-- Logs begin at Tue 2022-09-13 14:49:31 UTC, end at Tue 2022-09-13 15:47:52 UTC. -- Sep 13 15:14:03.947910 dv-cinder-857434-2-smb systemd[1]: Starting Devstack devstack@keystone.service... Sep 13 15:14:03.958840 dv-cinder-857434-2-smb devstack@keystone.service[81438]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Sep 13 15:14:03.959563 dv-cinder-857434-2-smb devstack@keystone.service[81438]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Sep 13 15:14:03 2022] *** Sep 13 15:14:03.959563 dv-cinder-857434-2-smb devstack@keystone.service[81438]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 13 15:14:03.959563 dv-cinder-857434-2-smb devstack@keystone.service[81438]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 13 15:14:03.959563 dv-cinder-857434-2-smb devstack@keystone.service[81438]: nodename: dv-cinder-857434-2-smb Sep 13 15:14:03.959563 dv-cinder-857434-2-smb devstack@keystone.service[81438]: machine: x86_64 Sep 13 15:14:03.959563 dv-cinder-857434-2-smb devstack@keystone.service[81438]: clock source: unix Sep 13 15:14:03.959563 dv-cinder-857434-2-smb devstack@keystone.service[81438]: pcre jit disabled Sep 13 15:14:03.959563 dv-cinder-857434-2-smb devstack@keystone.service[81438]: detected number of CPU cores: 4 Sep 13 15:14:03.959563 dv-cinder-857434-2-smb devstack@keystone.service[81438]: current working directory: / Sep 13 15:14:03.959563 dv-cinder-857434-2-smb devstack@keystone.service[81438]: detected binary path: /usr/bin/uwsgi-core Sep 13 15:14:03.960328 dv-cinder-857434-2-smb devstack@keystone.service[81438]: your processes number limit is 47680 Sep 13 15:14:03.960328 dv-cinder-857434-2-smb devstack@keystone.service[81438]: your memory page size is 4096 bytes Sep 13 15:14:03.960328 dv-cinder-857434-2-smb devstack@keystone.service[81438]: detected max file descriptor number: 2048 Sep 13 15:14:03.960328 dv-cinder-857434-2-smb devstack@keystone.service[81438]: lock engine: pthread robust mutexes Sep 13 15:14:03.960328 dv-cinder-857434-2-smb devstack@keystone.service[81438]: thunder lock: enabled Sep 13 15:14:03.960328 dv-cinder-857434-2-smb devstack@keystone.service[81438]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Sep 13 15:14:03.960328 dv-cinder-857434-2-smb devstack@keystone.service[81438]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 13 15:14:03.998926 dv-cinder-857434-2-smb devstack@keystone.service[81438]: Python main interpreter initialized at 0x5591e69769c0 Sep 13 15:14:03.998926 dv-cinder-857434-2-smb devstack@keystone.service[81438]: python threads support enabled Sep 13 15:14:03.998926 dv-cinder-857434-2-smb devstack@keystone.service[81438]: your server socket listen backlog is limited to 100 connections Sep 13 15:14:03.998926 dv-cinder-857434-2-smb devstack@keystone.service[81438]: your mercy for graceful operations on workers is 90 seconds Sep 13 15:14:03.999347 dv-cinder-857434-2-smb devstack@keystone.service[81438]: mapped 403077 bytes (393 KB) for 2 cores Sep 13 15:14:03.999436 dv-cinder-857434-2-smb devstack@keystone.service[81438]: *** Operational MODE: preforking *** Sep 13 15:14:03.999715 dv-cinder-857434-2-smb devstack@keystone.service[81438]: *** uWSGI is running in multiple interpreter mode *** Sep 13 15:14:03.999715 dv-cinder-857434-2-smb devstack@keystone.service[81438]: spawned uWSGI master process (pid: 81438) Sep 13 15:14:03.999905 dv-cinder-857434-2-smb systemd[1]: Started Devstack devstack@keystone.service. Sep 13 15:14:04.001032 dv-cinder-857434-2-smb devstack@keystone.service[81438]: spawned uWSGI worker 1 (pid: 81449, cores: 1) Sep 13 15:14:04.001032 dv-cinder-857434-2-smb devstack@keystone.service[81438]: spawned uWSGI worker 2 (pid: 81450, cores: 1) Sep 13 15:14:04.001032 dv-cinder-857434-2-smb devstack@keystone.service[81438]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 13 15:14:08.284813 dv-cinder-857434-2-smb devstack@keystone.service[81449]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 13 15:14:08.284813 dv-cinder-857434-2-smb devstack@keystone.service[81449]: from cryptography.utils import int_from_bytes Sep 13 15:14:08.285692 dv-cinder-857434-2-smb devstack@keystone.service[81449]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 13 15:14:08.285692 dv-cinder-857434-2-smb devstack@keystone.service[81449]: from cryptography.utils import int_from_bytes Sep 13 15:14:08.285859 dv-cinder-857434-2-smb devstack@keystone.service[81450]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 13 15:14:08.285859 dv-cinder-857434-2-smb devstack@keystone.service[81450]: from cryptography.utils import int_from_bytes Sep 13 15:14:08.286271 dv-cinder-857434-2-smb devstack@keystone.service[81450]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 13 15:14:08.286271 dv-cinder-857434-2-smb devstack@keystone.service[81450]: from cryptography.utils import int_from_bytes Sep 13 15:14:08.335345 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 13 15:14:08.335531 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 13 15:14:08.335725 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] command line args: [] {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 13 15:14:08.335999 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 13 15:14:08.336177 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ================================================================================ {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 13 15:14:08.336433 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] admin_token = **** {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:14:08.336541 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 13 15:14:08.336681 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] config_dir = [] {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:14:08.336769 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 13 15:14:08.336870 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:14:08.336949 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] command line args: [] {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 13 15:14:08.337054 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] config_source = [] {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:14:08.337141 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 13 15:14:08.337221 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] debug = True {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:14:08.337294 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ================================================================================ {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 13 15:14:08.337422 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:14:08.338698 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] admin_token = **** {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:14:08.338698 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] config_dir = [] {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:14:08.338831 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:14:08.338891 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:14:08.338953 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:14:08.339016 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] config_source = [] {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:14:08.339074 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:14:08.339142 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] debug = True {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:14:08.339207 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:14:08.339265 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:14:08.339350 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] list_limit = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:14:08.339416 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:14:08.339484 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] log_config_append = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:14:08.339548 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:14:08.339605 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:14:08.339662 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:14:08.339718 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] log_dir = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:14:08.339718 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] log_file = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:14:08.339826 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:14:08.339885 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:14:08.339947 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] list_limit = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:14:08.339947 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] log_config_append = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:14:08.340047 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:14:08.340102 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:14:08.340168 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:14:08.340231 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] log_dir = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:14:08.340293 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] log_file = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:14:08.340354 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:14:08.340650 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:14:08.340735 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:14:08.340859 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:14:08.340944 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:14:08.341017 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:14:08.341135 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:14:08.341210 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:14:08.341338 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:14:08.341418 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:14:08.341540 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:14:08.341540 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:14:08.341789 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:14:08.341922 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:14:08.342062 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:14:08.342150 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:14:08.342313 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:14:08.342432 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:14:08.342569 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:14:08.342685 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:14:08.342812 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:14:08.342939 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:14:08.343049 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:14:08.343168 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:14:08.343284 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:14:08.343519 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:14:08.343645 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.27/identity {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:14:08.343768 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] publish_errors = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:14:08.343889 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:14:08.344005 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:14:08.344179 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:14:08.344304 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.27/identity {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:14:08.344427 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:14:08.344549 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] publish_errors = False {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:14:08.344672 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:14:08.344794 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:14:08.344909 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:14:08.345022 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:14:08.345152 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] standard_threads = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:14:08.345275 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:14:08.345391 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:14:08.345505 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:14:08.345618 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:14:08.345765 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:14:08.345895 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:14:08.346014 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] standard_threads = False {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:14:08.346128 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] use_journal = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:14:08.346128 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] use_json = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:14:08.346340 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:14:08.346460 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] use_stderr = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:14:08.346625 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:14:08.346744 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] use_syslog = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:14:08.346859 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:14:08.346972 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:14:08.347087 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] use_journal = False {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:14:08.347087 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] use_json = False {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:14:08.347307 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.347423 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] use_stderr = False {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:14:08.347544 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.347660 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] use_syslog = False {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:14:08.347774 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.347887 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:14:08.348015 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.348133 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.348248 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.348361 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.348475 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.348588 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.348713 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.348829 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.348943 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.349056 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.349178 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.349293 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.349415 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.349537 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.349653 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.349797 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.349921 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.350037 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.350163 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.350280 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.350394 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.350515 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.350637 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.350760 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.350887 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.351004 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.351118 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.351232 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.351346 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.351459 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.351581 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.351698 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.351812 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.351925 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.352045 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.352160 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.352356 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.352533 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.352654 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.352770 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.352890 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.353018 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.353146 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.353262 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.353376 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.353490 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.353603 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.353752 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.353872 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.353986 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.354106 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.354227 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.354343 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.354466 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.354582 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.354695 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.354808 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.354921 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.355041 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.355164 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.355279 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.355399 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.355516 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.355630 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.355753 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.355878 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.355994 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.356114 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.356229 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.356343 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.356463 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.356591 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.356706 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.356826 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.356947 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.357062 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.357694 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.357854 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.357979 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.358102 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.358217 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.358331 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.358445 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.358638 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.358762 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.358877 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.358991 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.359112 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.359112 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.359341 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.359341 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.359565 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.359680 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.359794 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.359907 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.360031 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.360031 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.360245 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.360358 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.360499 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.360614 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.360741 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.360741 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.360957 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.360957 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.361183 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.361183 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.361405 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.361526 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.361643 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.361853 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.361980 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.361980 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.362191 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.362191 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.362376 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.362376 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.362557 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.362557 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.362746 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.362746 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.362938 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.363041 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.363139 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.363265 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.363394 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.363394 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.363627 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.363744 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.363860 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.363860 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.364063 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.364185 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.364302 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.364413 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.364534 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.364649 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.364764 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.364887 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.365004 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.365004 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.365226 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.365343 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.365457 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.365583 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.365714 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.365832 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.365938 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.366051 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.366166 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.366293 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.366417 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.366534 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.366649 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.366763 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.366877 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.367001 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.367118 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.367223 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.367335 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.367457 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.367579 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.367703 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.367820 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.367935 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.368051 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.368165 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.368279 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.368402 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.368519 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.368634 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.368748 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.368863 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.368977 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.369101 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.369218 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.369333 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.369454 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.369570 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.369684 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.369903 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.370023 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.370145 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.370268 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.370368 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.370490 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.370616 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.370748 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.370865 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.370980 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.371094 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.371210 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.371324 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.371447 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.371564 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.371679 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.371794 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.371915 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.372032 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.372154 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.372273 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.372388 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.372502 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.372616 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.372730 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.373438 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.373564 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.373681 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.373877 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] auth.external = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.374005 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.374150 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.374277 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.374397 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.374523 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.374523 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] auth.external = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.374743 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.374743 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] auth.password = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.374970 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.375088 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] auth.token = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.375212 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.375331 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.375448 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.375564 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.375683 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] auth.password = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.375799 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.375923 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] auth.token = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.376041 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.376157 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.376272 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.376394 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.376518 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.376644 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.376762 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.376878 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.376994 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] credential.caching = True {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.377109 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.377225 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.377352 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.377472 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.377587 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.377716 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.377834 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] credential.caching = True {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.377950 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.378080 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.378199 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.378316 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.378432 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.378549 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.378671 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.378797 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.378915 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.379031 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.379153 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.379271 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.379387 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.379511 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.379630 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.379747 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.379862 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.379978 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.380093 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.380217 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.380335 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.380451 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.380566 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.380682 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.380797 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] federation.caching = True {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.380921 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.381046 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.381165 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.381281 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.381396 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.381511 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.381636 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] federation.caching = True {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.381778 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.381898 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.382014 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.382129 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.382253 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.382372 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.382488 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.382604 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.382720 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.382836 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.382960 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.383079 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.383195 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.383311 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.383427 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.383543 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.383667 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] identity.caching = True {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.383786 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.383902 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.384018 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.384143 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.384260 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.384450 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.384571 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] identity.caching = True {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.384687 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.384805 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.384920 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.385036 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.385161 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.385279 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.385395 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.385514 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.385632 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.385760 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.385891 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.386010 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.386126 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.386242 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.386358 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.386473 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.386597 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.386721 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.386839 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.386956 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.387072 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.387187 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.387311 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.387429 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.387545 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.387662 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.387784 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.387902 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.388027 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.388154 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.388272 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.388411 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.388536 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.388652 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.388777 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.388777 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.388998 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.389114 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.389230 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.389345 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.389469 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.389588 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.389730 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.389849 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.389965 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.390082 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.390210 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.390329 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.390445 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.390568 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.390685 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.390803 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.390931 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.391051 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.391168 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.391283 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.391398 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.391513 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.391637 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.391755 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.391871 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.391987 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.392103 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.392231 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.392350 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.392466 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.392581 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.392697 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.392813 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.392937 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.393055 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.393172 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.393288 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.393403 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.393518 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.393642 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.393786 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.393912 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.394030 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.394147 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.394263 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.394387 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.394506 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.394622 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.394744 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.394860 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.394977 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.395101 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.395219 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.395337 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.395457 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.395573 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.395689 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.395817 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.user = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.395935 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.396051 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.396175 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.396293 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.396410 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.396534 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.396652 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.396768 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.396884 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.user = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.397000 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.397115 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.397239 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.397358 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.397474 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.397590 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.397759 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.397759 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.397994 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.398113 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.398228 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.398344 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.398460 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.398576 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.398703 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.398821 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.398937 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.399052 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.399168 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.399284 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.399407 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.399527 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.399643 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.399643 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.399860 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.399860 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.400084 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.400202 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.400318 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.400434 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.400556 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.400674 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.400798 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.400916 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.401031 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.401147 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.401262 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.401377 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.401501 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.401620 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.401753 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.401871 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.401986 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.402102 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.402229 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.402348 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.402464 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.402645 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.402765 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.402881 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.403007 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.403126 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.403243 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.403369 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.403487 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.403603 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.403729 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.403847 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.403963 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.404622 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.404747 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.404864 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.404990 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.405109 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] resource.caching = True {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.405226 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.405347 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.405464 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.405579 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.405724 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.405844 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.405961 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.406077 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.406193 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.406308 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.406437 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] resource.caching = True {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.406557 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.406673 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.406788 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.406904 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.407020 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.407145 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.407263 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.407379 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.407485 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] role.caching = True {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.407594 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.407785 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] role.driver = sql {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.407907 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.408023 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.408139 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.408255 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.408371 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.408495 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.408614 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.408730 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.408846 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] role.caching = True {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.408962 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.409078 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] role.driver = sql {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.409202 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.409321 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.409437 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.409552 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.409668 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.409877 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.410009 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.410128 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.410244 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.410359 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.410475 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.410590 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.410714 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.410833 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.410939 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.411054 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.411171 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.411287 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.411411 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.411529 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.411645 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.411761 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.411877 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.411993 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.412119 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.412237 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.412353 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.412469 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.412584 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.412700 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.412825 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.412943 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.413059 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.413175 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.413291 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.413415 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.413533 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.413649 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.413780 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.413780 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.413997 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.414125 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.414246 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.414362 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.414478 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.414593 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.414708 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.414832 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.414950 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.415066 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.415183 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.415303 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.415418 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.415542 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.415660 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.415776 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] token.caching = True {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.415891 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.416007 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.416122 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.416247 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.416366 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.416481 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.416597 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.416712 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.416827 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.416951 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.417069 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.417185 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.417302 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] token.caching = True {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.417417 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.417532 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.417646 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.417767 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.417884 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.417999 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.418115 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.418231 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.418364 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.418484 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.418600 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.418716 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.418831 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.418947 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.419071 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.419189 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.419306 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.419436 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.419564 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.420284 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.420434 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.420563 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.420563 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.420784 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] database.connection = **** {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.420901 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.421007 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.421007 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.421231 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.421350 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.421466 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.421466 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.421732 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.421732 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.421969 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.421969 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] database.connection = **** {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.422198 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.422316 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.422433 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.422550 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.422665 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.422781 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.422906 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.423024 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.423140 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.423256 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.423371 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.423487 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.423613 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.423731 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.423847 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.423964 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.424079 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.424195 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.424319 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.424438 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.424554 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.424671 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.424788 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.424905 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.425030 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.425149 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.425270 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 13 15:14:08.425388 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.425388 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.425388 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.425388 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.425388 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:14:08.425388 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 13 15:14:08.453204 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81449) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 15:14:08.453392 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81450) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 15:14:08.453495 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81449) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 15:14:08.453628 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81450) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 15:14:08.453797 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81449) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 15:14:08.453880 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81450) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 15:14:08.461932 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81449) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 15:14:08.462157 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81450) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 15:14:08.491148 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81449) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 15:14:08.491379 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81449) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 15:14:08.491583 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81450) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 15:14:08.491822 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81450) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 15:14:08.544990 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81449) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 15:14:08.545126 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81450) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 15:14:08.594190 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81449) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 15:14:08.594421 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81449) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 15:14:08.595491 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81450) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 15:14:08.595732 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81450) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 15:14:08.752204 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81450) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 15:14:08.752390 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81449) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 15:14:08.752536 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81450) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 15:14:08.752620 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81449) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 15:14:08.752719 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81450) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 15:14:08.752799 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81449) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 15:14:08.752872 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81450) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 15:14:08.753022 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81449) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 15:14:08.753106 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81450) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 15:14:08.753244 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81449) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 15:14:08.753336 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81450) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 15:14:08.753461 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81449) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 15:14:08.777233 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81449) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 15:14:08.777365 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81450) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 15:14:08.777451 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81449) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 15:14:08.777680 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81450) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 15:14:08.777795 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81449) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 15:14:08.777940 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81450) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 15:14:08.778025 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81449) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 15:14:08.778171 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81450) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 15:14:08.778267 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81449) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 15:14:08.778387 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81449) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 15:14:08.778468 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81450) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 15:14:08.778607 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81449) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 15:14:08.778690 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81450) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 15:14:08.778824 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81450) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 15:14:08.789997 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81449) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 15:14:08.790302 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81450) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 15:14:08.803551 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81449) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 15:14:08.803737 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81449) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 15:14:08.803936 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81450) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 15:14:08.804034 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81449) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 15:14:08.804178 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81450) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 15:14:08.804328 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81449) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 15:14:08.804409 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81450) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 15:14:08.804483 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81449) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 15:14:08.804625 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81450) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 15:14:08.804710 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81449) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 15:14:08.804839 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81449) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 15:14:08.804920 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81450) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 15:14:08.805060 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81450) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 15:14:08.805281 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81450) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 15:14:08.821880 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 15:14:08.822090 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 13 15:14:08.822274 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 15:14:08.822439 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 15:14:08.822520 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 13 15:14:08.822641 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 13 15:14:08.822819 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 15:14:08.822902 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 15:14:08.823023 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 13 15:14:08.823170 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 15:14:08.823307 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 15:14:08.823433 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 15:14:08.823842 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 15:14:08.823960 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 15:14:08.824112 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 15:14:08.824379 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 15:14:08.834022 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 15:14:08.834305 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 15:14:08.834582 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 15:14:08.834760 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 15:14:08.834870 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 15:14:08.835047 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 15:14:08.835326 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 15:14:08.835619 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 15:14:08.841922 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81449) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 15:14:08.842865 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81450) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 15:14:08.844819 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81449) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 15:14:08.845113 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 15:14:08.845405 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 15:14:08.845719 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 15:14:08.845802 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81450) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 15:14:08.846017 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 15:14:08.846113 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 15:14:08.846284 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 15:14:08.846367 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 15:14:08.846560 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 15:14:08.846643 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 15:14:08.846841 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 15:14:08.846924 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 15:14:08.847119 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 15:14:08.847202 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 15:14:08.847397 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 15:14:08.847487 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 15:14:08.847669 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 15:14:08.847751 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 15:14:08.847943 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 15:14:08.848224 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 15:14:08.848499 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 15:14:08.870799 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 15:14:08.871538 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 15:14:08.872258 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81449) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 15:14:08.872550 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 15:14:08.873159 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81450) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 15:14:08.873452 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 15:14:08.877248 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81449) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 15:14:08.877541 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 15:14:08.877858 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 15:14:08.878170 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81450) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 15:14:08.878465 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 15:14:08.878757 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 15:14:08.884171 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81449) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 15:14:08.884465 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 15:14:08.885068 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81450) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 15:14:08.885364 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 15:14:08.890623 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81449) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 15:14:08.890926 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 15:14:08.891220 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 15:14:08.891513 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 15:14:08.891594 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81450) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 15:14:08.891800 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 15:14:08.891885 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 15:14:08.892086 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 15:14:08.892169 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 15:14:08.892364 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 15:14:08.892455 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 15:14:08.892638 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 15:14:08.892721 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 15:14:08.892950 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 15:14:08.893227 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 15:14:08.893502 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 15:14:08.908101 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 15:14:08.908383 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 15:14:08.909092 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 15:14:08.909377 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 15:14:08.912241 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81449) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 15:14:08.913244 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81450) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 15:14:08.915507 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 15:14:08.915810 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 15:14:08.916501 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 15:14:08.916803 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 15:14:08.920612 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81449) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 15:14:08.921901 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81450) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 15:14:08.923873 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81449) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 15:14:08.925024 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81450) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 15:14:08.927123 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 15:14:08.927429 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 15:14:08.927720 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 15:14:08.928008 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 15:14:08.928272 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 15:14:08.928354 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 15:14:08.928573 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 15:14:08.928655 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 15:14:08.928870 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 15:14:08.929169 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 15:14:08.929457 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 15:14:08.929777 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 15:14:08.944389 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81449) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 15:14:08.944684 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 15:14:08.944958 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 15:14:08.945227 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 15:14:08.946530 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81450) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 15:14:08.946826 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 15:14:08.947109 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 15:14:08.947381 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 15:14:08.952836 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 15:14:08.954408 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 15:14:08.955102 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 15:14:08.955935 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 15:14:08.956218 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 15:14:08.956650 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 15:14:08.958224 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 15:14:08.958510 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 15:14:08.959078 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81449) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 15:14:08.959371 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 15:14:08.959665 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 15:14:08.959955 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 15:14:08.960346 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 15:14:08.961168 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81450) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 15:14:08.961460 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 15:14:08.961778 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 15:14:08.962073 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 15:14:08.962467 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 15:14:08.971536 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81449) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 15:14:08.971827 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 15:14:08.972114 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 15:14:08.972398 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 15:14:08.972782 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 15:14:08.973080 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 15:14:08.973365 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 15:14:08.973639 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81450) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 15:14:08.973956 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 15:14:08.974249 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 15:14:08.974550 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 15:14:08.974942 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 15:14:08.975240 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 15:14:08.975530 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 15:14:08.989284 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81449) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 15:14:08.991362 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81450) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 15:14:08.992219 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81449) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 15:14:08.994328 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81450) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 15:14:08.995114 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 15:14:08.996559 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 15:14:08.997194 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 15:14:08.998266 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81449) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 15:14:08.998558 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 15:14:08.998892 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 15:14:08.998974 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 15:14:09.000499 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81450) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 15:14:09.000791 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 15:14:09.001192 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 15:14:09.005265 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 15:14:09.006742 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81449) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 15:14:09.007585 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 15:14:09.009055 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81450) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 15:14:09.009607 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 15:14:09.010036 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 15:14:09.010328 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 15:14:09.010607 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 15:14:09.011968 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 15:14:09.012372 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 15:14:09.012668 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 15:14:09.012955 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 15:14:09.018980 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81449) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 15:14:09.019277 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 15:14:09.019560 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 15:14:09.021477 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81450) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 15:14:09.021808 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 15:14:09.022099 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 15:14:09.026421 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81449) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 15:14:09.026709 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 15:14:09.026992 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 15:14:09.027272 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 15:14:09.027552 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 15:14:09.027830 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 15:14:09.028114 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 15:14:09.028407 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 15:14:09.028682 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 15:14:09.028926 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81450) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 15:14:09.029078 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 15:14:09.029289 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 15:14:09.029388 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 15:14:09.029600 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 15:14:09.029724 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 15:14:09.029842 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 15:14:09.029940 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 15:14:09.030117 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 15:14:09.030199 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 15:14:09.030420 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 15:14:09.030704 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 15:14:09.031007 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 15:14:09.031285 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 15:14:09.031566 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 15:14:09.031854 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 15:14:09.032130 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 15:14:09.032402 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 15:14:09.032677 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 15:14:09.064606 dv-cinder-857434-2-smb devstack@keystone.service[81449]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5591e69769c0 pid: 81449 (default app) Sep 13 15:14:09.066921 dv-cinder-857434-2-smb devstack@keystone.service[81450]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5591e69769c0 pid: 81450 (default app) Sep 13 15:14:09.067814 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e116bec-15e8-4ae0-b488-7270f500d745 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:09.068105 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e116bec-15e8-4ae0-b488-7270f500d745 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:09.068383 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e116bec-15e8-4ae0-b488-7270f500d745 None None] PATH_INFO: `/v3` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:09.072538 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1/1] 10.222.0.27 () {50 vars in 791 bytes} [Tue Sep 13 15:14:09 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:14:15.884746 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6828bf-dbe1-416e-80ca-9bf02363bb8c None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:15.885348 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6828bf-dbe1-416e-80ca-9bf02363bb8c None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:15.885348 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6828bf-dbe1-416e-80ca-9bf02363bb8c None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:15.890305 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1/2] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:14:15 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 15:14:15.895577 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ca569b-1ae5-483a-b650-8977c731a918 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:15.895998 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ca569b-1ae5-483a-b650-8977c731a918 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:15.896132 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ca569b-1ae5-483a-b650-8977c731a918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:15.972031 dv-cinder-857434-2-smb devstack@keystone.service[81449]: INFO dbcounter [None req-d2ca569b-1ae5-483a-b650-8977c731a918 None None] Registered counter for database keystone Sep 13 15:14:15.991271 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG oslo_db.sqlalchemy.engines [None req-d2ca569b-1ae5-483a-b650-8977c731a918 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81449) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 15:14:15.998411 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writer thread running {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 15:14:16.174691 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG passlib.handlers.bcrypt [None req-d2ca569b-1ae5-483a-b650-8977c731a918 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81449) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 13 15:14:16.175075 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG passlib.handlers.bcrypt [None req-d2ca569b-1ae5-483a-b650-8977c731a918 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81449) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 13 15:14:16.234009 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-d2ca569b-1ae5-483a-b650-8977c731a918 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:14:16.235554 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-d2ca569b-1ae5-483a-b650-8977c731a918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:14:16.365395 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 2/3] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:14:15 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 471 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 13 15:14:16.846484 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6828bf-dbe1-416e-80ca-9bf02363bb8c None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:14:16.915521 dv-cinder-857434-2-smb devstack@keystone.service[81450]: INFO dbcounter [None req-ba6828bf-dbe1-416e-80ca-9bf02363bb8c None None] Registered counter for database keystone Sep 13 15:14:16.937249 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG oslo_db.sqlalchemy.engines [None req-ba6828bf-dbe1-416e-80ca-9bf02363bb8c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81450) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 15:14:16.943465 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writer thread running {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 15:14:17.061495 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6828bf-dbe1-416e-80ca-9bf02363bb8c None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:14:17.065686 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f17253-e09f-422a-82b0-fc632aa8f61c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:14:17.066328 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f17253-e09f-422a-82b0-fc632aa8f61c admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:17.066610 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f17253-e09f-422a-82b0-fc632aa8f61c admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:17.066882 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f17253-e09f-422a-82b0-fc632aa8f61c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:17.075776 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f17253-e09f-422a-82b0-fc632aa8f61c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:14:17.128543 dv-cinder-857434-2-smb devstack@keystone.service[81450]: WARNING keystone.common.rbac_enforcer.enforcer [None req-e0f17253-e09f-422a-82b0-fc632aa8f61c admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 13 15:14:17.128896 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f17253-e09f-422a-82b0-fc632aa8f61c admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:14:17.138796 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 2/4] 10.222.0.27 () {58 vars in 1324 bytes} [Tue Sep 13 15:14:16 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 13 15:14:17.146090 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ca569b-1ae5-483a-b650-8977c731a918 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:14:17.163626 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ca569b-1ae5-483a-b650-8977c731a918 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:14:17.168093 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97d6645-92f7-4f5d-8307-05200b18679e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:14:17.169211 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97d6645-92f7-4f5d-8307-05200b18679e admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:17.169507 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97d6645-92f7-4f5d-8307-05200b18679e admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:17.169814 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97d6645-92f7-4f5d-8307-05200b18679e admin admin] PATH_INFO: `/v3/projects/7edec545f8774b83a9353b60f81fc3c1` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:17.171426 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97d6645-92f7-4f5d-8307-05200b18679e admin admin] RBAC: Authorizing `identity:get_project(project_id=7edec545f8774b83a9353b60f81fc3c1)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:14:17.225371 dv-cinder-857434-2-smb devstack@keystone.service[81449]: WARNING keystone.common.rbac_enforcer.enforcer [None req-e97d6645-92f7-4f5d-8307-05200b18679e admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 13 15:14:17.225740 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97d6645-92f7-4f5d-8307-05200b18679e admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:14:17.230251 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 3/5] 10.222.0.27 () {56 vars in 1207 bytes} [Tue Sep 13 15:14:17 2022] GET /identity/v3/projects/7edec545f8774b83a9353b60f81fc3c1 => generated 344 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 15:14:19.343152 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31d5650-8010-4247-ae40-0515a20b78e7 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:19.343702 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31d5650-8010-4247-ae40-0515a20b78e7 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:19.343702 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31d5650-8010-4247-ae40-0515a20b78e7 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:19.347790 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 3/6] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:14:19 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:14:19.353177 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392fd72d-759d-497c-8b86-5fdcf6e4828e None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:19.353565 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392fd72d-759d-497c-8b86-5fdcf6e4828e None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:19.353763 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392fd72d-759d-497c-8b86-5fdcf6e4828e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:19.374823 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-392fd72d-759d-497c-8b86-5fdcf6e4828e None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:14:19.376352 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-392fd72d-759d-497c-8b86-5fdcf6e4828e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:14:19.384142 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 4/7] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:14:19 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 13 15:14:19.646474 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31d5650-8010-4247-ae40-0515a20b78e7 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:14:19.659097 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31d5650-8010-4247-ae40-0515a20b78e7 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:14:19.663308 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ce7183-c8ad-4721-87ce-6680792fb1c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:14:19.663911 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ce7183-c8ad-4721-87ce-6680792fb1c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:19.664197 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ce7183-c8ad-4721-87ce-6680792fb1c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:19.664473 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ce7183-c8ad-4721-87ce-6680792fb1c4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:19.672969 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ce7183-c8ad-4721-87ce-6680792fb1c4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:14:19.674835 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ce7183-c8ad-4721-87ce-6680792fb1c4 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:14:19.684034 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 4/8] 10.222.0.27 () {58 vars in 1324 bytes} [Tue Sep 13 15:14:19 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 15:14:19.689648 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392fd72d-759d-497c-8b86-5fdcf6e4828e None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:14:19.699099 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392fd72d-759d-497c-8b86-5fdcf6e4828e None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:14:19.703461 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393f093f-8870-4cee-ad77-985afa1ddfff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:14:19.704117 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393f093f-8870-4cee-ad77-985afa1ddfff admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:19.704400 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393f093f-8870-4cee-ad77-985afa1ddfff admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:19.704678 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393f093f-8870-4cee-ad77-985afa1ddfff admin admin] PATH_INFO: `/v3/users/50d6e356b66c47338a3bc6aea3a43029` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:19.706014 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393f093f-8870-4cee-ad77-985afa1ddfff admin admin] RBAC: Authorizing `identity:get_user(user_id=50d6e356b66c47338a3bc6aea3a43029)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:14:19.707837 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393f093f-8870-4cee-ad77-985afa1ddfff admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:14:19.709354 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 5/9] 10.222.0.27 () {56 vars in 1198 bytes} [Tue Sep 13 15:14:19 2022] GET /identity/v3/users/50d6e356b66c47338a3bc6aea3a43029 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:14:21.928595 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f273bc0c-878b-4b13-a0d0-bfce339dfa64 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:21.929118 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f273bc0c-878b-4b13-a0d0-bfce339dfa64 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:21.929118 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f273bc0c-878b-4b13-a0d0-bfce339dfa64 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:21.930499 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 5/10] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:14:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 15:14:21.936572 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f430f19b-9c34-410a-a89d-0f19116fea0b None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:21.936998 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f430f19b-9c34-410a-a89d-0f19116fea0b None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:21.937214 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f430f19b-9c34-410a-a89d-0f19116fea0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:21.955962 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-f430f19b-9c34-410a-a89d-0f19116fea0b None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:14:21.957145 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-f430f19b-9c34-410a-a89d-0f19116fea0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:14:21.973439 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f445967-4451-4459-822c-79bf31981ef7 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:21.973652 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f445967-4451-4459-822c-79bf31981ef7 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:21.973960 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f445967-4451-4459-822c-79bf31981ef7 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:21.975281 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 6/11] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:14:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 15:14:21.980337 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bbc79c-197e-48c1-98da-9918e1b65395 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:21.980619 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bbc79c-197e-48c1-98da-9918e1b65395 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:21.980890 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bbc79c-197e-48c1-98da-9918e1b65395 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:22.024064 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG passlib.handlers.bcrypt [None req-e8bbc79c-197e-48c1-98da-9918e1b65395 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81450) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 13 15:14:22.024455 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG passlib.handlers.bcrypt [None req-e8bbc79c-197e-48c1-98da-9918e1b65395 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81450) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 13 15:14:22.038701 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 6/12] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:14:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 15:14:22.073658 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-e8bbc79c-197e-48c1-98da-9918e1b65395 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:14:22.075944 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-e8bbc79c-197e-48c1-98da-9918e1b65395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:14:22.174424 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 7/13] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:14:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 15:14:22.321144 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f430f19b-9c34-410a-a89d-0f19116fea0b None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:14:22.344859 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:14:22.424225 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f430f19b-9c34-410a-a89d-0f19116fea0b None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:14:22.442735 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bbc79c-197e-48c1-98da-9918e1b65395 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:14:22.457428 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd227ed8-9074-4f61-8921-082af6487cc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:14:22.458091 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd227ed8-9074-4f61-8921-082af6487cc0 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:22.458375 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd227ed8-9074-4f61-8921-082af6487cc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:22.458677 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd227ed8-9074-4f61-8921-082af6487cc0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:22.469578 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd227ed8-9074-4f61-8921-082af6487cc0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 15:14:22.478456 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-dd227ed8-9074-4f61-8921-082af6487cc0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 15:14:22.478456 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:14:22.478456 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:14:22.478456 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:14:22.478456 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:14:22.478456 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:14:22.478456 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:14:22.478456 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:14:22.478456 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:14:22.478456 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:14:22.478456 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:14:22.478456 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:14:22.478456 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 15:14:22.478456 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 15:14:22.478456 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 15:14:22.478456 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 15:14:22.479362 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 15:14:22.479362 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 15:14:22.479362 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 15:14:22.479362 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 15:14:22.479362 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:14:22.479362 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:14:22.479362 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:14:22.479362 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:14:22.479362 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:14:22.479362 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:14:22.479362 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:14:22.479362 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Sep 13 15:14:22.479362 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:14:22.479362 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:14:22.479362 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:14:22.479362 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:14:22.480183 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:14:22.480183 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:14:22.480183 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:14:22.480183 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:14:22.480183 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 15:14:22.480183 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 15:14:22.480183 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 15:14:22.480183 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 15:14:22.480183 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 15:14:22.480183 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 15:14:22.480183 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 15:14:22.480183 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Sep 13 15:14:22.480183 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 7/14] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Sep 13 15:14:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:14:22.486015 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd227ed8-9074-4f61-8921-082af6487cc0 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:14:22.544708 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bbc79c-197e-48c1-98da-9918e1b65395 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:14:22.546798 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:14:22.567645 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:14:22.582756 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14840ea0-ba41-4e76-bbb9-a599fef1a3ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:14:22.583567 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14840ea0-ba41-4e76-bbb9-a599fef1a3ba None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:22.583854 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14840ea0-ba41-4e76-bbb9-a599fef1a3ba None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:22.584133 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14840ea0-ba41-4e76-bbb9-a599fef1a3ba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:22.587491 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd227ed8-9074-4f61-8921-082af6487cc0 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:14:22.620625 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff4b47d-18a1-4739-8faf-19473cd6b164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:14:22.621231 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff4b47d-18a1-4739-8faf-19473cd6b164 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:22.621514 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff4b47d-18a1-4739-8faf-19473cd6b164 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:22.622481 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff4b47d-18a1-4739-8faf-19473cd6b164 None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:22.623247 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff4b47d-18a1-4739-8faf-19473cd6b164 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:14:22.623559 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff4b47d-18a1-4739-8faf-19473cd6b164 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:14:22.624956 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff4b47d-18a1-4739-8faf-19473cd6b164 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:14:22.637111 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 8/15] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Sep 13 15:14:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 15:14:22.642469 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff4b47d-18a1-4739-8faf-19473cd6b164 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:14:22.654054 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14840ea0-ba41-4e76-bbb9-a599fef1a3ba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:14:22.655582 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14840ea0-ba41-4e76-bbb9-a599fef1a3ba None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:14:22.745437 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff4b47d-18a1-4739-8faf-19473cd6b164 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:14:22.756736 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 8/16] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Sep 13 15:14:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 13 15:14:22.762743 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14840ea0-ba41-4e76-bbb9-a599fef1a3ba None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:14:22.766360 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:14:22.782159 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12203999-4c32-415b-b337-9a8b959289db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:14:22.782796 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12203999-4c32-415b-b337-9a8b959289db None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:22.783081 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12203999-4c32-415b-b337-9a8b959289db None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:22.783357 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12203999-4c32-415b-b337-9a8b959289db None admin] PATH_INFO: `/v3/users/50d6e356b66c47338a3bc6aea3a43029` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:22.784513 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12203999-4c32-415b-b337-9a8b959289db None admin] RBAC: Authorizing `identity:get_user(user_id=50d6e356b66c47338a3bc6aea3a43029)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:14:22.786001 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12203999-4c32-415b-b337-9a8b959289db None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:14:22.787568 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 9/17] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Sep 13 15:14:22 2022] GET /identity/v3/users/50d6e356b66c47338a3bc6aea3a43029 => generated 247 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:14:22.792790 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12203999-4c32-415b-b337-9a8b959289db None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:14:22.807266 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:14:22.869444 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14840ea0-ba41-4e76-bbb9-a599fef1a3ba None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:14:22.892870 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12203999-4c32-415b-b337-9a8b959289db None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:14:22.902255 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437bafe8-c276-42bb-b314-bc971f497d3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:14:22.903663 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437bafe8-c276-42bb-b314-bc971f497d3d None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:22.904172 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437bafe8-c276-42bb-b314-bc971f497d3d None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:22.904509 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437bafe8-c276-42bb-b314-bc971f497d3d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:22.923373 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437bafe8-c276-42bb-b314-bc971f497d3d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:14:22.924828 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437bafe8-c276-42bb-b314-bc971f497d3d None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:14:22.927835 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57e9193-79b3-425a-9705-ae5a3df517f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:14:22.928462 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57e9193-79b3-425a-9705-ae5a3df517f8 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:22.928750 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57e9193-79b3-425a-9705-ae5a3df517f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:22.929029 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57e9193-79b3-425a-9705-ae5a3df517f8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:22.930180 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57e9193-79b3-425a-9705-ae5a3df517f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:14:22.931616 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57e9193-79b3-425a-9705-ae5a3df517f8 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:14:22.933157 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 10/18] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 13 15:14:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 15:14:22.939089 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57e9193-79b3-425a-9705-ae5a3df517f8 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:14:22.942851 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-437bafe8-c276-42bb-b314-bc971f497d3d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 15:14:22.942851 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:14:22.942851 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:14:22.942851 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:14:22.942851 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:14:22.942851 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:14:22.942851 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:14:22.942851 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:14:22.942851 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:14:22.942851 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:14:22.942851 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:14:22.942851 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:14:22.942851 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 15:14:22.942851 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 15:14:22.942851 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 15:14:22.942851 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 15:14:22.944046 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:14:22.944046 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:14:22.944046 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:14:22.944046 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:14:22.944046 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:14:22.944046 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:14:22.944046 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:14:22.944046 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Sep 13 15:14:22.944046 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:14:22.944046 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:14:22.944046 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:14:22.944046 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:14:22.944046 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:14:22.944046 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:14:22.944046 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:14:22.944046 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:14:22.944046 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 15:14:22.944840 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 15:14:22.944840 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 15:14:22.944840 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Sep 13 15:14:22.944840 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 9/19] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 13 15:14:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 15:14:22.949892 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437bafe8-c276-42bb-b314-bc971f497d3d None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:14:23.006806 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:14:23.021833 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:14:23.040711 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57e9193-79b3-425a-9705-ae5a3df517f8 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:14:23.055387 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437bafe8-c276-42bb-b314-bc971f497d3d None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:14:23.076909 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb465923-e931-4634-a1ed-42b0890cd703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:14:23.077518 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb465923-e931-4634-a1ed-42b0890cd703 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:23.077825 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb465923-e931-4634-a1ed-42b0890cd703 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:23.078105 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb465923-e931-4634-a1ed-42b0890cd703 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:23.078823 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb465923-e931-4634-a1ed-42b0890cd703 None admin] RBAC: Adding query filter params (role.id=f34412ad29f1478cba775b033129f71f, scope.domain.id=default, user.id=50d6e356b66c47338a3bc6aea3a43029) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:14:23.079126 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb465923-e931-4634-a1ed-42b0890cd703 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:14:23.080563 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb465923-e931-4634-a1ed-42b0890cd703 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:14:23.087138 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 11/20] 10.222.0.27 () {56 vars in 1322 bytes} [Tue Sep 13 15:14:22 2022] GET /identity/v3/role_assignments?user.id=50d6e356b66c47338a3bc6aea3a43029&scope.domain.id=default&role.id=f34412ad29f1478cba775b033129f71f => generated 233 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 15:14:23.088847 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9813d784-cf4e-45f8-bdb4-3f2e81918c2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:14:23.089458 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9813d784-cf4e-45f8-bdb4-3f2e81918c2b None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:23.089786 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9813d784-cf4e-45f8-bdb4-3f2e81918c2b None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:23.090063 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9813d784-cf4e-45f8-bdb4-3f2e81918c2b None admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:23.090733 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9813d784-cf4e-45f8-bdb4-3f2e81918c2b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:14:23.091037 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9813d784-cf4e-45f8-bdb4-3f2e81918c2b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:14:23.092456 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9813d784-cf4e-45f8-bdb4-3f2e81918c2b None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:14:23.112220 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 10/21] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Sep 13 15:14:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 15:14:25.629733 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535c4ed6-3b89-4a72-97ff-3b008fef1f95 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:25.630247 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535c4ed6-3b89-4a72-97ff-3b008fef1f95 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:25.630343 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535c4ed6-3b89-4a72-97ff-3b008fef1f95 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:25.631612 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 12/22] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:14:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:14:25.636992 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fda377-e895-4b9f-8a54-4148e5bccc1c None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:25.637529 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fda377-e895-4b9f-8a54-4148e5bccc1c None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:25.637804 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fda377-e895-4b9f-8a54-4148e5bccc1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:25.666693 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-31fda377-e895-4b9f-8a54-4148e5bccc1c None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:14:25.667904 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-31fda377-e895-4b9f-8a54-4148e5bccc1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:14:25.679997 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572e738b-9751-4965-ac23-dcf37df85052 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:25.680615 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572e738b-9751-4965-ac23-dcf37df85052 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:25.681194 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572e738b-9751-4965-ac23-dcf37df85052 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:25.682844 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 13/23] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:14:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:14:25.689603 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece629a5-bc8b-4b79-92d8-75c2836707b7 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:25.690364 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece629a5-bc8b-4b79-92d8-75c2836707b7 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:25.690846 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece629a5-bc8b-4b79-92d8-75c2836707b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:25.734859 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-ece629a5-bc8b-4b79-92d8-75c2836707b7 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:14:25.736104 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-ece629a5-bc8b-4b79-92d8-75c2836707b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:14:25.807884 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 11/24] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:14:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 15:14:25.822480 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599bdf8c-313d-4c0c-adc2-0922fd01d2c8 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:25.822763 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599bdf8c-313d-4c0c-adc2-0922fd01d2c8 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:25.823465 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599bdf8c-313d-4c0c-adc2-0922fd01d2c8 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:25.825401 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 12/25] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:14:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:14:25.831146 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f283fc2d-29e6-403f-801f-553e48d897c7 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:25.831787 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f283fc2d-29e6-403f-801f-553e48d897c7 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:25.832225 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f283fc2d-29e6-403f-801f-553e48d897c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:25.876507 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-f283fc2d-29e6-403f-801f-553e48d897c7 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:14:25.878760 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-f283fc2d-29e6-403f-801f-553e48d897c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:14:25.880166 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 14/26] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:14:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 15:14:25.951421 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:14:25.992466 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 13/27] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:14:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 15:14:26.206865 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece629a5-bc8b-4b79-92d8-75c2836707b7 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:14:26.281685 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f283fc2d-29e6-403f-801f-553e48d897c7 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:14:26.292053 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:14:26.340007 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece629a5-bc8b-4b79-92d8-75c2836707b7 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:14:26.422441 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00f3632-3990-46e1-b7a2-77b55b3ec64f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:14:26.423097 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00f3632-3990-46e1-b7a2-77b55b3ec64f None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:26.423379 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00f3632-3990-46e1-b7a2-77b55b3ec64f None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:26.423654 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00f3632-3990-46e1-b7a2-77b55b3ec64f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:26.433223 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f283fc2d-29e6-403f-801f-553e48d897c7 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:14:26.456413 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00f3632-3990-46e1-b7a2-77b55b3ec64f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 15:14:26.461802 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-c00f3632-3990-46e1-b7a2-77b55b3ec64f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 15:14:26.461802 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:14:26.461802 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:14:26.461802 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:14:26.461802 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:14:26.461802 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:14:26.461802 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:14:26.461802 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:14:26.461802 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:14:26.461802 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:14:26.461802 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:14:26.461802 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:14:26.461802 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 15:14:26.461802 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 15:14:26.461802 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 15:14:26.461802 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 15:14:26.462865 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 15:14:26.462865 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 15:14:26.462865 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 15:14:26.462865 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 15:14:26.462865 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:14:26.462865 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:14:26.462865 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:14:26.462865 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:14:26.462865 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:14:26.462865 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:14:26.462865 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:14:26.462865 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Sep 13 15:14:26.462865 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:14:26.462865 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:14:26.462865 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:14:26.462865 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:14:26.463829 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:14:26.463829 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:14:26.463829 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:14:26.463829 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:14:26.463829 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 15:14:26.463829 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 15:14:26.463829 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 15:14:26.463829 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 15:14:26.463829 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 15:14:26.463829 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 15:14:26.463829 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 15:14:26.463829 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Sep 13 15:14:26.463829 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 15/28] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Sep 13 15:14:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:14:26.463829 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00f3632-3990-46e1-b7a2-77b55b3ec64f None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:14:26.487786 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bbbee5-a0fa-44ed-b35e-21e720cc5a92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:14:26.488700 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bbbee5-a0fa-44ed-b35e-21e720cc5a92 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:26.489130 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bbbee5-a0fa-44ed-b35e-21e720cc5a92 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:26.489568 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bbbee5-a0fa-44ed-b35e-21e720cc5a92 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:26.510853 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bbbee5-a0fa-44ed-b35e-21e720cc5a92 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:14:26.515509 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bbbee5-a0fa-44ed-b35e-21e720cc5a92 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:14:26.538258 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-27bbbee5-a0fa-44ed-b35e-21e720cc5a92 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 15:14:26.538258 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:14:26.538258 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:14:26.538258 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:14:26.538258 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:14:26.538258 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:14:26.538258 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:14:26.538258 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:14:26.538258 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:14:26.538258 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:14:26.538258 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:14:26.538258 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:14:26.538258 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 15:14:26.538258 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 15:14:26.538258 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 15:14:26.538258 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 15:14:26.539361 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:14:26.539361 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:14:26.539361 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:14:26.539361 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:14:26.539361 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:14:26.539361 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:14:26.539361 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:14:26.539361 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Sep 13 15:14:26.539361 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:14:26.539361 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:14:26.539361 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:14:26.539361 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:14:26.539361 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:14:26.539361 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:14:26.539361 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:14:26.539361 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:14:26.539361 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 15:14:26.540379 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 15:14:26.540379 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 15:14:26.540379 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Sep 13 15:14:26.542122 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 14/29] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 13 15:14:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:14:26.543132 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bbbee5-a0fa-44ed-b35e-21e720cc5a92 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:14:26.574339 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:14:26.631783 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00f3632-3990-46e1-b7a2-77b55b3ec64f None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:14:26.660530 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bbbee5-a0fa-44ed-b35e-21e720cc5a92 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:14:26.670942 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043df709-1950-4437-9685-53abdb97b5e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:14:26.671948 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043df709-1950-4437-9685-53abdb97b5e7 None admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:26.672375 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043df709-1950-4437-9685-53abdb97b5e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:26.672801 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043df709-1950-4437-9685-53abdb97b5e7 None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:26.673735 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043df709-1950-4437-9685-53abdb97b5e7 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:14:26.675378 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043df709-1950-4437-9685-53abdb97b5e7 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:14:26.679650 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:14:26.700479 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd322ee9-f37f-4858-b946-53af94e3a353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:14:26.701197 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd322ee9-f37f-4858-b946-53af94e3a353 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:26.701848 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd322ee9-f37f-4858-b946-53af94e3a353 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:26.702207 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd322ee9-f37f-4858-b946-53af94e3a353 None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:26.702958 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd322ee9-f37f-4858-b946-53af94e3a353 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:14:26.703337 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd322ee9-f37f-4858-b946-53af94e3a353 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:14:26.704797 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd322ee9-f37f-4858-b946-53af94e3a353 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:14:26.719257 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 15/30] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Sep 13 15:14:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:14:26.725110 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd322ee9-f37f-4858-b946-53af94e3a353 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:14:26.817182 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 16/31] 10.222.0.27 () {60 vars in 1131 bytes} [Tue Sep 13 15:14:26 2022] POST /identity/v3/roles => generated 219 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:14:26.818821 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd899c0-04c5-4b9c-8eda-9e13261effc2 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:26.819121 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd899c0-04c5-4b9c-8eda-9e13261effc2 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:26.819407 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd899c0-04c5-4b9c-8eda-9e13261effc2 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:26.820349 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:14:26.822176 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 17/32] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:14:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:14:26.823442 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd899c0-04c5-4b9c-8eda-9e13261effc2 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:14:26.834238 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd322ee9-f37f-4858-b946-53af94e3a353 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:14:26.907109 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bb43c9-470d-4012-864e-c02185f26060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:14:26.907752 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bb43c9-470d-4012-864e-c02185f26060 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:26.908038 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bb43c9-470d-4012-864e-c02185f26060 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:26.908317 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bb43c9-470d-4012-864e-c02185f26060 None admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:26.910215 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bb43c9-470d-4012-864e-c02185f26060 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:14:26.910531 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bb43c9-470d-4012-864e-c02185f26060 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:14:26.912964 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bb43c9-470d-4012-864e-c02185f26060 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:14:26.942461 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 16/33] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Sep 13 15:14:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:14:26.945733 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56c710c-0417-4ab3-a02e-45da2939bb1d None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:26.946040 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56c710c-0417-4ab3-a02e-45da2939bb1d None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:26.946321 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56c710c-0417-4ab3-a02e-45da2939bb1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:26.984585 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-d56c710c-0417-4ab3-a02e-45da2939bb1d None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:14:26.986446 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-d56c710c-0417-4ab3-a02e-45da2939bb1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:14:27.026457 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd899c0-04c5-4b9c-8eda-9e13261effc2 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:14:27.073223 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b430b6d1-0e98-4a86-bbf4-9984be55b916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:14:27.074038 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b430b6d1-0e98-4a86-bbf4-9984be55b916 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:27.074472 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b430b6d1-0e98-4a86-bbf4-9984be55b916 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:27.075469 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b430b6d1-0e98-4a86-bbf4-9984be55b916 None admin] PATH_INFO: `/v3/users/50d6e356b66c47338a3bc6aea3a43029` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:27.076962 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b430b6d1-0e98-4a86-bbf4-9984be55b916 None admin] RBAC: Authorizing `identity:get_user(user_id=50d6e356b66c47338a3bc6aea3a43029)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:14:27.079399 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b430b6d1-0e98-4a86-bbf4-9984be55b916 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:14:27.081609 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 17/34] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:14:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 15:14:27.082150 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 18/35] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Sep 13 15:14:26 2022] GET /identity/v3/users/50d6e356b66c47338a3bc6aea3a43029 => generated 247 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:14:27.085957 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56c710c-0417-4ab3-a02e-45da2939bb1d None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:14:27.089326 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b430b6d1-0e98-4a86-bbf4-9984be55b916 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:14:27.183726 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:14:27.209624 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:14:27.234238 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56c710c-0417-4ab3-a02e-45da2939bb1d None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:14:27.236370 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b430b6d1-0e98-4a86-bbf4-9984be55b916 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:14:27.272240 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd8134d-a6ba-4ad1-8346-3cc76645e375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:14:27.272432 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edd65bb-80a7-4c4b-8d40-a13375bed167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:14:27.272869 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd8134d-a6ba-4ad1-8346-3cc76645e375 None admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:27.273059 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edd65bb-80a7-4c4b-8d40-a13375bed167 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:27.273169 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd8134d-a6ba-4ad1-8346-3cc76645e375 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:27.273345 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edd65bb-80a7-4c4b-8d40-a13375bed167 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:27.273440 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd8134d-a6ba-4ad1-8346-3cc76645e375 None admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:27.273630 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edd65bb-80a7-4c4b-8d40-a13375bed167 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:27.274317 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd8134d-a6ba-4ad1-8346-3cc76645e375 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:14:27.274910 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edd65bb-80a7-4c4b-8d40-a13375bed167 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:14:27.275774 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd8134d-a6ba-4ad1-8346-3cc76645e375 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:14:27.276422 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edd65bb-80a7-4c4b-8d40-a13375bed167 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:14:27.279234 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 19/36] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 13 15:14:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:14:27.280580 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4b866b-72d0-48b4-90de-ee53e1f4c4b3 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:27.280878 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4b866b-72d0-48b4-90de-ee53e1f4c4b3 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:27.281164 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4b866b-72d0-48b4-90de-ee53e1f4c4b3 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:27.282407 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 20/37] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:14:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:14:27.287278 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4b866b-72d0-48b4-90de-ee53e1f4c4b3 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:14:27.402317 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4b866b-72d0-48b4-90de-ee53e1f4c4b3 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:14:27.441733 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 18/38] 10.222.0.27 () {60 vars in 1141 bytes} [Tue Sep 13 15:14:27 2022] POST /identity/v3/projects => generated 301 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:14:27.441733 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413ca7e9-c470-4cad-9c02-8c4f35f3577c None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:27.441733 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413ca7e9-c470-4cad-9c02-8c4f35f3577c None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:27.441733 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413ca7e9-c470-4cad-9c02-8c4f35f3577c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:27.444063 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:14:27.451408 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900d5be5-1f49-4bd7-a33e-cf208d6b89d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:14:27.452806 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900d5be5-1f49-4bd7-a33e-cf208d6b89d2 None admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:27.453460 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900d5be5-1f49-4bd7-a33e-cf208d6b89d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:27.453919 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900d5be5-1f49-4bd7-a33e-cf208d6b89d2 None admin] PATH_INFO: `/v3/domains/default/users/50d6e356b66c47338a3bc6aea3a43029/roles/f34412ad29f1478cba775b033129f71f` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:27.454019 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-413ca7e9-c470-4cad-9c02-8c4f35f3577c None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:14:27.455532 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-413ca7e9-c470-4cad-9c02-8c4f35f3577c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:14:27.456330 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900d5be5-1f49-4bd7-a33e-cf208d6b89d2 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=50d6e356b66c47338a3bc6aea3a43029, role_id=f34412ad29f1478cba775b033129f71f)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:14:27.458196 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900d5be5-1f49-4bd7-a33e-cf208d6b89d2 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:14:27.482699 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 21/39] 10.222.0.27 () {58 vars in 1361 bytes} [Tue Sep 13 15:14:27 2022] PUT /identity/v3/domains/default/users/50d6e356b66c47338a3bc6aea3a43029/roles/f34412ad29f1478cba775b033129f71f => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:14:27.484243 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900d5be5-1f49-4bd7-a33e-cf208d6b89d2 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:14:27.552927 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 19/40] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:14:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 15:14:27.622279 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900d5be5-1f49-4bd7-a33e-cf208d6b89d2 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:14:27.663237 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a95dd38-245d-4d1a-8e1a-f8ce51e1e3fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:14:27.664759 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a95dd38-245d-4d1a-8e1a-f8ce51e1e3fb None admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:27.665338 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a95dd38-245d-4d1a-8e1a-f8ce51e1e3fb None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:27.665847 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a95dd38-245d-4d1a-8e1a-f8ce51e1e3fb None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:27.666786 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a95dd38-245d-4d1a-8e1a-f8ce51e1e3fb None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:14:27.668472 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a95dd38-245d-4d1a-8e1a-f8ce51e1e3fb None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:14:27.690856 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 22/41] 10.222.0.27 () {60 vars in 1131 bytes} [Tue Sep 13 15:14:27 2022] POST /identity/v3/roles => generated 225 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:14:27.801511 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627f65b6-ced4-4f64-ba4b-b426eb2a83be None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:27.802034 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627f65b6-ced4-4f64-ba4b-b426eb2a83be None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:27.802134 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627f65b6-ced4-4f64-ba4b-b426eb2a83be None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:27.803783 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 20/42] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:14:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:14:27.811091 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56827f89-086d-43ae-8378-e348d3c077bb None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:27.811400 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56827f89-086d-43ae-8378-e348d3c077bb None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:27.811661 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56827f89-086d-43ae-8378-e348d3c077bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:27.833249 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-56827f89-086d-43ae-8378-e348d3c077bb None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:14:27.834847 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-56827f89-086d-43ae-8378-e348d3c077bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:14:27.856275 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627f65b6-ced4-4f64-ba4b-b426eb2a83be None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:14:27.902310 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:14:27.929558 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 23/43] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:14:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 15:14:27.940646 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:14:27.986010 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627f65b6-ced4-4f64-ba4b-b426eb2a83be None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:14:28.023298 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e59fa1-7e86-4683-b2a3-d6f590fb869e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:14:28.023930 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e59fa1-7e86-4683-b2a3-d6f590fb869e None admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:28.024216 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e59fa1-7e86-4683-b2a3-d6f590fb869e None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:28.024494 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e59fa1-7e86-4683-b2a3-d6f590fb869e None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:28.025197 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e59fa1-7e86-4683-b2a3-d6f590fb869e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:14:28.026762 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e59fa1-7e86-4683-b2a3-d6f590fb869e None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:14:28.043914 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 21/44] 10.222.0.27 () {60 vars in 1131 bytes} [Tue Sep 13 15:14:27 2022] POST /identity/v3/roles => generated 223 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 15:14:28.204622 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56827f89-086d-43ae-8378-e348d3c077bb None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:14:28.313910 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56827f89-086d-43ae-8378-e348d3c077bb None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:14:28.456475 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e0c3b3-f752-40c6-88e0-abfa8e892dd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:14:28.457025 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e0c3b3-f752-40c6-88e0-abfa8e892dd4 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:28.457307 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e0c3b3-f752-40c6-88e0-abfa8e892dd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:28.457581 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e0c3b3-f752-40c6-88e0-abfa8e892dd4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:28.458719 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e0c3b3-f752-40c6-88e0-abfa8e892dd4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:14:28.460166 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e0c3b3-f752-40c6-88e0-abfa8e892dd4 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:14:28.461752 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 24/45] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 13 15:14:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:14:28.467296 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e59fa1-7e86-4683-b2a3-d6f590fb869e None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:14:28.569501 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e59fa1-7e86-4683-b2a3-d6f590fb869e None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:14:28.591942 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:14:28.604130 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6b8a39-8d01-4f41-addf-56936d936257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:14:28.604746 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6b8a39-8d01-4f41-addf-56936d936257 None admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:28.605036 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6b8a39-8d01-4f41-addf-56936d936257 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:28.605318 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6b8a39-8d01-4f41-addf-56936d936257 None admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:28.606608 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6b8a39-8d01-4f41-addf-56936d936257 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:14:28.608040 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6b8a39-8d01-4f41-addf-56936d936257 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:14:28.634152 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 22/46] 10.222.0.27 () {60 vars in 1141 bytes} [Tue Sep 13 15:14:28 2022] POST /identity/v3/projects => generated 312 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:14:29.823316 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a12ee0-b65e-4ca1-a91d-35477dee5436 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:29.823863 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a12ee0-b65e-4ca1-a91d-35477dee5436 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:29.823863 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a12ee0-b65e-4ca1-a91d-35477dee5436 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:29.826107 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 25/47] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:14:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:14:29.831116 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8507729-784c-4393-857f-0ff021c111ad None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:29.831505 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8507729-784c-4393-857f-0ff021c111ad None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:29.831685 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8507729-784c-4393-857f-0ff021c111ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:29.850374 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-e8507729-784c-4393-857f-0ff021c111ad None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:14:29.851559 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-e8507729-784c-4393-857f-0ff021c111ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:14:29.917319 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 23/48] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:14:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 15:14:30.201034 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a12ee0-b65e-4ca1-a91d-35477dee5436 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:14:30.254018 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:14:30.315059 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a12ee0-b65e-4ca1-a91d-35477dee5436 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:14:30.352972 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a45689-8738-4d85-93c1-3349f842ee57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:14:30.353612 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a45689-8738-4d85-93c1-3349f842ee57 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:30.354206 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a45689-8738-4d85-93c1-3349f842ee57 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:30.354206 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a45689-8738-4d85-93c1-3349f842ee57 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:30.367665 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a45689-8738-4d85-93c1-3349f842ee57 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 15:14:30.373862 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-95a45689-8738-4d85-93c1-3349f842ee57 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 15:14:30.373862 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:14:30.373862 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:14:30.373862 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:14:30.373862 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:14:30.373862 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:14:30.373862 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:14:30.373862 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:14:30.373862 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:14:30.373862 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:14:30.373862 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:14:30.373862 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:14:30.373862 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 15:14:30.373862 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 15:14:30.373862 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 15:14:30.373862 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 15:14:30.374695 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 15:14:30.374695 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 15:14:30.374695 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 15:14:30.374695 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 15:14:30.374695 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:14:30.374695 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:14:30.374695 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:14:30.374695 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:14:30.374695 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:14:30.374695 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:14:30.374695 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:14:30.374695 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Sep 13 15:14:30.374695 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:14:30.374695 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:14:30.374695 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:14:30.374695 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:14:30.375626 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:14:30.375626 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:14:30.375626 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:14:30.375626 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:14:30.375626 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 15:14:30.375626 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 15:14:30.375626 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 15:14:30.375626 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 15:14:30.375626 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 15:14:30.375626 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 15:14:30.375626 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 15:14:30.375626 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Sep 13 15:14:30.375626 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 26/49] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Sep 13 15:14:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 15:14:30.381428 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8507729-784c-4393-857f-0ff021c111ad None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:14:30.486673 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8507729-784c-4393-857f-0ff021c111ad None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:14:30.488955 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:14:30.522478 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c42656f-720c-45e6-b62c-ab404dd568ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:14:30.523102 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c42656f-720c-45e6-b62c-ab404dd568ba None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:30.523388 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c42656f-720c-45e6-b62c-ab404dd568ba None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:30.523668 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c42656f-720c-45e6-b62c-ab404dd568ba None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:30.524334 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c42656f-720c-45e6-b62c-ab404dd568ba None admin] RBAC: Adding query filter params (name=admin) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:14:30.524642 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c42656f-720c-45e6-b62c-ab404dd568ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:14:30.526073 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c42656f-720c-45e6-b62c-ab404dd568ba None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:14:30.539457 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 24/50] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Sep 13 15:14:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:14:30.540713 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a45689-8738-4d85-93c1-3349f842ee57 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:14:30.648754 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a45689-8738-4d85-93c1-3349f842ee57 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:14:30.658954 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:14:30.684308 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affd6fbf-dab9-48e9-bfa9-0f31d9542154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:14:30.684958 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affd6fbf-dab9-48e9-bfa9-0f31d9542154 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:30.685241 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affd6fbf-dab9-48e9-bfa9-0f31d9542154 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:30.685518 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affd6fbf-dab9-48e9-bfa9-0f31d9542154 None admin] PATH_INFO: `/v3/users/50d6e356b66c47338a3bc6aea3a43029` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:30.686707 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affd6fbf-dab9-48e9-bfa9-0f31d9542154 None admin] RBAC: Authorizing `identity:get_user(user_id=50d6e356b66c47338a3bc6aea3a43029)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:14:30.688170 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affd6fbf-dab9-48e9-bfa9-0f31d9542154 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:14:30.689782 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 27/51] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Sep 13 15:14:30 2022] GET /identity/v3/users/50d6e356b66c47338a3bc6aea3a43029 => generated 247 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:14:30.695481 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c42656f-720c-45e6-b62c-ab404dd568ba None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:14:30.835794 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c42656f-720c-45e6-b62c-ab404dd568ba None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:14:30.878052 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbce5d6a-e2a9-46cf-ae83-ed59ee00b664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:14:30.879064 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbce5d6a-e2a9-46cf-ae83-ed59ee00b664 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:30.879543 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbce5d6a-e2a9-46cf-ae83-ed59ee00b664 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:30.880026 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbce5d6a-e2a9-46cf-ae83-ed59ee00b664 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:30.881849 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbce5d6a-e2a9-46cf-ae83-ed59ee00b664 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:14:30.884346 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbce5d6a-e2a9-46cf-ae83-ed59ee00b664 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:14:30.886054 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89b591f-c281-4abd-906b-92ebe6423a30 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:30.886528 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89b591f-c281-4abd-906b-92ebe6423a30 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:30.886617 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 25/52] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 13 15:14:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:14:30.886807 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89b591f-c281-4abd-906b-92ebe6423a30 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:30.888737 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 28/53] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:14:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 15:14:30.894438 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89b591f-c281-4abd-906b-92ebe6423a30 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:14:30.897334 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c907b2a-7380-417e-bb87-c304e66b7cba None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:30.897626 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c907b2a-7380-417e-bb87-c304e66b7cba None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:30.897938 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c907b2a-7380-417e-bb87-c304e66b7cba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:31.009728 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89b591f-c281-4abd-906b-92ebe6423a30 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:14:31.023644 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-5c907b2a-7380-417e-bb87-c304e66b7cba None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:14:31.024872 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-5c907b2a-7380-417e-bb87-c304e66b7cba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:14:31.045118 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc0f54d-d0dc-4077-a17b-db5bc342c04f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:14:31.045760 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc0f54d-d0dc-4077-a17b-db5bc342c04f None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:31.046056 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc0f54d-d0dc-4077-a17b-db5bc342c04f None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:31.046334 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc0f54d-d0dc-4077-a17b-db5bc342c04f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:31.047059 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc0f54d-d0dc-4077-a17b-db5bc342c04f None admin] RBAC: Adding query filter params (role.id=f34412ad29f1478cba775b033129f71f, scope.domain.id=default, user.id=50d6e356b66c47338a3bc6aea3a43029) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:14:31.047374 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc0f54d-d0dc-4077-a17b-db5bc342c04f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:14:31.048824 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc0f54d-d0dc-4077-a17b-db5bc342c04f None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:14:31.051051 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:14:31.054747 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 29/54] 10.222.0.27 () {56 vars in 1322 bytes} [Tue Sep 13 15:14:30 2022] GET /identity/v3/role_assignments?user.id=50d6e356b66c47338a3bc6aea3a43029&scope.domain.id=default&role.id=f34412ad29f1478cba775b033129f71f => generated 530 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:14:31.096197 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 26/55] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:14:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 15:14:31.371051 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc0f54d-d0dc-4077-a17b-db5bc342c04f None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:14:31.412496 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:14:31.470343 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc0f54d-d0dc-4077-a17b-db5bc342c04f None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:14:31.503420 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb59b48-db54-4367-96c2-5202a512874f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:14:31.504047 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb59b48-db54-4367-96c2-5202a512874f None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:31.504335 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb59b48-db54-4367-96c2-5202a512874f None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:31.504617 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb59b48-db54-4367-96c2-5202a512874f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:31.505747 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb59b48-db54-4367-96c2-5202a512874f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:14:31.507211 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb59b48-db54-4367-96c2-5202a512874f None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:14:31.508765 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 30/56] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 13 15:14:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:14:31.514762 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c907b2a-7380-417e-bb87-c304e66b7cba None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:14:31.610192 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c907b2a-7380-417e-bb87-c304e66b7cba None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:14:31.643222 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8b3de2-c431-42fd-9abb-0f47835d234a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:14:31.643826 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8b3de2-c431-42fd-9abb-0f47835d234a None admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:31.644113 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8b3de2-c431-42fd-9abb-0f47835d234a None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:31.644398 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8b3de2-c431-42fd-9abb-0f47835d234a None admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:31.645042 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8b3de2-c431-42fd-9abb-0f47835d234a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:14:31.646503 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8b3de2-c431-42fd-9abb-0f47835d234a None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:14:31.672727 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 27/57] 10.222.0.27 () {60 vars in 1140 bytes} [Tue Sep 13 15:14:31 2022] POST /identity/v3/projects => generated 298 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:14:33.813875 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93654dbd-92b9-4976-b1a8-de4a85a2536d None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:33.814444 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93654dbd-92b9-4976-b1a8-de4a85a2536d None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:33.814444 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93654dbd-92b9-4976-b1a8-de4a85a2536d None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:33.816115 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 31/58] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:14:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:14:33.821744 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8a2a38-aced-4689-a23d-64b58f0e4236 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:33.822131 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8a2a38-aced-4689-a23d-64b58f0e4236 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:33.822311 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8a2a38-aced-4689-a23d-64b58f0e4236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:33.841371 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-ba8a2a38-aced-4689-a23d-64b58f0e4236 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:14:33.842579 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-ba8a2a38-aced-4689-a23d-64b58f0e4236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:14:33.852829 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:14:33.909421 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 28/59] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:14:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 15:14:34.176333 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93654dbd-92b9-4976-b1a8-de4a85a2536d None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:14:34.275467 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93654dbd-92b9-4976-b1a8-de4a85a2536d None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:14:34.284731 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:14:34.308628 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdeacb18-f5e8-4a36-b3c1-50e356affece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:14:34.309348 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeacb18-f5e8-4a36-b3c1-50e356affece None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:34.309632 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeacb18-f5e8-4a36-b3c1-50e356affece None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:34.309947 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeacb18-f5e8-4a36-b3c1-50e356affece None admin] PATH_INFO: `/v3/domains/default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:34.311081 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdeacb18-f5e8-4a36-b3c1-50e356affece None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:14:34.312533 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdeacb18-f5e8-4a36-b3c1-50e356affece None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:14:34.314121 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 32/60] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 13 15:14:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:14:34.319531 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8a2a38-aced-4689-a23d-64b58f0e4236 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:14:34.416768 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8a2a38-aced-4689-a23d-64b58f0e4236 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:14:34.449687 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16029710-af51-4308-a47d-815804353eea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:14:34.450468 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16029710-af51-4308-a47d-815804353eea None admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:34.450755 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16029710-af51-4308-a47d-815804353eea None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:34.451036 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16029710-af51-4308-a47d-815804353eea None admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:34.451695 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16029710-af51-4308-a47d-815804353eea None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:14:34.453135 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16029710-af51-4308-a47d-815804353eea None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:14:34.478961 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 29/61] 10.222.0.27 () {60 vars in 1132 bytes} [Tue Sep 13 15:14:34 2022] POST /identity/v3/users => generated 275 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:14:37.887507 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6f785f-5628-4ed9-a6aa-f3d58edfe5f8 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:37.888497 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6f785f-5628-4ed9-a6aa-f3d58edfe5f8 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:37.889014 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6f785f-5628-4ed9-a6aa-f3d58edfe5f8 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:37.890600 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 33/62] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:14:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:14:37.896207 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795e4ece-1bef-458f-9a78-8e62012e5bd7 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:37.896634 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795e4ece-1bef-458f-9a78-8e62012e5bd7 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:37.896767 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795e4ece-1bef-458f-9a78-8e62012e5bd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:37.903983 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:14:37.916237 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-795e4ece-1bef-458f-9a78-8e62012e5bd7 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:14:37.917461 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-795e4ece-1bef-458f-9a78-8e62012e5bd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:14:37.927824 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4667f924-850c-4d67-848d-02c6477acebc None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:37.928397 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4667f924-850c-4d67-848d-02c6477acebc None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:37.929148 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4667f924-850c-4d67-848d-02c6477acebc None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:37.930712 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 34/63] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:14:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:14:37.938048 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ab3265-b650-431d-9ddc-e23bf54e9201 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:37.938612 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ab3265-b650-431d-9ddc-e23bf54e9201 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:37.939079 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ab3265-b650-431d-9ddc-e23bf54e9201 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:37.965348 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-18ab3265-b650-431d-9ddc-e23bf54e9201 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:14:37.972178 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-18ab3265-b650-431d-9ddc-e23bf54e9201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:14:38.039730 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 30/64] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:14:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 15:14:38.097429 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 35/65] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:14:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 15:14:38.122734 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c76e9b1-f33f-43f9-b096-1ab9dfafe066 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:38.123328 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c76e9b1-f33f-43f9-b096-1ab9dfafe066 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:38.123826 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c76e9b1-f33f-43f9-b096-1ab9dfafe066 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:38.125360 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 31/66] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:14:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:14:38.130706 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a6444c-4640-489e-b7db-1f1aa70f469d None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:38.131227 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a6444c-4640-489e-b7db-1f1aa70f469d None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:38.131707 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a6444c-4640-489e-b7db-1f1aa70f469d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:38.163767 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-61a6444c-4640-489e-b7db-1f1aa70f469d None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:14:38.165245 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-61a6444c-4640-489e-b7db-1f1aa70f469d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:14:38.261928 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 36/67] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:14:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 15:14:38.303468 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9e63aa-2158-4f6b-8fec-9e8960871bdf None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:38.304077 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9e63aa-2158-4f6b-8fec-9e8960871bdf None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:38.304569 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9e63aa-2158-4f6b-8fec-9e8960871bdf None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:38.306188 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 32/68] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:14:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:14:38.312066 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b33c37a-ff0b-4768-8ee9-df895f3a1d1e None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:38.312620 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b33c37a-ff0b-4768-8ee9-df895f3a1d1e None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:38.313101 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b33c37a-ff0b-4768-8ee9-df895f3a1d1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:38.339504 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-1b33c37a-ff0b-4768-8ee9-df895f3a1d1e None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:14:38.341518 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9e63aa-2158-4f6b-8fec-9e8960871bdf None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:14:38.341657 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-1b33c37a-ff0b-4768-8ee9-df895f3a1d1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:14:38.388444 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:14:38.441304 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 37/69] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:14:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 15:14:38.442619 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b33c37a-ff0b-4768-8ee9-df895f3a1d1e None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:14:38.476034 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9e63aa-2158-4f6b-8fec-9e8960871bdf None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:14:38.509310 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:14:38.515426 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60343c7-dda2-4847-914f-7d67a98fb795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:14:38.516307 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60343c7-dda2-4847-914f-7d67a98fb795 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:38.516793 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60343c7-dda2-4847-914f-7d67a98fb795 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:38.517275 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60343c7-dda2-4847-914f-7d67a98fb795 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:38.530681 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60343c7-dda2-4847-914f-7d67a98fb795 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 15:14:38.537296 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-e60343c7-dda2-4847-914f-7d67a98fb795 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 15:14:38.537296 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:14:38.537296 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:14:38.537296 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:14:38.537296 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:14:38.537296 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:14:38.537296 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:14:38.537296 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:14:38.537296 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:14:38.537296 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:14:38.537296 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:14:38.537296 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:14:38.537296 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 15:14:38.537296 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 15:14:38.537296 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 15:14:38.537296 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 15:14:38.538165 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 15:14:38.538165 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 15:14:38.538165 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 15:14:38.538165 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 15:14:38.538165 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:14:38.538165 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:14:38.538165 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:14:38.538165 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:14:38.538165 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:14:38.538165 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:14:38.538165 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:14:38.538165 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Sep 13 15:14:38.538165 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:14:38.538165 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:14:38.538165 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:14:38.538165 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:14:38.538950 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:14:38.538950 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:14:38.538950 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:14:38.538950 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:14:38.538950 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 15:14:38.538950 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 15:14:38.538950 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 15:14:38.538950 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 15:14:38.538950 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 15:14:38.538950 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 15:14:38.538950 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 15:14:38.538950 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Sep 13 15:14:38.541165 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 33/70] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Sep 13 15:14:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 15:14:38.543215 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7edff6f-28ec-4eb9-ac42-21f775db42a9 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:38.543881 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7edff6f-28ec-4eb9-ac42-21f775db42a9 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:38.544350 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7edff6f-28ec-4eb9-ac42-21f775db42a9 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:38.546112 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 34/71] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:14:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:14:38.548292 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7edff6f-28ec-4eb9-ac42-21f775db42a9 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:14:38.571888 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b33c37a-ff0b-4768-8ee9-df895f3a1d1e None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:14:38.611639 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67a2292-ed48-4aeb-a081-9c5d40a9916a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:14:38.612625 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67a2292-ed48-4aeb-a081-9c5d40a9916a None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:38.613101 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67a2292-ed48-4aeb-a081-9c5d40a9916a None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:38.613571 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67a2292-ed48-4aeb-a081-9c5d40a9916a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:38.625642 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67a2292-ed48-4aeb-a081-9c5d40a9916a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 15:14:38.631168 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-e67a2292-ed48-4aeb-a081-9c5d40a9916a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 15:14:38.631168 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:14:38.631168 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:14:38.631168 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:14:38.631168 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:14:38.631168 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:14:38.631168 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:14:38.631168 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:14:38.631168 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:14:38.631168 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:14:38.631168 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:14:38.631168 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:14:38.631168 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 15:14:38.631168 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 15:14:38.631168 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 15:14:38.631168 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 15:14:38.632069 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 15:14:38.632069 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 15:14:38.632069 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 15:14:38.632069 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 15:14:38.632069 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:14:38.632069 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:14:38.632069 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:14:38.632069 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:14:38.632069 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:14:38.632069 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:14:38.632069 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:14:38.632069 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Sep 13 15:14:38.632069 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:14:38.632069 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:14:38.632069 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:14:38.632069 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:14:38.632815 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:14:38.632815 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:14:38.632815 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:14:38.632815 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:14:38.632815 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 15:14:38.632815 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 15:14:38.632815 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 15:14:38.632815 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 15:14:38.632815 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 15:14:38.632815 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 15:14:38.632815 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 15:14:38.632815 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Sep 13 15:14:38.634588 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 38/72] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Sep 13 15:14:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:14:38.635891 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ce5791-b155-44b3-a4b9-a7acbc42e855 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:38.636468 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ce5791-b155-44b3-a4b9-a7acbc42e855 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:38.636904 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ce5791-b155-44b3-a4b9-a7acbc42e855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:38.655644 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-18ce5791-b155-44b3-a4b9-a7acbc42e855 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:14:38.657201 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-18ce5791-b155-44b3-a4b9-a7acbc42e855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:14:38.667307 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7edff6f-28ec-4eb9-ac42-21f775db42a9 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:14:38.678827 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:14:38.705963 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57648160-b7bd-4895-8cfe-f758577bbcf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:14:38.706806 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57648160-b7bd-4895-8cfe-f758577bbcf9 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:38.707487 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57648160-b7bd-4895-8cfe-f758577bbcf9 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:38.707909 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57648160-b7bd-4895-8cfe-f758577bbcf9 None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:38.708813 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57648160-b7bd-4895-8cfe-f758577bbcf9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:14:38.709272 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57648160-b7bd-4895-8cfe-f758577bbcf9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:14:38.710704 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57648160-b7bd-4895-8cfe-f758577bbcf9 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:14:38.721266 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 35/73] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Sep 13 15:14:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:14:38.722659 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57648160-b7bd-4895-8cfe-f758577bbcf9 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:14:38.734847 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 39/74] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:14:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 15:14:38.735547 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ce5791-b155-44b3-a4b9-a7acbc42e855 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:14:38.782138 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:14:38.828033 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57648160-b7bd-4895-8cfe-f758577bbcf9 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:14:38.840942 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ce5791-b155-44b3-a4b9-a7acbc42e855 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:14:38.865864 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05da099c-3775-48bd-bbcc-0af694c05b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:14:38.866503 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05da099c-3775-48bd-bbcc-0af694c05b1c None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:38.866810 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05da099c-3775-48bd-bbcc-0af694c05b1c None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:38.867069 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05da099c-3775-48bd-bbcc-0af694c05b1c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:38.877008 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9480f7fa-7856-420c-abbc-95af0774f812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:14:38.877629 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9480f7fa-7856-420c-abbc-95af0774f812 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:38.877941 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9480f7fa-7856-420c-abbc-95af0774f812 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:38.878112 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05da099c-3775-48bd-bbcc-0af694c05b1c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 15:14:38.878205 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9480f7fa-7856-420c-abbc-95af0774f812 None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:38.878873 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9480f7fa-7856-420c-abbc-95af0774f812 None admin] RBAC: Adding query filter params (name=member) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:14:38.879179 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9480f7fa-7856-420c-abbc-95af0774f812 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:14:38.880568 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9480f7fa-7856-420c-abbc-95af0774f812 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:14:38.883041 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-05da099c-3775-48bd-bbcc-0af694c05b1c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 15:14:38.883041 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:14:38.883041 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:14:38.883041 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:14:38.883041 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:14:38.883041 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:14:38.883041 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:14:38.883041 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:14:38.883041 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:14:38.883041 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:14:38.883041 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:14:38.883041 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:14:38.883041 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 15:14:38.883041 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 15:14:38.883041 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 15:14:38.883041 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 15:14:38.883848 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 15:14:38.883848 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 15:14:38.883848 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 15:14:38.883848 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 15:14:38.883848 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:14:38.883848 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:14:38.883848 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:14:38.883848 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:14:38.883848 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:14:38.883848 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:14:38.883848 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:14:38.883848 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Sep 13 15:14:38.883848 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:14:38.883848 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:14:38.883848 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:14:38.883848 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:14:38.884605 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:14:38.884605 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:14:38.884605 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:14:38.884605 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:14:38.884605 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 15:14:38.884605 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 15:14:38.884605 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 15:14:38.884605 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 15:14:38.884605 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 15:14:38.884605 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 15:14:38.884605 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 15:14:38.884605 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Sep 13 15:14:38.884605 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 36/75] 10.222.0.27 () {56 vars in 1114 bytes} [Tue Sep 13 15:14:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:14:38.885222 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05da099c-3775-48bd-bbcc-0af694c05b1c None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:14:38.895562 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 40/76] 10.222.0.27 () {56 vars in 1101 bytes} [Tue Sep 13 15:14:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:14:38.900815 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9480f7fa-7856-420c-abbc-95af0774f812 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:14:38.919641 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:14:38.991817 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05da099c-3775-48bd-bbcc-0af694c05b1c None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:14:39.002837 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9480f7fa-7856-420c-abbc-95af0774f812 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:14:39.007065 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:14:39.027303 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddaa00f-8331-4a86-b0b0-be5ae0f78beb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:14:39.027935 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddaa00f-8331-4a86-b0b0-be5ae0f78beb None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:39.028221 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddaa00f-8331-4a86-b0b0-be5ae0f78beb None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:39.028503 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddaa00f-8331-4a86-b0b0-be5ae0f78beb None admin] PATH_INFO: `/v3/roles/member` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:39.036954 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8782d93f-8b67-4186-a9d2-23892eb43579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:14:39.037538 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8782d93f-8b67-4186-a9d2-23892eb43579 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:39.037858 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8782d93f-8b67-4186-a9d2-23892eb43579 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:39.038144 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8782d93f-8b67-4186-a9d2-23892eb43579 None admin] PATH_INFO: `/v3/users/50d6e356b66c47338a3bc6aea3a43029` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:39.038510 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddaa00f-8331-4a86-b0b0-be5ae0f78beb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 15:14:39.039309 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8782d93f-8b67-4186-a9d2-23892eb43579 None admin] RBAC: Authorizing `identity:get_user(user_id=50d6e356b66c47338a3bc6aea3a43029)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:14:39.040761 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8782d93f-8b67-4186-a9d2-23892eb43579 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:14:39.042372 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 41/77] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Sep 13 15:14:38 2022] GET /identity/v3/users/50d6e356b66c47338a3bc6aea3a43029 => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:14:39.044045 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-dddaa00f-8331-4a86-b0b0-be5ae0f78beb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 15:14:39.044045 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:14:39.044045 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:14:39.044045 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:14:39.044045 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:14:39.044045 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:14:39.044045 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:14:39.044045 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:14:39.044045 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:14:39.044045 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:14:39.044045 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:14:39.044045 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:14:39.044045 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 15:14:39.044045 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 15:14:39.044045 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 15:14:39.044045 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 15:14:39.044845 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 15:14:39.044845 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 15:14:39.044845 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 15:14:39.044845 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 15:14:39.044845 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:14:39.044845 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:14:39.044845 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:14:39.044845 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:14:39.044845 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:14:39.044845 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:14:39.044845 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:14:39.044845 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Sep 13 15:14:39.044845 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:14:39.044845 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:14:39.044845 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:14:39.044845 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:14:39.045627 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:14:39.045627 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:14:39.045627 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:14:39.045627 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:14:39.045627 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 15:14:39.045627 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 15:14:39.045627 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 15:14:39.045627 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 15:14:39.045627 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 15:14:39.045627 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 15:14:39.045627 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 15:14:39.045627 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Sep 13 15:14:39.047552 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8782d93f-8b67-4186-a9d2-23892eb43579 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:14:39.047691 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 37/78] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Sep 13 15:14:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:14:39.047691 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddaa00f-8331-4a86-b0b0-be5ae0f78beb None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:14:39.131118 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:14:39.145881 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddaa00f-8331-4a86-b0b0-be5ae0f78beb None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:14:39.146348 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8782d93f-8b67-4186-a9d2-23892eb43579 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:14:39.181971 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e437fc76-029c-46bc-b39e-0382bb473411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:14:39.182152 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86ed1c4-eaa0-44e0-ad91-124235638d67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:14:39.182581 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e437fc76-029c-46bc-b39e-0382bb473411 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:39.182673 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86ed1c4-eaa0-44e0-ad91-124235638d67 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:39.182868 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e437fc76-029c-46bc-b39e-0382bb473411 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:39.182957 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86ed1c4-eaa0-44e0-ad91-124235638d67 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:39.183141 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e437fc76-029c-46bc-b39e-0382bb473411 None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:39.183229 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86ed1c4-eaa0-44e0-ad91-124235638d67 None admin] PATH_INFO: `/v3/users/5b2e21c1e08c42f18233d33bd9c6be68` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:39.183932 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e437fc76-029c-46bc-b39e-0382bb473411 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:14:39.184239 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e437fc76-029c-46bc-b39e-0382bb473411 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:14:39.185614 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e437fc76-029c-46bc-b39e-0382bb473411 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:14:39.193401 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 42/79] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Sep 13 15:14:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:14:39.194228 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e437fc76-029c-46bc-b39e-0382bb473411 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:14:39.199495 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86ed1c4-eaa0-44e0-ad91-124235638d67 None admin] RBAC: Authorizing `identity:get_user(user_id=5b2e21c1e08c42f18233d33bd9c6be68)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:14:39.200962 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86ed1c4-eaa0-44e0-ad91-124235638d67 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:14:39.202682 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 38/80] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Sep 13 15:14:39 2022] GET /identity/v3/users/5b2e21c1e08c42f18233d33bd9c6be68 => generated 275 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:14:39.203446 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86ed1c4-eaa0-44e0-ad91-124235638d67 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:14:39.234247 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:14:39.297140 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e437fc76-029c-46bc-b39e-0382bb473411 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:14:39.300449 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86ed1c4-eaa0-44e0-ad91-124235638d67 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:14:39.331383 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c31fd29-bf0d-4a17-9955-597d219395e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:14:39.332015 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c31fd29-bf0d-4a17-9955-597d219395e3 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:39.332308 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c31fd29-bf0d-4a17-9955-597d219395e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:39.332589 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c31fd29-bf0d-4a17-9955-597d219395e3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:39.333722 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c31fd29-bf0d-4a17-9955-597d219395e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:14:39.334580 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd100bd5-dfc7-48d4-8c53-2e44d5b7bb5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:14:39.335179 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c31fd29-bf0d-4a17-9955-597d219395e3 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:14:39.335266 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd100bd5-dfc7-48d4-8c53-2e44d5b7bb5e None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:39.335464 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd100bd5-dfc7-48d4-8c53-2e44d5b7bb5e None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:39.335743 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd100bd5-dfc7-48d4-8c53-2e44d5b7bb5e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:39.336742 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 43/81] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 13 15:14:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:14:39.337585 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c31fd29-bf0d-4a17-9955-597d219395e3 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:14:39.355183 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:14:39.405036 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd100bd5-dfc7-48d4-8c53-2e44d5b7bb5e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:14:39.406645 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd100bd5-dfc7-48d4-8c53-2e44d5b7bb5e None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:14:39.436336 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:14:39.437620 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c31fd29-bf0d-4a17-9955-597d219395e3 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:14:39.471972 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208bb3a6-8ed2-4a88-8216-4d664dfbd866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:14:39.472585 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208bb3a6-8ed2-4a88-8216-4d664dfbd866 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:39.472865 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208bb3a6-8ed2-4a88-8216-4d664dfbd866 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:39.473142 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208bb3a6-8ed2-4a88-8216-4d664dfbd866 None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:39.473837 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208bb3a6-8ed2-4a88-8216-4d664dfbd866 None admin] RBAC: Adding query filter params (name=member) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:14:39.474147 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208bb3a6-8ed2-4a88-8216-4d664dfbd866 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:14:39.475514 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208bb3a6-8ed2-4a88-8216-4d664dfbd866 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:14:39.484020 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 44/82] 10.222.0.27 () {56 vars in 1101 bytes} [Tue Sep 13 15:14:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:14:39.485981 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208bb3a6-8ed2-4a88-8216-4d664dfbd866 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:14:39.507304 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 39/83] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Sep 13 15:14:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 15:14:39.508149 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd100bd5-dfc7-48d4-8c53-2e44d5b7bb5e None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:14:39.570786 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:14:39.593606 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208bb3a6-8ed2-4a88-8216-4d664dfbd866 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:14:39.612366 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd100bd5-dfc7-48d4-8c53-2e44d5b7bb5e None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:14:39.626096 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4336b90-e237-49d7-b5d9-0f8600448597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:14:39.626725 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4336b90-e237-49d7-b5d9-0f8600448597 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:39.627015 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4336b90-e237-49d7-b5d9-0f8600448597 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:39.627297 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4336b90-e237-49d7-b5d9-0f8600448597 None admin] PATH_INFO: `/v3/users/5b2e21c1e08c42f18233d33bd9c6be68` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:39.628433 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4336b90-e237-49d7-b5d9-0f8600448597 None admin] RBAC: Authorizing `identity:get_user(user_id=5b2e21c1e08c42f18233d33bd9c6be68)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:14:39.629931 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4336b90-e237-49d7-b5d9-0f8600448597 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:14:39.631508 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 45/84] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Sep 13 15:14:39 2022] GET /identity/v3/users/5b2e21c1e08c42f18233d33bd9c6be68 => generated 275 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:14:39.636086 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4336b90-e237-49d7-b5d9-0f8600448597 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:14:39.646957 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:14:39.653503 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24356a9-55b6-40ce-82fa-b4f58bfe42a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:14:39.654157 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24356a9-55b6-40ce-82fa-b4f58bfe42a4 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:39.654440 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24356a9-55b6-40ce-82fa-b4f58bfe42a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:39.655025 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24356a9-55b6-40ce-82fa-b4f58bfe42a4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:39.728949 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24356a9-55b6-40ce-82fa-b4f58bfe42a4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:14:39.731572 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24356a9-55b6-40ce-82fa-b4f58bfe42a4 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:14:39.734003 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4336b90-e237-49d7-b5d9-0f8600448597 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:14:39.766881 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af631c19-4627-4375-ab31-bb003e1bd179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:14:39.767488 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af631c19-4627-4375-ab31-bb003e1bd179 None admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:39.767777 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af631c19-4627-4375-ab31-bb003e1bd179 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:39.768059 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af631c19-4627-4375-ab31-bb003e1bd179 None admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:39.768713 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af631c19-4627-4375-ab31-bb003e1bd179 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:14:39.770203 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af631c19-4627-4375-ab31-bb003e1bd179 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:14:39.797375 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 46/85] 10.222.0.27 () {60 vars in 1132 bytes} [Tue Sep 13 15:14:39 2022] POST /identity/v3/users => generated 289 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:14:39.797375 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af631c19-4627-4375-ab31-bb003e1bd179 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:14:39.810461 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:14:39.838836 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 40/86] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Sep 13 15:14:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 15:14:39.840300 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24356a9-55b6-40ce-82fa-b4f58bfe42a4 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:14:39.876989 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:14:39.915415 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af631c19-4627-4375-ab31-bb003e1bd179 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:14:39.952790 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546c175c-2b00-4ea6-9a08-07e94ad88de2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:14:39.953454 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546c175c-2b00-4ea6-9a08-07e94ad88de2 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:39.953764 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546c175c-2b00-4ea6-9a08-07e94ad88de2 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:39.954050 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546c175c-2b00-4ea6-9a08-07e94ad88de2 None admin] PATH_INFO: `/v3/users/5b2e21c1e08c42f18233d33bd9c6be68` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:39.955284 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546c175c-2b00-4ea6-9a08-07e94ad88de2 None admin] RBAC: Authorizing `identity:get_user(user_id=5b2e21c1e08c42f18233d33bd9c6be68)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:14:39.956765 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546c175c-2b00-4ea6-9a08-07e94ad88de2 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:14:39.958629 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 47/87] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Sep 13 15:14:39 2022] GET /identity/v3/users/5b2e21c1e08c42f18233d33bd9c6be68 => generated 275 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:14:39.959246 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546c175c-2b00-4ea6-9a08-07e94ad88de2 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:14:39.967225 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24356a9-55b6-40ce-82fa-b4f58bfe42a4 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:14:40.006003 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0549b76-d854-47ec-800a-4049d0c17caa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:14:40.006641 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0549b76-d854-47ec-800a-4049d0c17caa None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:40.006984 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0549b76-d854-47ec-800a-4049d0c17caa None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:40.007865 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0549b76-d854-47ec-800a-4049d0c17caa None admin] PATH_INFO: `/v3/projects/6cd2be8a8d2a48ce87a8453fb81f9427` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:40.009559 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0549b76-d854-47ec-800a-4049d0c17caa None admin] RBAC: Authorizing `identity:get_project(project_id=6cd2be8a8d2a48ce87a8453fb81f9427)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:14:40.011224 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0549b76-d854-47ec-800a-4049d0c17caa None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:14:40.013001 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 41/88] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Sep 13 15:14:39 2022] GET /identity/v3/projects/6cd2be8a8d2a48ce87a8453fb81f9427 => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:14:40.013795 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0549b76-d854-47ec-800a-4049d0c17caa None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:14:40.044814 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:14:40.089923 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546c175c-2b00-4ea6-9a08-07e94ad88de2 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:14:40.137119 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aab1536-d238-4129-b9c8-f8c33651fcb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:14:40.137997 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aab1536-d238-4129-b9c8-f8c33651fcb3 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:40.138284 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aab1536-d238-4129-b9c8-f8c33651fcb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:40.138790 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:14:40.138908 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aab1536-d238-4129-b9c8-f8c33651fcb3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:40.142058 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0549b76-d854-47ec-800a-4049d0c17caa None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:14:40.188881 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64f0e74-30cd-4b87-ad39-97d4e9653ee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:14:40.189534 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64f0e74-30cd-4b87-ad39-97d4e9653ee9 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:40.189897 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64f0e74-30cd-4b87-ad39-97d4e9653ee9 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:40.190181 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64f0e74-30cd-4b87-ad39-97d4e9653ee9 None admin] PATH_INFO: `/v3/projects/6cd2be8a8d2a48ce87a8453fb81f9427` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:40.191328 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64f0e74-30cd-4b87-ad39-97d4e9653ee9 None admin] RBAC: Authorizing `identity:get_project(project_id=6cd2be8a8d2a48ce87a8453fb81f9427)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:14:40.193232 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64f0e74-30cd-4b87-ad39-97d4e9653ee9 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:14:40.195579 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 42/89] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Sep 13 15:14:40 2022] GET /identity/v3/projects/6cd2be8a8d2a48ce87a8453fb81f9427 => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:14:40.196645 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64f0e74-30cd-4b87-ad39-97d4e9653ee9 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:14:40.236464 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aab1536-d238-4129-b9c8-f8c33651fcb3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:14:40.238147 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aab1536-d238-4129-b9c8-f8c33651fcb3 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:14:40.306012 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64f0e74-30cd-4b87-ad39-97d4e9653ee9 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:14:40.337297 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:14:40.343428 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d970ff02-022d-466f-88ba-ecd8989a1a65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:14:40.343977 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d970ff02-022d-466f-88ba-ecd8989a1a65 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:40.344261 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d970ff02-022d-466f-88ba-ecd8989a1a65 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:40.344538 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d970ff02-022d-466f-88ba-ecd8989a1a65 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:40.384227 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:14:40.387810 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 48/90] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Sep 13 15:14:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 15:14:40.388799 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aab1536-d238-4129-b9c8-f8c33651fcb3 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:14:40.429551 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d970ff02-022d-466f-88ba-ecd8989a1a65 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:14:40.431607 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d970ff02-022d-466f-88ba-ecd8989a1a65 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:14:40.519714 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aab1536-d238-4129-b9c8-f8c33651fcb3 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:14:40.548539 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 43/91] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Sep 13 15:14:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 15:14:40.554247 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d970ff02-022d-466f-88ba-ecd8989a1a65 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:14:40.556988 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428489b9-f4b6-4a10-87f3-f7372bf09eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:14:40.558264 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428489b9-f4b6-4a10-87f3-f7372bf09eba None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:40.558549 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428489b9-f4b6-4a10-87f3-f7372bf09eba None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:40.558826 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428489b9-f4b6-4a10-87f3-f7372bf09eba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:40.559823 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428489b9-f4b6-4a10-87f3-f7372bf09eba None admin] RBAC: Adding query filter params (role.id=f34412ad29f1478cba775b033129f71f, scope.project.id=6cd2be8a8d2a48ce87a8453fb81f9427, user.id=50d6e356b66c47338a3bc6aea3a43029) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:14:40.560206 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428489b9-f4b6-4a10-87f3-f7372bf09eba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:14:40.561674 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428489b9-f4b6-4a10-87f3-f7372bf09eba None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:14:40.572012 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 49/92] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Sep 13 15:14:40 2022] GET /identity/v3/role_assignments?user.id=50d6e356b66c47338a3bc6aea3a43029&scope.project.id=6cd2be8a8d2a48ce87a8453fb81f9427&role.id=f34412ad29f1478cba775b033129f71f => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:14:40.573337 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428489b9-f4b6-4a10-87f3-f7372bf09eba None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:14:40.618547 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:14:40.705585 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428489b9-f4b6-4a10-87f3-f7372bf09eba None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:14:40.733751 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:14:40.775533 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dbba7d-be00-465a-988c-0c69760ea2cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:14:40.776204 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dbba7d-be00-465a-988c-0c69760ea2cd None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:40.781161 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dbba7d-be00-465a-988c-0c69760ea2cd None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:40.781567 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dbba7d-be00-465a-988c-0c69760ea2cd None admin] PATH_INFO: `/v3/projects/6cd2be8a8d2a48ce87a8453fb81f9427` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:40.783049 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dbba7d-be00-465a-988c-0c69760ea2cd None admin] RBAC: Authorizing `identity:get_project(project_id=6cd2be8a8d2a48ce87a8453fb81f9427)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:14:40.784642 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dbba7d-be00-465a-988c-0c69760ea2cd None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:14:40.787322 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 50/93] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Sep 13 15:14:40 2022] GET /identity/v3/projects/6cd2be8a8d2a48ce87a8453fb81f9427 => generated 298 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:14:40.788147 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dbba7d-be00-465a-988c-0c69760ea2cd None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:14:40.820590 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d970ff02-022d-466f-88ba-ecd8989a1a65 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:14:40.865385 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e11393b-b78c-4c03-a514-38607bbc7450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:14:40.866072 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e11393b-b78c-4c03-a514-38607bbc7450 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:40.866560 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e11393b-b78c-4c03-a514-38607bbc7450 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:40.866844 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e11393b-b78c-4c03-a514-38607bbc7450 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:40.868076 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e11393b-b78c-4c03-a514-38607bbc7450 None admin] RBAC: Adding query filter params (role.id=3fae3d3a28e147d3b2bede2378ff79ae, scope.project.id=6cd2be8a8d2a48ce87a8453fb81f9427, user.id=5b2e21c1e08c42f18233d33bd9c6be68) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:14:40.868735 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e11393b-b78c-4c03-a514-38607bbc7450 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:14:40.870296 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e11393b-b78c-4c03-a514-38607bbc7450 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:14:40.880830 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 44/94] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Sep 13 15:14:40 2022] GET /identity/v3/role_assignments?user.id=5b2e21c1e08c42f18233d33bd9c6be68&scope.project.id=6cd2be8a8d2a48ce87a8453fb81f9427&role.id=3fae3d3a28e147d3b2bede2378ff79ae => generated 259 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:14:40.885997 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e11393b-b78c-4c03-a514-38607bbc7450 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:14:40.953848 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dbba7d-be00-465a-988c-0c69760ea2cd None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:14:40.960176 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:14:41.034329 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2fb267-fb3e-4e29-93ef-79d847ca49b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:14:41.034995 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2fb267-fb3e-4e29-93ef-79d847ca49b0 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:41.035288 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2fb267-fb3e-4e29-93ef-79d847ca49b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:41.035573 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2fb267-fb3e-4e29-93ef-79d847ca49b0 None admin] PATH_INFO: `/v3/projects/80da76bc27b24b528f68fdc359d52a49` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:41.039768 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2fb267-fb3e-4e29-93ef-79d847ca49b0 None admin] RBAC: Authorizing `identity:get_project(project_id=80da76bc27b24b528f68fdc359d52a49)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:14:41.041280 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2fb267-fb3e-4e29-93ef-79d847ca49b0 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:14:41.043728 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 51/95] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Sep 13 15:14:40 2022] GET /identity/v3/projects/80da76bc27b24b528f68fdc359d52a49 => generated 312 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:14:41.056319 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2fb267-fb3e-4e29-93ef-79d847ca49b0 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:14:41.111522 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e11393b-b78c-4c03-a514-38607bbc7450 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:14:41.145875 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:14:41.152497 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d268ee3c-4f82-457e-9d02-4438c7796ae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:14:41.153455 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d268ee3c-4f82-457e-9d02-4438c7796ae3 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:41.153972 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d268ee3c-4f82-457e-9d02-4438c7796ae3 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:41.154514 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d268ee3c-4f82-457e-9d02-4438c7796ae3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:41.155281 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d268ee3c-4f82-457e-9d02-4438c7796ae3 None admin] RBAC: Adding query filter params (role.id=5d9c0543f8e04065bb3d8bcd11156c1d, scope.project.id=6cd2be8a8d2a48ce87a8453fb81f9427, user.id=5b2e21c1e08c42f18233d33bd9c6be68) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:14:41.155600 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d268ee3c-4f82-457e-9d02-4438c7796ae3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:14:41.157322 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d268ee3c-4f82-457e-9d02-4438c7796ae3 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:14:41.164262 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 45/96] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Sep 13 15:14:40 2022] GET /identity/v3/role_assignments?user.id=5b2e21c1e08c42f18233d33bd9c6be68&scope.project.id=6cd2be8a8d2a48ce87a8453fb81f9427&role.id=5d9c0543f8e04065bb3d8bcd11156c1d => generated 259 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:14:41.254835 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2fb267-fb3e-4e29-93ef-79d847ca49b0 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:14:41.299129 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9bc3ca-dc9e-4c2e-9d01-0ffbbec20172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:14:41.300114 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9bc3ca-dc9e-4c2e-9d01-0ffbbec20172 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:41.300603 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9bc3ca-dc9e-4c2e-9d01-0ffbbec20172 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:41.301081 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9bc3ca-dc9e-4c2e-9d01-0ffbbec20172 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:41.302153 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9bc3ca-dc9e-4c2e-9d01-0ffbbec20172 None admin] RBAC: Adding query filter params (role.id=3fae3d3a28e147d3b2bede2378ff79ae, scope.project.id=80da76bc27b24b528f68fdc359d52a49, user.id=5b2e21c1e08c42f18233d33bd9c6be68) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:14:41.302677 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9bc3ca-dc9e-4c2e-9d01-0ffbbec20172 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:14:41.304346 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9bc3ca-dc9e-4c2e-9d01-0ffbbec20172 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:14:41.310722 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 52/97] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Sep 13 15:14:41 2022] GET /identity/v3/role_assignments?user.id=5b2e21c1e08c42f18233d33bd9c6be68&scope.project.id=80da76bc27b24b528f68fdc359d52a49&role.id=3fae3d3a28e147d3b2bede2378ff79ae => generated 259 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:14:42.475956 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c677edf1-f2a4-4df5-ae2b-dabcedb0a056 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:42.476537 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c677edf1-f2a4-4df5-ae2b-dabcedb0a056 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:42.476537 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c677edf1-f2a4-4df5-ae2b-dabcedb0a056 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:42.478100 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 46/98] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:14:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:14:42.484672 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc932f43-e9a5-4351-a54f-4513a8200b30 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:42.485524 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc932f43-e9a5-4351-a54f-4513a8200b30 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:42.486056 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc932f43-e9a5-4351-a54f-4513a8200b30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:42.515494 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-cc932f43-e9a5-4351-a54f-4513a8200b30 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:14:42.517049 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-cc932f43-e9a5-4351-a54f-4513a8200b30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:14:42.551887 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:14:42.603087 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 53/99] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:14:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 15:14:43.062828 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6fcd19-5d0a-4b38-bfc7-328910fbed37 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:43.063194 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6fcd19-5d0a-4b38-bfc7-328910fbed37 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:43.063399 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6fcd19-5d0a-4b38-bfc7-328910fbed37 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:43.065011 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 47/100] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:14:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:14:43.070729 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a905e8ae-129c-4630-a2ae-b06290efb811 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:43.071089 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a905e8ae-129c-4630-a2ae-b06290efb811 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:43.071383 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a905e8ae-129c-4630-a2ae-b06290efb811 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:43.098712 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-a905e8ae-129c-4630-a2ae-b06290efb811 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:14:43.099929 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-a905e8ae-129c-4630-a2ae-b06290efb811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:14:43.190073 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 54/101] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:14:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 15:14:43.222900 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6fcd19-5d0a-4b38-bfc7-328910fbed37 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:14:43.353080 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6fcd19-5d0a-4b38-bfc7-328910fbed37 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:14:43.390425 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef493e2-6427-4937-89cf-993fed80f621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:14:43.391394 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef493e2-6427-4937-89cf-993fed80f621 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:43.391876 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef493e2-6427-4937-89cf-993fed80f621 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:43.392371 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef493e2-6427-4937-89cf-993fed80f621 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:43.403688 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef493e2-6427-4937-89cf-993fed80f621 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 15:14:43.409357 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-eef493e2-6427-4937-89cf-993fed80f621 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 15:14:43.409357 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:14:43.409357 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:14:43.409357 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:14:43.409357 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:14:43.409357 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:14:43.409357 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:14:43.409357 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:14:43.409357 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:14:43.409357 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:14:43.409357 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:14:43.409357 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:14:43.409357 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 15:14:43.409357 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 15:14:43.409357 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 15:14:43.409357 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 15:14:43.410271 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 15:14:43.410271 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 15:14:43.410271 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 15:14:43.410271 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 15:14:43.410271 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:14:43.410271 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:14:43.410271 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:14:43.410271 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:14:43.410271 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:14:43.410271 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:14:43.410271 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:14:43.410271 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Sep 13 15:14:43.410271 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:14:43.410271 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:14:43.410271 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:14:43.410271 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:14:43.411017 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:14:43.411017 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:14:43.411017 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:14:43.411017 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:14:43.411017 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 15:14:43.411017 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 15:14:43.411017 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 15:14:43.411017 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 15:14:43.411017 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 15:14:43.411017 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 15:14:43.411017 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 15:14:43.411017 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Sep 13 15:14:43.413495 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 48/102] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Sep 13 15:14:43 2022] GET /identity/v3/roles/reader => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:14:43.418981 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a905e8ae-129c-4630-a2ae-b06290efb811 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:14:43.550727 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:14:43.561811 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a905e8ae-129c-4630-a2ae-b06290efb811 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:14:43.607417 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dda4754-2bae-4349-9640-c66c40dbc53e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:14:43.607965 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dda4754-2bae-4349-9640-c66c40dbc53e None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:43.608257 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dda4754-2bae-4349-9640-c66c40dbc53e None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:43.608539 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dda4754-2bae-4349-9640-c66c40dbc53e None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:43.609219 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dda4754-2bae-4349-9640-c66c40dbc53e None admin] RBAC: Adding query filter params (name=reader) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:14:43.609531 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dda4754-2bae-4349-9640-c66c40dbc53e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:14:43.610948 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dda4754-2bae-4349-9640-c66c40dbc53e None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:14:43.625189 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 55/103] 10.222.0.27 () {56 vars in 1101 bytes} [Tue Sep 13 15:14:43 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:14:43.630440 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef493e2-6427-4937-89cf-993fed80f621 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:14:43.713738 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dda4754-2bae-4349-9640-c66c40dbc53e None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:14:43.730356 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:14:43.856602 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef493e2-6427-4937-89cf-993fed80f621 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:14:43.875772 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dda4754-2bae-4349-9640-c66c40dbc53e None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:14:43.927271 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655f8642-f199-41b9-8ac4-8631c031357c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:14:43.927977 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655f8642-f199-41b9-8ac4-8631c031357c None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:43.928882 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655f8642-f199-41b9-8ac4-8631c031357c None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:43.929164 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655f8642-f199-41b9-8ac4-8631c031357c None admin] PATH_INFO: `/v3/users/51446a984d37449ea74465e626699634` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:43.945567 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd1cb9e-e526-49c1-92c0-2eaa1a0f679e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:14:43.946292 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd1cb9e-e526-49c1-92c0-2eaa1a0f679e None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:43.946577 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd1cb9e-e526-49c1-92c0-2eaa1a0f679e None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:43.946850 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd1cb9e-e526-49c1-92c0-2eaa1a0f679e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:43.948877 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd1cb9e-e526-49c1-92c0-2eaa1a0f679e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:14:43.950560 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd1cb9e-e526-49c1-92c0-2eaa1a0f679e None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:14:43.956520 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655f8642-f199-41b9-8ac4-8631c031357c None admin] RBAC: Authorizing `identity:get_user(user_id=51446a984d37449ea74465e626699634)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:14:43.958010 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655f8642-f199-41b9-8ac4-8631c031357c None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:14:43.958352 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 56/104] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 13 15:14:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 15:14:43.959601 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528dc4b7-f4a6-4124-a2e1-24bff7e39336 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:43.959886 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528dc4b7-f4a6-4124-a2e1-24bff7e39336 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:43.960161 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528dc4b7-f4a6-4124-a2e1-24bff7e39336 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:43.962990 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 57/105] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:14:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:14:43.963683 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528dc4b7-f4a6-4124-a2e1-24bff7e39336 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:14:43.964897 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 49/106] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Sep 13 15:14:43 2022] GET /identity/v3/users/51446a984d37449ea74465e626699634 => generated 289 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:14:43.972014 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1773ad64-4e7c-42db-8e6d-bfe8a178e4e4 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:43.972304 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1773ad64-4e7c-42db-8e6d-bfe8a178e4e4 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:43.972602 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1773ad64-4e7c-42db-8e6d-bfe8a178e4e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:44.000812 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-1773ad64-4e7c-42db-8e6d-bfe8a178e4e4 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:14:44.002078 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-1773ad64-4e7c-42db-8e6d-bfe8a178e4e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:14:44.012031 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:14:44.130589 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528dc4b7-f4a6-4124-a2e1-24bff7e39336 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:14:44.140474 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 50/107] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:14:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 15:14:44.141502 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1773ad64-4e7c-42db-8e6d-bfe8a178e4e4 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:14:44.234117 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:14:44.250556 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8eaff2f-e4ff-4dbb-a867-b71c24be1ab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:14:44.251179 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eaff2f-e4ff-4dbb-a867-b71c24be1ab0 None admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:44.251468 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eaff2f-e4ff-4dbb-a867-b71c24be1ab0 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:44.251749 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eaff2f-e4ff-4dbb-a867-b71c24be1ab0 None admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:44.252419 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8eaff2f-e4ff-4dbb-a867-b71c24be1ab0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:14:44.253907 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8eaff2f-e4ff-4dbb-a867-b71c24be1ab0 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:14:44.296713 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1773ad64-4e7c-42db-8e6d-bfe8a178e4e4 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:14:44.313631 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 58/108] 10.222.0.27 () {60 vars in 1141 bytes} [Tue Sep 13 15:14:43 2022] POST /identity/v3/projects => generated 302 bytes in 350 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:14:44.321776 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faa50d1-b150-4979-9e7c-3b4a76544773 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:44.321776 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faa50d1-b150-4979-9e7c-3b4a76544773 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:44.321776 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faa50d1-b150-4979-9e7c-3b4a76544773 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:44.321776 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 59/109] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:14:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:14:44.356325 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8ddb36-11eb-49de-b5c4-ca30373de1c6 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:44.356626 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8ddb36-11eb-49de-b5c4-ca30373de1c6 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:44.356894 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8ddb36-11eb-49de-b5c4-ca30373de1c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:44.365340 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aa59f5-8414-4c88-b8db-45423f5528f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:14:44.366800 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aa59f5-8414-4c88-b8db-45423f5528f2 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:44.367391 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aa59f5-8414-4c88-b8db-45423f5528f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:44.368038 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aa59f5-8414-4c88-b8db-45423f5528f2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:44.394973 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-4c8ddb36-11eb-49de-b5c4-ca30373de1c6 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:14:44.396218 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-4c8ddb36-11eb-49de-b5c4-ca30373de1c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:14:44.490151 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80aa59f5-8414-4c88-b8db-45423f5528f2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:14:44.491853 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80aa59f5-8414-4c88-b8db-45423f5528f2 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:14:44.509268 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 60/110] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:14:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 15:14:44.510599 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1228c214-a0a4-47bc-b052-8690cd6b1f05 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:44.510938 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1228c214-a0a4-47bc-b052-8690cd6b1f05 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:44.511214 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1228c214-a0a4-47bc-b052-8690cd6b1f05 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:44.512945 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 61/111] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:14:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:14:44.524456 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b4b995-a6b7-4f55-8820-fac5c804b8fd None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:44.526043 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b4b995-a6b7-4f55-8820-fac5c804b8fd None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:44.526332 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b4b995-a6b7-4f55-8820-fac5c804b8fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:44.552321 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:14:44.566554 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-78b4b995-a6b7-4f55-8820-fac5c804b8fd None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:14:44.569068 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-78b4b995-a6b7-4f55-8820-fac5c804b8fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:14:44.583702 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:14:44.661128 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 51/112] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Sep 13 15:14:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 520 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 15:14:44.662513 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0cc8d9-7f86-46b8-8b53-74217e3703dc None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:44.662804 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0cc8d9-7f86-46b8-8b53-74217e3703dc None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:44.663084 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0cc8d9-7f86-46b8-8b53-74217e3703dc None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:44.668867 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 52/113] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:14:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:14:44.669683 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0cc8d9-7f86-46b8-8b53-74217e3703dc None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:14:44.672904 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 62/114] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:14:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 15:14:44.674829 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b4b995-a6b7-4f55-8820-fac5c804b8fd None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:14:44.788715 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0cc8d9-7f86-46b8-8b53-74217e3703dc None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:14:44.797043 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b4b995-a6b7-4f55-8820-fac5c804b8fd None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:14:44.825883 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c31b097-1e06-445e-a88a-3e9bd32e8a5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:14:44.826529 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c31b097-1e06-445e-a88a-3e9bd32e8a5c None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:44.826816 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c31b097-1e06-445e-a88a-3e9bd32e8a5c None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:44.827148 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c31b097-1e06-445e-a88a-3e9bd32e8a5c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:44.833561 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031fe28a-661f-460a-9cd0-cf88050e0e9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:14:44.834240 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031fe28a-661f-460a-9cd0-cf88050e0e9b None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:44.834527 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031fe28a-661f-460a-9cd0-cf88050e0e9b None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:44.834854 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031fe28a-661f-460a-9cd0-cf88050e0e9b None admin] PATH_INFO: `/v3/projects/6cd2be8a8d2a48ce87a8453fb81f9427` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:44.836003 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031fe28a-661f-460a-9cd0-cf88050e0e9b None admin] RBAC: Authorizing `identity:get_project(project_id=6cd2be8a8d2a48ce87a8453fb81f9427)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:14:44.837480 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031fe28a-661f-460a-9cd0-cf88050e0e9b None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:14:44.838783 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c31b097-1e06-445e-a88a-3e9bd32e8a5c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 15:14:44.840174 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 63/115] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Sep 13 15:14:44 2022] GET /identity/v3/projects/6cd2be8a8d2a48ce87a8453fb81f9427 => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:14:44.841410 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69216a86-e305-4a6d-937e-594aa8cb3253 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:44.841724 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69216a86-e305-4a6d-937e-594aa8cb3253 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:44.842011 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69216a86-e305-4a6d-937e-594aa8cb3253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:44.850202 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-2c31b097-1e06-445e-a88a-3e9bd32e8a5c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 15:14:44.850202 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:14:44.850202 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:14:44.850202 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:14:44.850202 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:14:44.850202 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:14:44.850202 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:14:44.850202 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:14:44.850202 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:14:44.850202 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:14:44.850202 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:14:44.850202 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:14:44.850202 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 15:14:44.850202 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 15:14:44.850202 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 15:14:44.850202 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 15:14:44.851052 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 15:14:44.851052 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 15:14:44.851052 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 15:14:44.851052 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 15:14:44.851052 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:14:44.851052 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:14:44.851052 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:14:44.851052 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:14:44.851052 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:14:44.851052 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:14:44.851052 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:14:44.851052 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Sep 13 15:14:44.851052 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:14:44.851052 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:14:44.851052 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:14:44.851052 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:14:44.851803 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:14:44.851803 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:14:44.851803 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:14:44.851803 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:14:44.851803 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 15:14:44.851803 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 15:14:44.851803 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 15:14:44.851803 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 15:14:44.851803 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 15:14:44.851803 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 15:14:44.851803 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 15:14:44.851803 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Sep 13 15:14:44.851803 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 53/116] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Sep 13 15:14:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:14:44.852886 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c31b097-1e06-445e-a88a-3e9bd32e8a5c None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:14:44.859409 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:14:44.867623 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:14:44.880693 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-69216a86-e305-4a6d-937e-594aa8cb3253 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:14:44.882228 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-69216a86-e305-4a6d-937e-594aa8cb3253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:14:44.988694 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 64/117] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:14:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 15:14:44.989984 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69216a86-e305-4a6d-937e-594aa8cb3253 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:14:44.998878 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c31b097-1e06-445e-a88a-3e9bd32e8a5c None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:14:45.050818 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf91d5ed-ab6c-4b21-99e2-4109f6f53226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:14:45.051783 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf91d5ed-ab6c-4b21-99e2-4109f6f53226 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:45.052269 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf91d5ed-ab6c-4b21-99e2-4109f6f53226 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:45.052777 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf91d5ed-ab6c-4b21-99e2-4109f6f53226 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:45.053736 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf91d5ed-ab6c-4b21-99e2-4109f6f53226 None admin] RBAC: Adding query filter params (role.id=b43a33bf0d63483a868ced4dfbcc4a6d, scope.project.id=6cd2be8a8d2a48ce87a8453fb81f9427, user.id=51446a984d37449ea74465e626699634) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:14:45.054241 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf91d5ed-ab6c-4b21-99e2-4109f6f53226 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:14:45.055897 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf91d5ed-ab6c-4b21-99e2-4109f6f53226 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:14:45.062051 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 54/118] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Sep 13 15:14:44 2022] GET /identity/v3/role_assignments?user.id=51446a984d37449ea74465e626699634&scope.project.id=6cd2be8a8d2a48ce87a8453fb81f9427&role.id=b43a33bf0d63483a868ced4dfbcc4a6d => generated 259 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:14:45.063131 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf91d5ed-ab6c-4b21-99e2-4109f6f53226 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:14:45.158042 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69216a86-e305-4a6d-937e-594aa8cb3253 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:14:45.211635 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:14:45.212846 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152a9eb3-8279-4114-93b1-9fb3c79453a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:14:45.214618 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152a9eb3-8279-4114-93b1-9fb3c79453a8 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:45.214618 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152a9eb3-8279-4114-93b1-9fb3c79453a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:45.215516 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152a9eb3-8279-4114-93b1-9fb3c79453a8 None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:45.215861 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152a9eb3-8279-4114-93b1-9fb3c79453a8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:14:45.216391 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152a9eb3-8279-4114-93b1-9fb3c79453a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:14:45.218370 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152a9eb3-8279-4114-93b1-9fb3c79453a8 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:14:45.219963 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:14:45.234460 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 65/119] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Sep 13 15:14:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:14:45.243047 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152a9eb3-8279-4114-93b1-9fb3c79453a8 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:14:45.252450 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf91d5ed-ab6c-4b21-99e2-4109f6f53226 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:14:45.289961 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafb6ed8-0dcd-47f1-b9b3-01660ae7cfd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:14:45.290789 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafb6ed8-0dcd-47f1-b9b3-01660ae7cfd8 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:45.291078 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafb6ed8-0dcd-47f1-b9b3-01660ae7cfd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:45.291358 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafb6ed8-0dcd-47f1-b9b3-01660ae7cfd8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:45.304500 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafb6ed8-0dcd-47f1-b9b3-01660ae7cfd8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 15:14:45.310320 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-cafb6ed8-0dcd-47f1-b9b3-01660ae7cfd8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 15:14:45.310320 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:14:45.310320 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:14:45.310320 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:14:45.310320 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:14:45.310320 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:14:45.310320 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:14:45.310320 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:14:45.310320 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:14:45.310320 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:14:45.310320 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:14:45.310320 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:14:45.310320 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 15:14:45.310320 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 15:14:45.310320 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 15:14:45.310320 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 15:14:45.311158 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 15:14:45.311158 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 15:14:45.311158 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 15:14:45.311158 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 15:14:45.311158 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:14:45.311158 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:14:45.311158 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:14:45.311158 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:14:45.311158 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:14:45.311158 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:14:45.311158 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:14:45.311158 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Sep 13 15:14:45.311158 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:14:45.311158 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:14:45.311158 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:14:45.311158 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:14:45.311929 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:14:45.311929 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:14:45.311929 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:14:45.311929 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:14:45.311929 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 15:14:45.311929 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 15:14:45.311929 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 15:14:45.311929 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 15:14:45.311929 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 15:14:45.311929 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 15:14:45.311929 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 15:14:45.311929 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Sep 13 15:14:45.311929 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 55/120] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Sep 13 15:14:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:14:45.312545 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafb6ed8-0dcd-47f1-b9b3-01660ae7cfd8 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:14:45.405133 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152a9eb3-8279-4114-93b1-9fb3c79453a8 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:14:45.440728 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafb6ed8-0dcd-47f1-b9b3-01660ae7cfd8 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:14:45.440925 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d615e8-8db9-4294-af3a-9608bcf76878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:14:45.441418 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d615e8-8db9-4294-af3a-9608bcf76878 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:45.441726 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d615e8-8db9-4294-af3a-9608bcf76878 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:45.442033 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d615e8-8db9-4294-af3a-9608bcf76878 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:45.452854 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d615e8-8db9-4294-af3a-9608bcf76878 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 15:14:45.458364 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-99d615e8-8db9-4294-af3a-9608bcf76878 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 15:14:45.458364 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:14:45.458364 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:14:45.458364 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:14:45.458364 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:14:45.458364 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:14:45.458364 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:14:45.458364 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:14:45.458364 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:14:45.458364 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:14:45.458364 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:14:45.458364 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:14:45.458364 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 15:14:45.458364 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 15:14:45.458364 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 15:14:45.458364 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 15:14:45.459246 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 15:14:45.459246 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 15:14:45.459246 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 15:14:45.459246 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 15:14:45.459246 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:14:45.459246 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:14:45.459246 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:14:45.459246 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:14:45.459246 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:14:45.459246 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:14:45.459246 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:14:45.459246 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Sep 13 15:14:45.459246 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:14:45.459246 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:14:45.459246 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:14:45.459246 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:14:45.460017 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:14:45.460017 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:14:45.460017 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:14:45.460017 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:14:45.460017 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 15:14:45.460017 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 15:14:45.460017 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 15:14:45.460017 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 15:14:45.460017 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 15:14:45.460017 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 15:14:45.460017 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 15:14:45.460017 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Sep 13 15:14:45.460017 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 66/121] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Sep 13 15:14:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:14:45.460631 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d615e8-8db9-4294-af3a-9608bcf76878 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:14:45.474322 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:14:45.483790 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166cdbbb-0c30-46eb-91e9-3fd8f3c22379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:14:45.484665 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166cdbbb-0c30-46eb-91e9-3fd8f3c22379 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:45.485117 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166cdbbb-0c30-46eb-91e9-3fd8f3c22379 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:45.485555 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166cdbbb-0c30-46eb-91e9-3fd8f3c22379 None admin] PATH_INFO: `/v3/users/50d6e356b66c47338a3bc6aea3a43029` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:45.487178 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166cdbbb-0c30-46eb-91e9-3fd8f3c22379 None admin] RBAC: Authorizing `identity:get_user(user_id=50d6e356b66c47338a3bc6aea3a43029)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:14:45.488930 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166cdbbb-0c30-46eb-91e9-3fd8f3c22379 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:14:45.490821 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 56/122] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Sep 13 15:14:45 2022] GET /identity/v3/users/50d6e356b66c47338a3bc6aea3a43029 => generated 247 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:14:45.491714 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166cdbbb-0c30-46eb-91e9-3fd8f3c22379 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:14:45.528047 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:14:45.576850 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d615e8-8db9-4294-af3a-9608bcf76878 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:14:45.603918 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166cdbbb-0c30-46eb-91e9-3fd8f3c22379 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:14:45.614173 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35793093-cac8-4a9a-a437-b67363db5664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:14:45.615175 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35793093-cac8-4a9a-a437-b67363db5664 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:45.615349 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35793093-cac8-4a9a-a437-b67363db5664 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:45.615698 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35793093-cac8-4a9a-a437-b67363db5664 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:45.627502 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35793093-cac8-4a9a-a437-b67363db5664 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 15:14:45.633671 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-35793093-cac8-4a9a-a437-b67363db5664 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 15:14:45.633671 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:14:45.633671 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:14:45.633671 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:14:45.633671 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:14:45.633671 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:14:45.633671 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:14:45.633671 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:14:45.633671 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:14:45.633671 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:14:45.633671 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:14:45.633671 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:14:45.633671 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 15:14:45.633671 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 15:14:45.633671 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 15:14:45.633671 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 15:14:45.634543 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 15:14:45.634543 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 15:14:45.634543 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 15:14:45.634543 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 15:14:45.634543 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:14:45.634543 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:14:45.634543 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:14:45.634543 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:14:45.634543 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:14:45.634543 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:14:45.634543 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:14:45.634543 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Sep 13 15:14:45.634543 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:14:45.634543 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:14:45.634543 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:14:45.634543 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:14:45.635308 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:14:45.635308 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:14:45.635308 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:14:45.635308 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:14:45.635308 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 15:14:45.635308 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 15:14:45.635308 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 15:14:45.635308 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 15:14:45.635308 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 15:14:45.635308 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 15:14:45.635308 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 15:14:45.635308 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Sep 13 15:14:45.635308 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 67/123] 10.222.0.27 () {56 vars in 1114 bytes} [Tue Sep 13 15:14:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:14:45.636519 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35793093-cac8-4a9a-a437-b67363db5664 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:14:45.645287 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738ca192-1c77-40ff-abb7-c54b3e4545d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:14:45.646262 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738ca192-1c77-40ff-abb7-c54b3e4545d8 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:45.646700 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738ca192-1c77-40ff-abb7-c54b3e4545d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:45.647111 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738ca192-1c77-40ff-abb7-c54b3e4545d8 None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:45.647914 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738ca192-1c77-40ff-abb7-c54b3e4545d8 None admin] RBAC: Adding query filter params (name=member) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:14:45.648464 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738ca192-1c77-40ff-abb7-c54b3e4545d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:14:45.650125 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738ca192-1c77-40ff-abb7-c54b3e4545d8 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:14:45.659713 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 57/124] 10.222.0.27 () {56 vars in 1101 bytes} [Tue Sep 13 15:14:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:14:45.665263 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738ca192-1c77-40ff-abb7-c54b3e4545d8 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:14:45.749382 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:14:45.770335 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35793093-cac8-4a9a-a437-b67363db5664 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:14:45.794862 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:14:45.795674 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738ca192-1c77-40ff-abb7-c54b3e4545d8 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:14:45.820062 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7aeb9f-3811-4d16-b827-f2a36ba95125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:14:45.821242 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7aeb9f-3811-4d16-b827-f2a36ba95125 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:45.821729 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7aeb9f-3811-4d16-b827-f2a36ba95125 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:45.822486 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7aeb9f-3811-4d16-b827-f2a36ba95125 None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:45.824606 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7aeb9f-3811-4d16-b827-f2a36ba95125 None admin] RBAC: Adding query filter params (name=member) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:14:45.825099 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7aeb9f-3811-4d16-b827-f2a36ba95125 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:14:45.827221 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7aeb9f-3811-4d16-b827-f2a36ba95125 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:14:45.838600 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814fcf03-884b-46b1-959a-21ac0e6c1ff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:14:45.843373 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 68/125] 10.222.0.27 () {56 vars in 1101 bytes} [Tue Sep 13 15:14:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:14:45.843373 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7aeb9f-3811-4d16-b827-f2a36ba95125 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:14:45.846749 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814fcf03-884b-46b1-959a-21ac0e6c1ff4 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:45.847100 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814fcf03-884b-46b1-959a-21ac0e6c1ff4 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:45.847359 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814fcf03-884b-46b1-959a-21ac0e6c1ff4 None admin] PATH_INFO: `/v3/projects/6cd2be8a8d2a48ce87a8453fb81f9427` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:45.850737 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814fcf03-884b-46b1-959a-21ac0e6c1ff4 None admin] RBAC: Authorizing `identity:get_project(project_id=6cd2be8a8d2a48ce87a8453fb81f9427)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:14:45.853110 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814fcf03-884b-46b1-959a-21ac0e6c1ff4 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:14:45.855795 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 58/126] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Sep 13 15:14:45 2022] GET /identity/v3/projects/6cd2be8a8d2a48ce87a8453fb81f9427 => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:14:45.857247 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814fcf03-884b-46b1-959a-21ac0e6c1ff4 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:14:45.950793 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7aeb9f-3811-4d16-b827-f2a36ba95125 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:14:45.990688 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814fcf03-884b-46b1-959a-21ac0e6c1ff4 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:14:45.998412 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0c99e7-bd7d-4342-87fd-215ddbb021f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:14:45.999755 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0c99e7-bd7d-4342-87fd-215ddbb021f0 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:46.000220 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0c99e7-bd7d-4342-87fd-215ddbb021f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:46.000673 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0c99e7-bd7d-4342-87fd-215ddbb021f0 None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:46.001951 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0c99e7-bd7d-4342-87fd-215ddbb021f0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:14:46.002904 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0c99e7-bd7d-4342-87fd-215ddbb021f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:14:46.005166 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0c99e7-bd7d-4342-87fd-215ddbb021f0 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:14:46.016546 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 69/127] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Sep 13 15:14:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:14:46.017845 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0c99e7-bd7d-4342-87fd-215ddbb021f0 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:14:46.019292 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:14:46.031651 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4958053-c8af-43b3-9c93-a27a000b45ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:14:46.032513 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4958053-c8af-43b3-9c93-a27a000b45ef None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:46.032919 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4958053-c8af-43b3-9c93-a27a000b45ef None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:46.033264 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4958053-c8af-43b3-9c93-a27a000b45ef None admin] PATH_INFO: `/v3/users/5b2e21c1e08c42f18233d33bd9c6be68` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:46.034878 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4958053-c8af-43b3-9c93-a27a000b45ef None admin] RBAC: Authorizing `identity:get_user(user_id=5b2e21c1e08c42f18233d33bd9c6be68)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:14:46.036519 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4958053-c8af-43b3-9c93-a27a000b45ef None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:14:46.038558 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 59/128] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Sep 13 15:14:45 2022] GET /identity/v3/users/5b2e21c1e08c42f18233d33bd9c6be68 => generated 275 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:14:46.045295 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4958053-c8af-43b3-9c93-a27a000b45ef None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:14:46.081438 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:14:46.158701 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0c99e7-bd7d-4342-87fd-215ddbb021f0 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:14:46.164978 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4958053-c8af-43b3-9c93-a27a000b45ef None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:14:46.205406 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c4d278-58bc-4c75-9358-f993427e7886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:14:46.206088 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c4d278-58bc-4c75-9358-f993427e7886 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:46.206373 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c4d278-58bc-4c75-9358-f993427e7886 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:46.206650 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c4d278-58bc-4c75-9358-f993427e7886 None admin] PATH_INFO: `/v3/users/5b2e21c1e08c42f18233d33bd9c6be68` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:46.208227 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c4d278-58bc-4c75-9358-f993427e7886 None admin] RBAC: Authorizing `identity:get_user(user_id=5b2e21c1e08c42f18233d33bd9c6be68)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:14:46.209662 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c4d278-58bc-4c75-9358-f993427e7886 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:14:46.211250 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 70/129] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Sep 13 15:14:46 2022] GET /identity/v3/users/5b2e21c1e08c42f18233d33bd9c6be68 => generated 275 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:14:46.216944 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c4d278-58bc-4c75-9358-f993427e7886 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:14:46.217065 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53202668-8ea7-4bb9-97ac-42b4b2f0c836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:14:46.217065 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53202668-8ea7-4bb9-97ac-42b4b2f0c836 None admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:46.217065 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53202668-8ea7-4bb9-97ac-42b4b2f0c836 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:46.217065 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53202668-8ea7-4bb9-97ac-42b4b2f0c836 None admin] PATH_INFO: `/v3/projects/6cd2be8a8d2a48ce87a8453fb81f9427/users/50d6e356b66c47338a3bc6aea3a43029/roles/f34412ad29f1478cba775b033129f71f` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:46.219035 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53202668-8ea7-4bb9-97ac-42b4b2f0c836 None admin] RBAC: Authorizing `identity:create_grant(project_id=6cd2be8a8d2a48ce87a8453fb81f9427, user_id=50d6e356b66c47338a3bc6aea3a43029, role_id=f34412ad29f1478cba775b033129f71f)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:14:46.221884 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53202668-8ea7-4bb9-97ac-42b4b2f0c836 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:14:46.240740 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 60/130] 10.222.0.27 () {58 vars in 1439 bytes} [Tue Sep 13 15:14:46 2022] PUT /identity/v3/projects/6cd2be8a8d2a48ce87a8453fb81f9427/users/50d6e356b66c47338a3bc6aea3a43029/roles/f34412ad29f1478cba775b033129f71f => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:14:46.241945 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53202668-8ea7-4bb9-97ac-42b4b2f0c836 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:14:46.331807 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:14:46.341146 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c4d278-58bc-4c75-9358-f993427e7886 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:14:46.352994 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:14:46.405445 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc08f820-dfca-47f3-be65-d4689178ccd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:14:46.406805 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc08f820-dfca-47f3-be65-d4689178ccd7 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:46.407308 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc08f820-dfca-47f3-be65-d4689178ccd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:46.407791 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc08f820-dfca-47f3-be65-d4689178ccd7 None admin] PATH_INFO: `/v3/users/5b2e21c1e08c42f18233d33bd9c6be68` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:46.408064 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53202668-8ea7-4bb9-97ac-42b4b2f0c836 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:14:46.409569 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc08f820-dfca-47f3-be65-d4689178ccd7 None admin] RBAC: Authorizing `identity:get_user(user_id=5b2e21c1e08c42f18233d33bd9c6be68)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:14:46.411318 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc08f820-dfca-47f3-be65-d4689178ccd7 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:14:46.413208 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 71/131] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Sep 13 15:14:46 2022] GET /identity/v3/users/5b2e21c1e08c42f18233d33bd9c6be68 => generated 275 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:14:46.422541 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc08f820-dfca-47f3-be65-d4689178ccd7 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:14:46.452518 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999b8de8-c94a-4539-92fd-1da9f0a016cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:14:46.453180 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999b8de8-c94a-4539-92fd-1da9f0a016cd None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:46.453466 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999b8de8-c94a-4539-92fd-1da9f0a016cd None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:46.453774 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999b8de8-c94a-4539-92fd-1da9f0a016cd None admin] PATH_INFO: `/v3/projects/6cd2be8a8d2a48ce87a8453fb81f9427` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:46.456421 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999b8de8-c94a-4539-92fd-1da9f0a016cd None admin] RBAC: Authorizing `identity:get_project(project_id=6cd2be8a8d2a48ce87a8453fb81f9427)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:14:46.457974 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999b8de8-c94a-4539-92fd-1da9f0a016cd None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:14:46.462971 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 61/132] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Sep 13 15:14:46 2022] GET /identity/v3/projects/6cd2be8a8d2a48ce87a8453fb81f9427 => generated 298 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:14:46.464905 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999b8de8-c94a-4539-92fd-1da9f0a016cd None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:14:46.601350 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999b8de8-c94a-4539-92fd-1da9f0a016cd None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:14:46.603345 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc08f820-dfca-47f3-be65-d4689178ccd7 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:14:46.645617 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:14:46.662614 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4438124e-aa58-4a26-8c0e-fd5b4e07f714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:14:46.664459 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4438124e-aa58-4a26-8c0e-fd5b4e07f714 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:46.665927 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4438124e-aa58-4a26-8c0e-fd5b4e07f714 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:46.666445 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4438124e-aa58-4a26-8c0e-fd5b4e07f714 None admin] PATH_INFO: `/v3/projects/80da76bc27b24b528f68fdc359d52a49` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:46.669010 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4438124e-aa58-4a26-8c0e-fd5b4e07f714 None admin] RBAC: Authorizing `identity:get_project(project_id=80da76bc27b24b528f68fdc359d52a49)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:14:46.670393 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da3105c-fe32-4a7c-b422-f5329212e56f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:14:46.672594 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da3105c-fe32-4a7c-b422-f5329212e56f None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:46.673364 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4438124e-aa58-4a26-8c0e-fd5b4e07f714 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:14:46.673883 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da3105c-fe32-4a7c-b422-f5329212e56f None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:46.674779 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da3105c-fe32-4a7c-b422-f5329212e56f None admin] PATH_INFO: `/v3/projects/6cd2be8a8d2a48ce87a8453fb81f9427` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:46.676840 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da3105c-fe32-4a7c-b422-f5329212e56f None admin] RBAC: Authorizing `identity:get_project(project_id=6cd2be8a8d2a48ce87a8453fb81f9427)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:14:46.679283 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da3105c-fe32-4a7c-b422-f5329212e56f None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:14:46.679760 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 72/133] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Sep 13 15:14:46 2022] GET /identity/v3/projects/80da76bc27b24b528f68fdc359d52a49 => generated 312 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:14:46.680713 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4438124e-aa58-4a26-8c0e-fd5b4e07f714 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:14:46.688259 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 62/134] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Sep 13 15:14:46 2022] GET /identity/v3/projects/6cd2be8a8d2a48ce87a8453fb81f9427 => generated 298 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:14:46.696521 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da3105c-fe32-4a7c-b422-f5329212e56f None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:14:46.804569 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:14:46.853139 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da3105c-fe32-4a7c-b422-f5329212e56f None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:14:46.883120 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4438124e-aa58-4a26-8c0e-fd5b4e07f714 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:14:46.892974 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e54f2c-4956-4958-a99c-cf732a7e2891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:14:46.894044 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e54f2c-4956-4958-a99c-cf732a7e2891 None admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:46.894564 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e54f2c-4956-4958-a99c-cf732a7e2891 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:46.894910 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e54f2c-4956-4958-a99c-cf732a7e2891 None admin] PATH_INFO: `/v3/projects/6cd2be8a8d2a48ce87a8453fb81f9427/users/5b2e21c1e08c42f18233d33bd9c6be68/roles/5d9c0543f8e04065bb3d8bcd11156c1d` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:46.897233 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e54f2c-4956-4958-a99c-cf732a7e2891 None admin] RBAC: Authorizing `identity:create_grant(project_id=6cd2be8a8d2a48ce87a8453fb81f9427, user_id=5b2e21c1e08c42f18233d33bd9c6be68, role_id=5d9c0543f8e04065bb3d8bcd11156c1d)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:14:46.898805 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e54f2c-4956-4958-a99c-cf732a7e2891 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:14:46.917841 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 63/135] 10.222.0.27 () {58 vars in 1439 bytes} [Tue Sep 13 15:14:46 2022] PUT /identity/v3/projects/6cd2be8a8d2a48ce87a8453fb81f9427/users/5b2e21c1e08c42f18233d33bd9c6be68/roles/5d9c0543f8e04065bb3d8bcd11156c1d => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 15:14:46.925304 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e54f2c-4956-4958-a99c-cf732a7e2891 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:14:46.943340 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba7eecf-0bf2-47f1-baa9-9c67f930433a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:14:46.944030 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba7eecf-0bf2-47f1-baa9-9c67f930433a None admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:46.945531 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba7eecf-0bf2-47f1-baa9-9c67f930433a None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:46.945854 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba7eecf-0bf2-47f1-baa9-9c67f930433a None admin] PATH_INFO: `/v3/projects/6cd2be8a8d2a48ce87a8453fb81f9427/users/5b2e21c1e08c42f18233d33bd9c6be68/roles/3fae3d3a28e147d3b2bede2378ff79ae` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:46.949532 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba7eecf-0bf2-47f1-baa9-9c67f930433a None admin] RBAC: Authorizing `identity:create_grant(project_id=6cd2be8a8d2a48ce87a8453fb81f9427, user_id=5b2e21c1e08c42f18233d33bd9c6be68, role_id=3fae3d3a28e147d3b2bede2378ff79ae)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:14:46.951296 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba7eecf-0bf2-47f1-baa9-9c67f930433a None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:14:46.984318 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 73/136] 10.222.0.27 () {58 vars in 1439 bytes} [Tue Sep 13 15:14:46 2022] PUT /identity/v3/projects/6cd2be8a8d2a48ce87a8453fb81f9427/users/5b2e21c1e08c42f18233d33bd9c6be68/roles/3fae3d3a28e147d3b2bede2378ff79ae => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:14:46.985415 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939a2bfd-1f2e-47cd-89e9-cc470f8280c3 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:46.985723 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939a2bfd-1f2e-47cd-89e9-cc470f8280c3 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:46.986034 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939a2bfd-1f2e-47cd-89e9-cc470f8280c3 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:46.987341 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 74/137] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:14:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:14:46.999277 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f74568-2eaf-4502-8473-67704c86254c None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:46.999616 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f74568-2eaf-4502-8473-67704c86254c None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:46.999838 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f74568-2eaf-4502-8473-67704c86254c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:47.024666 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:14:47.033288 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-23f74568-2eaf-4502-8473-67704c86254c None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:14:47.034557 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-23f74568-2eaf-4502-8473-67704c86254c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:14:47.125053 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e54f2c-4956-4958-a99c-cf732a7e2891 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:14:47.138230 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 75/138] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:14:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 15:14:47.189846 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b438bd2-fbf7-42d1-97a5-bc0230ff3020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:14:47.190545 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b438bd2-fbf7-42d1-97a5-bc0230ff3020 None admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:47.190832 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b438bd2-fbf7-42d1-97a5-bc0230ff3020 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:47.191113 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b438bd2-fbf7-42d1-97a5-bc0230ff3020 None admin] PATH_INFO: `/v3/projects/80da76bc27b24b528f68fdc359d52a49/users/5b2e21c1e08c42f18233d33bd9c6be68/roles/3fae3d3a28e147d3b2bede2378ff79ae` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:47.193221 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b438bd2-fbf7-42d1-97a5-bc0230ff3020 None admin] RBAC: Authorizing `identity:create_grant(project_id=80da76bc27b24b528f68fdc359d52a49, user_id=5b2e21c1e08c42f18233d33bd9c6be68, role_id=3fae3d3a28e147d3b2bede2378ff79ae)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:14:47.199746 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b438bd2-fbf7-42d1-97a5-bc0230ff3020 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:14:47.223100 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 64/139] 10.222.0.27 () {58 vars in 1439 bytes} [Tue Sep 13 15:14:46 2022] PUT /identity/v3/projects/80da76bc27b24b528f68fdc359d52a49/users/5b2e21c1e08c42f18233d33bd9c6be68/roles/3fae3d3a28e147d3b2bede2378ff79ae => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:14:47.437658 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3752607-8d65-463e-8f96-12dc6320a873 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:47.438083 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3752607-8d65-463e-8f96-12dc6320a873 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:47.438261 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3752607-8d65-463e-8f96-12dc6320a873 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:47.439613 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 76/140] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:14:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:14:47.445362 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40092564-067b-4557-bae8-7d9399e9fbc6 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:47.445645 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40092564-067b-4557-bae8-7d9399e9fbc6 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:47.445963 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40092564-067b-4557-bae8-7d9399e9fbc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:47.468960 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-40092564-067b-4557-bae8-7d9399e9fbc6 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:14:47.470222 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-40092564-067b-4557-bae8-7d9399e9fbc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:14:47.508771 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3752607-8d65-463e-8f96-12dc6320a873 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:14:47.580240 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:14:47.603885 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 65/141] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:14:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 15:14:47.687774 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3752607-8d65-463e-8f96-12dc6320a873 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:14:47.739344 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d951071-ffba-4c0e-9606-171ad02aaa29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:14:47.739983 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d951071-ffba-4c0e-9606-171ad02aaa29 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:47.740262 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d951071-ffba-4c0e-9606-171ad02aaa29 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:47.740531 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d951071-ffba-4c0e-9606-171ad02aaa29 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:47.741645 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d951071-ffba-4c0e-9606-171ad02aaa29 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:14:47.743142 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d951071-ffba-4c0e-9606-171ad02aaa29 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:14:47.744705 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 77/142] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 13 15:14:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 15:14:47.751318 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40092564-067b-4557-bae8-7d9399e9fbc6 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:14:47.811255 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:14:47.877931 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40092564-067b-4557-bae8-7d9399e9fbc6 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:14:47.913911 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edce176-1a10-4e4b-a4b6-1f613a2a325d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:14:47.914540 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edce176-1a10-4e4b-a4b6-1f613a2a325d None admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:47.915075 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edce176-1a10-4e4b-a4b6-1f613a2a325d None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:47.915358 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edce176-1a10-4e4b-a4b6-1f613a2a325d None admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:47.916021 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edce176-1a10-4e4b-a4b6-1f613a2a325d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:14:47.918062 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edce176-1a10-4e4b-a4b6-1f613a2a325d None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:14:47.940327 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 66/143] 10.222.0.27 () {60 vars in 1132 bytes} [Tue Sep 13 15:14:47 2022] POST /identity/v3/users => generated 283 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:14:48.008016 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d951071-ffba-4c0e-9606-171ad02aaa29 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:14:48.143034 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d951071-ffba-4c0e-9606-171ad02aaa29 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:14:48.144549 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:14:48.188942 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5d4d14-2770-4403-85d1-eceb1e3dd4c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:14:48.189583 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5d4d14-2770-4403-85d1-eceb1e3dd4c2 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:48.189886 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5d4d14-2770-4403-85d1-eceb1e3dd4c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:48.190158 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5d4d14-2770-4403-85d1-eceb1e3dd4c2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:48.210947 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5d4d14-2770-4403-85d1-eceb1e3dd4c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 15:14:48.216978 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-4f5d4d14-2770-4403-85d1-eceb1e3dd4c2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 15:14:48.216978 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:14:48.216978 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:14:48.216978 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:14:48.216978 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:14:48.216978 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:14:48.216978 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:14:48.216978 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:14:48.216978 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:14:48.216978 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:14:48.216978 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:14:48.216978 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:14:48.216978 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 15:14:48.216978 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 15:14:48.216978 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 15:14:48.216978 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 15:14:48.217961 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 15:14:48.217961 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 15:14:48.217961 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 15:14:48.217961 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 15:14:48.217961 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:14:48.217961 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:14:48.217961 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:14:48.217961 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:14:48.217961 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:14:48.217961 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:14:48.217961 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:14:48.217961 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Sep 13 15:14:48.217961 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:14:48.217961 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:14:48.217961 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:14:48.217961 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:14:48.218755 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:14:48.218755 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:14:48.218755 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:14:48.218755 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:14:48.218755 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 15:14:48.218755 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 15:14:48.218755 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 15:14:48.218755 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 15:14:48.218755 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 15:14:48.218755 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 15:14:48.218755 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 15:14:48.218755 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Sep 13 15:14:48.218755 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 78/144] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Sep 13 15:14:48 2022] GET /identity/v3/roles/reader => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:14:48.225855 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edce176-1a10-4e4b-a4b6-1f613a2a325d None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:14:48.387769 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edce176-1a10-4e4b-a4b6-1f613a2a325d None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:14:48.402614 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:14:48.427872 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a60d388-e1df-4915-bf3f-9a0516cc02c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:14:48.428495 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a60d388-e1df-4915-bf3f-9a0516cc02c7 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:48.428784 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a60d388-e1df-4915-bf3f-9a0516cc02c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:48.429066 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a60d388-e1df-4915-bf3f-9a0516cc02c7 None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:48.429797 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a60d388-e1df-4915-bf3f-9a0516cc02c7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:14:48.430118 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a60d388-e1df-4915-bf3f-9a0516cc02c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:14:48.431501 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a60d388-e1df-4915-bf3f-9a0516cc02c7 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:14:48.444666 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 67/145] 10.222.0.27 () {56 vars in 1101 bytes} [Tue Sep 13 15:14:48 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:14:48.454789 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5d4d14-2770-4403-85d1-eceb1e3dd4c2 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:14:48.607238 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5d4d14-2770-4403-85d1-eceb1e3dd4c2 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:14:48.648810 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01da6614-3616-45bb-8e5b-8a717727218e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:14:48.649731 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01da6614-3616-45bb-8e5b-8a717727218e None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:48.650174 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01da6614-3616-45bb-8e5b-8a717727218e None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:48.650607 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01da6614-3616-45bb-8e5b-8a717727218e None admin] PATH_INFO: `/v3/users/51446a984d37449ea74465e626699634` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:48.652225 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01da6614-3616-45bb-8e5b-8a717727218e None admin] RBAC: Authorizing `identity:get_user(user_id=51446a984d37449ea74465e626699634)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:14:48.653861 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01da6614-3616-45bb-8e5b-8a717727218e None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:14:48.655913 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 79/146] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Sep 13 15:14:48 2022] GET /identity/v3/users/51446a984d37449ea74465e626699634 => generated 289 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:14:48.661621 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a60d388-e1df-4915-bf3f-9a0516cc02c7 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:14:48.810883 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a60d388-e1df-4915-bf3f-9a0516cc02c7 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:14:48.851168 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28517859-de33-415a-8269-38c7770829b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:14:48.851808 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28517859-de33-415a-8269-38c7770829b8 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:48.852088 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28517859-de33-415a-8269-38c7770829b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:48.852361 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28517859-de33-415a-8269-38c7770829b8 None admin] PATH_INFO: `/v3/projects/6cd2be8a8d2a48ce87a8453fb81f9427` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:48.853508 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28517859-de33-415a-8269-38c7770829b8 None admin] RBAC: Authorizing `identity:get_project(project_id=6cd2be8a8d2a48ce87a8453fb81f9427)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:14:48.856047 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28517859-de33-415a-8269-38c7770829b8 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:14:48.858534 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 68/147] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Sep 13 15:14:48 2022] GET /identity/v3/projects/6cd2be8a8d2a48ce87a8453fb81f9427 => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:14:48.864322 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01da6614-3616-45bb-8e5b-8a717727218e None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:14:48.909780 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:14:48.999979 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01da6614-3616-45bb-8e5b-8a717727218e None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:14:49.038447 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e53beee-68ab-44bf-b95e-989b70959ec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:14:49.039459 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e53beee-68ab-44bf-b95e-989b70959ec1 None admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:49.039959 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e53beee-68ab-44bf-b95e-989b70959ec1 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:49.040453 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e53beee-68ab-44bf-b95e-989b70959ec1 None admin] PATH_INFO: `/v3/projects/6cd2be8a8d2a48ce87a8453fb81f9427/users/51446a984d37449ea74465e626699634/roles/b43a33bf0d63483a868ced4dfbcc4a6d` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:49.043467 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e53beee-68ab-44bf-b95e-989b70959ec1 None admin] RBAC: Authorizing `identity:create_grant(project_id=6cd2be8a8d2a48ce87a8453fb81f9427, user_id=51446a984d37449ea74465e626699634, role_id=b43a33bf0d63483a868ced4dfbcc4a6d)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:14:49.045140 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e53beee-68ab-44bf-b95e-989b70959ec1 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:14:49.074005 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 80/148] 10.222.0.27 () {58 vars in 1439 bytes} [Tue Sep 13 15:14:48 2022] PUT /identity/v3/projects/6cd2be8a8d2a48ce87a8453fb81f9427/users/51446a984d37449ea74465e626699634/roles/b43a33bf0d63483a868ced4dfbcc4a6d => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:14:49.621910 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d6a952-95ef-4dda-95b5-c6e1c48b399b None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:49.622306 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d6a952-95ef-4dda-95b5-c6e1c48b399b None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:49.622492 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d6a952-95ef-4dda-95b5-c6e1c48b399b None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:49.624215 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 69/149] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:14:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 15:14:49.629489 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a020f338-d81c-4d94-bd33-0eadcca13104 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:49.630092 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a020f338-d81c-4d94-bd33-0eadcca13104 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:49.630587 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a020f338-d81c-4d94-bd33-0eadcca13104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:49.658761 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-a020f338-d81c-4d94-bd33-0eadcca13104 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:14:49.660337 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-a020f338-d81c-4d94-bd33-0eadcca13104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:14:49.751857 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 81/150] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:14:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 15:14:50.300961 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d6a952-95ef-4dda-95b5-c6e1c48b399b None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:14:50.340157 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:14:50.442243 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d6a952-95ef-4dda-95b5-c6e1c48b399b None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:14:50.486117 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8f740d-94ca-498c-a5b9-c7fafd646530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:14:50.486763 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8f740d-94ca-498c-a5b9-c7fafd646530 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:50.487048 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8f740d-94ca-498c-a5b9-c7fafd646530 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:50.487327 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8f740d-94ca-498c-a5b9-c7fafd646530 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:50.506828 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8f740d-94ca-498c-a5b9-c7fafd646530 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 15:14:50.512194 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-2f8f740d-94ca-498c-a5b9-c7fafd646530 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 15:14:50.512194 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:14:50.512194 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:14:50.512194 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:14:50.512194 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:14:50.512194 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:14:50.512194 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:14:50.512194 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:14:50.512194 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:14:50.512194 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:14:50.512194 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:14:50.512194 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:14:50.512194 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 15:14:50.512194 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 15:14:50.512194 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 15:14:50.512194 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 15:14:50.513031 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 15:14:50.513031 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 15:14:50.513031 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 15:14:50.513031 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 15:14:50.513031 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:14:50.513031 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:14:50.513031 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:14:50.513031 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:14:50.513031 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:14:50.513031 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:14:50.513031 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:14:50.513031 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Sep 13 15:14:50.513031 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:14:50.513031 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:14:50.513031 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:14:50.513031 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:14:50.513911 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:14:50.513911 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:14:50.513911 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:14:50.513911 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:14:50.513911 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 15:14:50.513911 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 15:14:50.513911 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 15:14:50.513911 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 15:14:50.513911 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 15:14:50.513911 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 15:14:50.513911 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 15:14:50.513911 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Sep 13 15:14:50.513911 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 70/151] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Sep 13 15:14:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:14:50.520394 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a020f338-d81c-4d94-bd33-0eadcca13104 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:14:50.562453 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:14:50.575878 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c894c9-be6e-4466-a66f-42a44231e397 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:50.576525 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c894c9-be6e-4466-a66f-42a44231e397 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:50.576824 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c894c9-be6e-4466-a66f-42a44231e397 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:50.578633 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 71/152] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:14:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:14:50.583866 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff0c8ad-cd0a-4892-ae08-9df9935a98be None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:50.584152 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff0c8ad-cd0a-4892-ae08-9df9935a98be None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:50.584977 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff0c8ad-cd0a-4892-ae08-9df9935a98be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:50.612349 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-0ff0c8ad-cd0a-4892-ae08-9df9935a98be None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:14:50.613542 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-0ff0c8ad-cd0a-4892-ae08-9df9935a98be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:14:50.727535 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a020f338-d81c-4d94-bd33-0eadcca13104 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:14:50.739538 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 72/153] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:14:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 15:14:50.783955 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed7e8b8-4b26-40b2-a91e-874a6cec1b00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:14:50.784573 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed7e8b8-4b26-40b2-a91e-874a6cec1b00 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:50.784854 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed7e8b8-4b26-40b2-a91e-874a6cec1b00 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:50.785127 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed7e8b8-4b26-40b2-a91e-874a6cec1b00 None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:50.785823 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed7e8b8-4b26-40b2-a91e-874a6cec1b00 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:14:50.786206 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed7e8b8-4b26-40b2-a91e-874a6cec1b00 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:14:50.787667 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed7e8b8-4b26-40b2-a91e-874a6cec1b00 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:14:50.799071 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 82/154] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Sep 13 15:14:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:14:50.804816 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff0c8ad-cd0a-4892-ae08-9df9935a98be None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:14:50.837404 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:14:50.950896 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff0c8ad-cd0a-4892-ae08-9df9935a98be None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:14:50.996838 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99048dee-ef7b-4d95-8430-af01810e27f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:14:50.997479 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99048dee-ef7b-4d95-8430-af01810e27f3 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:50.997781 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99048dee-ef7b-4d95-8430-af01810e27f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:50.998057 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99048dee-ef7b-4d95-8430-af01810e27f3 None admin] PATH_INFO: `/v3/users/50d6e356b66c47338a3bc6aea3a43029` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:51.002601 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99048dee-ef7b-4d95-8430-af01810e27f3 None admin] RBAC: Authorizing `identity:get_user(user_id=50d6e356b66c47338a3bc6aea3a43029)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:14:51.004176 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99048dee-ef7b-4d95-8430-af01810e27f3 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:14:51.006050 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 73/155] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Sep 13 15:14:50 2022] GET /identity/v3/users/50d6e356b66c47338a3bc6aea3a43029 => generated 247 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:14:51.012781 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed7e8b8-4b26-40b2-a91e-874a6cec1b00 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:14:51.131230 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:14:51.150821 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed7e8b8-4b26-40b2-a91e-874a6cec1b00 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:14:51.192239 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ca3bf5-3ef6-4dda-9f8a-ae6edf06a8c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:14:51.192853 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ca3bf5-3ef6-4dda-9f8a-ae6edf06a8c8 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:51.193132 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ca3bf5-3ef6-4dda-9f8a-ae6edf06a8c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:51.193400 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ca3bf5-3ef6-4dda-9f8a-ae6edf06a8c8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:51.357188 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86442ccb-f86b-4ba1-bd0e-6c9ff3a7d58b None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:51.357694 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86442ccb-f86b-4ba1-bd0e-6c9ff3a7d58b None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:51.357816 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86442ccb-f86b-4ba1-bd0e-6c9ff3a7d58b None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:51.359263 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 74/156] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:14:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:14:51.364818 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff53ca4-f6c6-4c8b-8a72-beae6775d578 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:51.365294 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff53ca4-f6c6-4c8b-8a72-beae6775d578 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:51.365729 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff53ca4-f6c6-4c8b-8a72-beae6775d578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:51.393726 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ca3bf5-3ef6-4dda-9f8a-ae6edf06a8c8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:14:51.393726 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ca3bf5-3ef6-4dda-9f8a-ae6edf06a8c8 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:14:51.431559 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-0ff53ca4-f6c6-4c8b-8a72-beae6775d578 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:14:51.434157 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-0ff53ca4-f6c6-4c8b-8a72-beae6775d578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:14:51.607637 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:14:51.643040 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 75/157] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:14:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 15:14:51.644071 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff53ca4-f6c6-4c8b-8a72-beae6775d578 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:14:51.664949 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 83/158] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Sep 13 15:14:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 653 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 15:14:51.666248 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fcacdf-e9cb-462c-9b96-e00b28039345 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:51.667132 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fcacdf-e9cb-462c-9b96-e00b28039345 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:51.667578 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fcacdf-e9cb-462c-9b96-e00b28039345 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:51.669137 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 84/159] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:14:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:14:51.678645 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fcacdf-e9cb-462c-9b96-e00b28039345 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:14:51.690073 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:14:51.942706 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fcacdf-e9cb-462c-9b96-e00b28039345 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:14:51.967110 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff53ca4-f6c6-4c8b-8a72-beae6775d578 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:14:52.009795 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2433c57f-18c3-4826-be9b-6d7a832fcf10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:14:52.011186 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2433c57f-18c3-4826-be9b-6d7a832fcf10 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:52.011692 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2433c57f-18c3-4826-be9b-6d7a832fcf10 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:52.012071 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2433c57f-18c3-4826-be9b-6d7a832fcf10 None admin] PATH_INFO: `/v3/projects/6cd2be8a8d2a48ce87a8453fb81f9427` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:52.014390 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2433c57f-18c3-4826-be9b-6d7a832fcf10 None admin] RBAC: Authorizing `identity:get_project(project_id=6cd2be8a8d2a48ce87a8453fb81f9427)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:14:52.015853 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2433c57f-18c3-4826-be9b-6d7a832fcf10 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:14:52.017493 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 85/160] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Sep 13 15:14:51 2022] GET /identity/v3/projects/6cd2be8a8d2a48ce87a8453fb81f9427 => generated 298 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:14:52.019099 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0112a5ff-bcb2-4724-9028-8aa5890c6a18 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:52.019597 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0112a5ff-bcb2-4724-9028-8aa5890c6a18 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:52.020083 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0112a5ff-bcb2-4724-9028-8aa5890c6a18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:52.025720 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33c1e2e-d1f2-4e20-a380-2e25fda41052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:14:52.025720 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33c1e2e-d1f2-4e20-a380-2e25fda41052 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:52.025720 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33c1e2e-d1f2-4e20-a380-2e25fda41052 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:52.025720 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33c1e2e-d1f2-4e20-a380-2e25fda41052 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:52.043152 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33c1e2e-d1f2-4e20-a380-2e25fda41052 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 15:14:52.048180 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-d33c1e2e-d1f2-4e20-a380-2e25fda41052 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 15:14:52.048180 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:14:52.048180 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:14:52.048180 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:14:52.048180 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:14:52.048180 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:14:52.048180 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:14:52.048180 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:14:52.048180 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:14:52.048180 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:14:52.048180 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:14:52.048180 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:14:52.048180 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 15:14:52.048180 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 15:14:52.048180 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 15:14:52.048180 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 15:14:52.049086 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 15:14:52.049086 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 15:14:52.049086 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 15:14:52.049086 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 15:14:52.049086 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:14:52.049086 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:14:52.049086 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:14:52.049086 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:14:52.049086 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:14:52.049086 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:14:52.049086 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:14:52.049086 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Sep 13 15:14:52.049086 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:14:52.049086 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:14:52.049086 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:14:52.049086 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:14:52.049881 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:14:52.049881 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:14:52.049881 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:14:52.049881 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:14:52.049881 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 15:14:52.049881 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 15:14:52.049881 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 15:14:52.049881 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 15:14:52.049881 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 15:14:52.049881 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 15:14:52.049881 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 15:14:52.049881 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Sep 13 15:14:52.054163 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 76/161] 10.222.0.27 () {56 vars in 1114 bytes} [Tue Sep 13 15:14:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 410 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:14:52.055000 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33c1e2e-d1f2-4e20-a380-2e25fda41052 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:14:52.062681 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-0112a5ff-bcb2-4724-9028-8aa5890c6a18 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:14:52.064145 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-0112a5ff-bcb2-4724-9028-8aa5890c6a18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:14:52.148589 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:14:52.189488 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 86/162] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:14:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 15:14:52.190702 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0112a5ff-bcb2-4724-9028-8aa5890c6a18 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:14:52.207777 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:14:52.263551 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33c1e2e-d1f2-4e20-a380-2e25fda41052 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:14:52.332603 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0361a7e-deb7-4aef-8767-d531076b3aa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:14:52.333637 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0361a7e-deb7-4aef-8767-d531076b3aa5 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:52.334150 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0361a7e-deb7-4aef-8767-d531076b3aa5 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:52.335421 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0361a7e-deb7-4aef-8767-d531076b3aa5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:52.336356 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0361a7e-deb7-4aef-8767-d531076b3aa5 None admin] RBAC: Adding query filter params (role.id=f34412ad29f1478cba775b033129f71f, scope.project.id=6cd2be8a8d2a48ce87a8453fb81f9427, user.id=50d6e356b66c47338a3bc6aea3a43029) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:14:52.336894 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0361a7e-deb7-4aef-8767-d531076b3aa5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:14:52.339320 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0361a7e-deb7-4aef-8767-d531076b3aa5 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:14:52.347306 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 77/163] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Sep 13 15:14:52 2022] GET /identity/v3/role_assignments?user.id=50d6e356b66c47338a3bc6aea3a43029&scope.project.id=6cd2be8a8d2a48ce87a8453fb81f9427&role.id=f34412ad29f1478cba775b033129f71f => generated 608 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:14:52.348690 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0361a7e-deb7-4aef-8767-d531076b3aa5 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:14:52.404089 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0112a5ff-bcb2-4724-9028-8aa5890c6a18 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:14:52.469186 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0361a7e-deb7-4aef-8767-d531076b3aa5 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:14:52.474404 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18a6b16-35f3-4f07-8d63-7214938f8098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:14:52.475039 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18a6b16-35f3-4f07-8d63-7214938f8098 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:52.475323 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18a6b16-35f3-4f07-8d63-7214938f8098 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:52.475598 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18a6b16-35f3-4f07-8d63-7214938f8098 None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:52.476284 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18a6b16-35f3-4f07-8d63-7214938f8098 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:14:52.476605 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18a6b16-35f3-4f07-8d63-7214938f8098 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:14:52.478059 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18a6b16-35f3-4f07-8d63-7214938f8098 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:14:52.496665 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 87/164] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Sep 13 15:14:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:14:52.503806 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18a6b16-35f3-4f07-8d63-7214938f8098 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:14:52.511086 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77da49a5-5792-465c-aef9-b44794682842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:14:52.512555 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77da49a5-5792-465c-aef9-b44794682842 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:52.513092 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77da49a5-5792-465c-aef9-b44794682842 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:52.513664 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77da49a5-5792-465c-aef9-b44794682842 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:52.525135 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77da49a5-5792-465c-aef9-b44794682842 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 15:14:52.532103 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-77da49a5-5792-465c-aef9-b44794682842 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 15:14:52.532103 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:14:52.532103 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:14:52.532103 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:14:52.532103 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:14:52.532103 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:14:52.532103 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:14:52.532103 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:14:52.532103 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:14:52.532103 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:14:52.532103 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:14:52.532103 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:14:52.532103 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 15:14:52.532103 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 15:14:52.532103 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 15:14:52.532103 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 15:14:52.532951 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 15:14:52.532951 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 15:14:52.532951 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 15:14:52.532951 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 15:14:52.532951 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:14:52.532951 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:14:52.532951 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:14:52.532951 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:14:52.532951 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:14:52.532951 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:14:52.532951 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:14:52.532951 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Sep 13 15:14:52.532951 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:14:52.532951 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:14:52.532951 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:14:52.532951 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:14:52.533738 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:14:52.533738 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:14:52.533738 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:14:52.533738 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:14:52.533738 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 15:14:52.533738 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 15:14:52.533738 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 15:14:52.533738 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 15:14:52.533738 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 15:14:52.533738 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 15:14:52.533738 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 15:14:52.533738 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Sep 13 15:14:52.537017 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 78/165] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Sep 13 15:14:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:14:52.542057 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:14:52.542963 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b2b579-5154-495a-9a32-12f672a1f7ff None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:52.543623 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b2b579-5154-495a-9a32-12f672a1f7ff None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:52.544230 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b2b579-5154-495a-9a32-12f672a1f7ff None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:52.545760 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 79/166] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:14:52 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:14:52.546737 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b2b579-5154-495a-9a32-12f672a1f7ff None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:14:52.589862 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:14:52.688855 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18a6b16-35f3-4f07-8d63-7214938f8098 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:14:52.703919 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b2b579-5154-495a-9a32-12f672a1f7ff None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:14:52.759246 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5e0152-a1fe-4bf6-9cfb-96b95f9122e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:14:52.759246 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5e0152-a1fe-4bf6-9cfb-96b95f9122e4 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:52.759560 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5e0152-a1fe-4bf6-9cfb-96b95f9122e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:52.759630 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5e0152-a1fe-4bf6-9cfb-96b95f9122e4 None admin] PATH_INFO: `/v3/users/5b2e21c1e08c42f18233d33bd9c6be68` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:52.761402 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5e0152-a1fe-4bf6-9cfb-96b95f9122e4 None admin] RBAC: Authorizing `identity:get_user(user_id=5b2e21c1e08c42f18233d33bd9c6be68)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:14:52.762695 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb092d1f-5de4-46b0-832b-f2bbabfa9409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:14:52.762904 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5e0152-a1fe-4bf6-9cfb-96b95f9122e4 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:14:52.763771 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb092d1f-5de4-46b0-832b-f2bbabfa9409 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:52.764272 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb092d1f-5de4-46b0-832b-f2bbabfa9409 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:52.764747 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb092d1f-5de4-46b0-832b-f2bbabfa9409 None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:52.764855 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 88/167] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Sep 13 15:14:52 2022] GET /identity/v3/users/5b2e21c1e08c42f18233d33bd9c6be68 => generated 275 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:14:52.765860 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb092d1f-5de4-46b0-832b-f2bbabfa9409 None admin] RBAC: Adding query filter params (name=member) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:14:52.765963 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82e6fb0-3f70-477c-9b04-ae573560b7c9 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:52.766204 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82e6fb0-3f70-477c-9b04-ae573560b7c9 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:52.766478 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82e6fb0-3f70-477c-9b04-ae573560b7c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:52.766828 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb092d1f-5de4-46b0-832b-f2bbabfa9409 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:14:52.768503 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb092d1f-5de4-46b0-832b-f2bbabfa9409 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:14:52.788065 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 80/168] 10.222.0.27 () {56 vars in 1101 bytes} [Tue Sep 13 15:14:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:14:52.789325 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb092d1f-5de4-46b0-832b-f2bbabfa9409 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:14:52.798902 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-e82e6fb0-3f70-477c-9b04-ae573560b7c9 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:14:52.800116 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-e82e6fb0-3f70-477c-9b04-ae573560b7c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:14:52.903587 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:14:52.934124 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 89/169] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:14:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 15:14:52.935319 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82e6fb0-3f70-477c-9b04-ae573560b7c9 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:14:52.974264 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb092d1f-5de4-46b0-832b-f2bbabfa9409 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:14:53.033155 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:14:53.055251 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d65e22-175b-45ac-9b95-0f6d84c5060e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:14:53.055869 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d65e22-175b-45ac-9b95-0f6d84c5060e None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:53.056144 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d65e22-175b-45ac-9b95-0f6d84c5060e None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:53.056416 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d65e22-175b-45ac-9b95-0f6d84c5060e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:53.159258 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82e6fb0-3f70-477c-9b04-ae573560b7c9 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:14:53.222237 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d65e22-175b-45ac-9b95-0f6d84c5060e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:14:53.223725 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d65e22-175b-45ac-9b95-0f6d84c5060e None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:14:53.240870 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5261c3-d2e3-4649-8e0d-edfeee47317f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:14:53.241436 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5261c3-d2e3-4649-8e0d-edfeee47317f None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:53.241730 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5261c3-d2e3-4649-8e0d-edfeee47317f None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:53.242021 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5261c3-d2e3-4649-8e0d-edfeee47317f None admin] PATH_INFO: `/v3/users/5b2e21c1e08c42f18233d33bd9c6be68` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:53.246430 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5261c3-d2e3-4649-8e0d-edfeee47317f None admin] RBAC: Authorizing `identity:get_user(user_id=5b2e21c1e08c42f18233d33bd9c6be68)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:14:53.247903 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5261c3-d2e3-4649-8e0d-edfeee47317f None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:14:53.249728 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 90/170] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Sep 13 15:14:52 2022] GET /identity/v3/users/5b2e21c1e08c42f18233d33bd9c6be68 => generated 275 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:14:53.250411 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5261c3-d2e3-4649-8e0d-edfeee47317f None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:14:53.349151 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:14:53.395002 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5261c3-d2e3-4649-8e0d-edfeee47317f None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:14:53.414031 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:14:53.431887 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 81/171] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Sep 13 15:14:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 643 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 15:14:53.436895 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d65e22-175b-45ac-9b95-0f6d84c5060e None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:14:53.449187 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea75f9c-46ca-4ceb-a6c0-4069720a89a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:14:53.450148 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea75f9c-46ca-4ceb-a6c0-4069720a89a8 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:53.450148 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea75f9c-46ca-4ceb-a6c0-4069720a89a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:53.450369 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea75f9c-46ca-4ceb-a6c0-4069720a89a8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:53.461324 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea75f9c-46ca-4ceb-a6c0-4069720a89a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 15:14:53.466783 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-1ea75f9c-46ca-4ceb-a6c0-4069720a89a8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 15:14:53.466783 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:14:53.466783 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:14:53.466783 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:14:53.466783 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:14:53.466783 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:14:53.466783 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:14:53.466783 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:14:53.466783 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:14:53.466783 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:14:53.466783 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:14:53.466783 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:14:53.466783 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 15:14:53.466783 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 15:14:53.466783 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 15:14:53.466783 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 15:14:53.467867 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 15:14:53.467867 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 15:14:53.467867 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 15:14:53.467867 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 15:14:53.467867 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:14:53.467867 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:14:53.467867 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:14:53.467867 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:14:53.467867 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:14:53.467867 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:14:53.467867 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:14:53.467867 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Sep 13 15:14:53.467867 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:14:53.467867 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:14:53.467867 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:14:53.467867 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:14:53.468655 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:14:53.468655 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:14:53.468655 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:14:53.468655 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:14:53.468655 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 15:14:53.468655 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 15:14:53.468655 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 15:14:53.468655 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 15:14:53.468655 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 15:14:53.468655 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 15:14:53.468655 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 15:14:53.468655 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Sep 13 15:14:53.468655 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 91/172] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Sep 13 15:14:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:14:53.469386 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a35cc7f-d814-4d5c-ba9c-3e9d655b14f9 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:53.469386 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a35cc7f-d814-4d5c-ba9c-3e9d655b14f9 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:53.469613 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a35cc7f-d814-4d5c-ba9c-3e9d655b14f9 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:53.471087 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 92/173] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:14:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:14:53.471835 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a35cc7f-d814-4d5c-ba9c-3e9d655b14f9 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:14:53.552082 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d65e22-175b-45ac-9b95-0f6d84c5060e None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:14:53.592173 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a7e915-2426-4288-8875-35716e457fad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:14:53.593113 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a7e915-2426-4288-8875-35716e457fad None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:53.593599 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a7e915-2426-4288-8875-35716e457fad None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:53.593966 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a7e915-2426-4288-8875-35716e457fad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:53.596721 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a35cc7f-d814-4d5c-ba9c-3e9d655b14f9 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:14:53.623861 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:14:53.637506 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2a3799-c672-4865-bddc-5fb163a60097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:14:53.638444 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2a3799-c672-4865-bddc-5fb163a60097 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:53.638892 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2a3799-c672-4865-bddc-5fb163a60097 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:53.639308 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2a3799-c672-4865-bddc-5fb163a60097 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:53.651828 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2a3799-c672-4865-bddc-5fb163a60097 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 15:14:53.657382 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-9e2a3799-c672-4865-bddc-5fb163a60097 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 15:14:53.657382 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:14:53.657382 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:14:53.657382 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:14:53.657382 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:14:53.657382 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:14:53.657382 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:14:53.657382 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:14:53.657382 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:14:53.657382 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:14:53.657382 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:14:53.657382 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:14:53.657382 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 15:14:53.657382 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 15:14:53.657382 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 15:14:53.657382 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 15:14:53.658444 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 15:14:53.658444 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 15:14:53.658444 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 15:14:53.658444 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 15:14:53.658444 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:14:53.658444 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:14:53.658444 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:14:53.658444 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:14:53.658444 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:14:53.658444 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:14:53.658444 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:14:53.658444 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Sep 13 15:14:53.658444 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:14:53.658444 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:14:53.658444 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:14:53.658444 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:14:53.659221 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:14:53.659221 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:14:53.659221 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:14:53.659221 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:14:53.659221 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 15:14:53.659221 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 15:14:53.659221 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 15:14:53.659221 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 15:14:53.659221 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 15:14:53.659221 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 15:14:53.659221 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 15:14:53.659221 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Sep 13 15:14:53.659221 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 93/174] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Sep 13 15:14:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:14:53.662507 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2a3799-c672-4865-bddc-5fb163a60097 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:14:53.672492 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a7e915-2426-4288-8875-35716e457fad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:14:53.674017 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a7e915-2426-4288-8875-35716e457fad None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:14:53.695153 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:14:53.767357 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2a3799-c672-4865-bddc-5fb163a60097 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:14:53.773791 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 82/175] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Sep 13 15:14:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 15:14:53.774625 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a7e915-2426-4288-8875-35716e457fad None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:14:53.800762 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0945bc4-c4ea-4a7f-9373-3dd75504826a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:14:53.801392 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0945bc4-c4ea-4a7f-9373-3dd75504826a None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:53.801677 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0945bc4-c4ea-4a7f-9373-3dd75504826a None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:53.801983 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0945bc4-c4ea-4a7f-9373-3dd75504826a None admin] PATH_INFO: `/v3/projects/6cd2be8a8d2a48ce87a8453fb81f9427` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:53.803168 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0945bc4-c4ea-4a7f-9373-3dd75504826a None admin] RBAC: Authorizing `identity:get_project(project_id=6cd2be8a8d2a48ce87a8453fb81f9427)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:14:53.804560 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0945bc4-c4ea-4a7f-9373-3dd75504826a None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:14:53.810518 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 94/176] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Sep 13 15:14:53 2022] GET /identity/v3/projects/6cd2be8a8d2a48ce87a8453fb81f9427 => generated 298 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:14:53.810518 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5264bb-7dd6-457a-a77e-b94760b16c87 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:53.810518 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5264bb-7dd6-457a-a77e-b94760b16c87 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:53.810518 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5264bb-7dd6-457a-a77e-b94760b16c87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:53.827157 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-fb5264bb-7dd6-457a-a77e-b94760b16c87 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:14:53.828440 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-fb5264bb-7dd6-457a-a77e-b94760b16c87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:14:53.833107 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:14:53.875193 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a7e915-2426-4288-8875-35716e457fad None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:14:53.894887 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 95/177] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:14:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 15:14:53.896452 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3eba77-400d-44e6-b088-3b377d8dfc43 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:53.896743 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3eba77-400d-44e6-b088-3b377d8dfc43 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:53.897026 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3eba77-400d-44e6-b088-3b377d8dfc43 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:53.898619 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 96/178] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:14:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:14:53.899345 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3eba77-400d-44e6-b088-3b377d8dfc43 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:14:53.909790 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06f9c1a-c6ad-4095-a683-636b098dcdb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:14:53.910603 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06f9c1a-c6ad-4095-a683-636b098dcdb2 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:53.911605 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06f9c1a-c6ad-4095-a683-636b098dcdb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:53.911605 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06f9c1a-c6ad-4095-a683-636b098dcdb2 None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:53.911796 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06f9c1a-c6ad-4095-a683-636b098dcdb2 None admin] RBAC: Adding query filter params (name=member) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:14:53.912098 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06f9c1a-c6ad-4095-a683-636b098dcdb2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:14:53.913459 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06f9c1a-c6ad-4095-a683-636b098dcdb2 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:14:53.930878 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 83/179] 10.222.0.27 () {56 vars in 1101 bytes} [Tue Sep 13 15:14:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:14:53.930878 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f5ed86-1fc9-493e-b178-ca951f920637 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:53.930878 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f5ed86-1fc9-493e-b178-ca951f920637 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:53.930878 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f5ed86-1fc9-493e-b178-ca951f920637 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:53.930878 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 84/180] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:14:53 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:14:53.930878 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f5ed86-1fc9-493e-b178-ca951f920637 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:14:53.952923 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:14:54.030766 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3eba77-400d-44e6-b088-3b377d8dfc43 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:14:54.037245 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f5ed86-1fc9-493e-b178-ca951f920637 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:14:54.062321 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:14:54.066718 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f55ff7-3131-4b43-b864-195f6d30e47f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:14:54.067332 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f55ff7-3131-4b43-b864-195f6d30e47f None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:54.067604 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f55ff7-3131-4b43-b864-195f6d30e47f None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:54.067877 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f55ff7-3131-4b43-b864-195f6d30e47f None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:54.068532 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f55ff7-3131-4b43-b864-195f6d30e47f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:14:54.068833 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f55ff7-3131-4b43-b864-195f6d30e47f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:14:54.070238 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f55ff7-3131-4b43-b864-195f6d30e47f None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:14:54.075390 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedcca45-a952-4393-9e69-3ce357021eee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:14:54.076023 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedcca45-a952-4393-9e69-3ce357021eee None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:54.076303 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedcca45-a952-4393-9e69-3ce357021eee None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:54.076583 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedcca45-a952-4393-9e69-3ce357021eee None admin] PATH_INFO: `/v3/projects/6cd2be8a8d2a48ce87a8453fb81f9427` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:54.077742 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedcca45-a952-4393-9e69-3ce357021eee None admin] RBAC: Authorizing `identity:get_project(project_id=6cd2be8a8d2a48ce87a8453fb81f9427)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:14:54.083780 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 97/181] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Sep 13 15:14:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:14:54.083945 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedcca45-a952-4393-9e69-3ce357021eee None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:14:54.084037 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f55ff7-3131-4b43-b864-195f6d30e47f None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:14:54.084118 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 85/182] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Sep 13 15:14:53 2022] GET /identity/v3/projects/6cd2be8a8d2a48ce87a8453fb81f9427 => generated 298 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:14:54.084118 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcefd65-0c7d-4657-bbc1-372790e236f2 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:54.084118 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcefd65-0c7d-4657-bbc1-372790e236f2 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:54.084118 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcefd65-0c7d-4657-bbc1-372790e236f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:54.100744 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-adcefd65-0c7d-4657-bbc1-372790e236f2 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:14:54.101967 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-adcefd65-0c7d-4657-bbc1-372790e236f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:14:54.174362 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:14:54.185862 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 86/183] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:14:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 15:14:54.185862 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcefd65-0c7d-4657-bbc1-372790e236f2 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:14:54.186088 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f55ff7-3131-4b43-b864-195f6d30e47f None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:14:54.219541 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f11870-9278-4cbd-9b7d-ba7099725a65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:14:54.220152 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f11870-9278-4cbd-9b7d-ba7099725a65 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:54.220437 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f11870-9278-4cbd-9b7d-ba7099725a65 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:54.220714 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f11870-9278-4cbd-9b7d-ba7099725a65 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:54.221439 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f11870-9278-4cbd-9b7d-ba7099725a65 None admin] RBAC: Adding query filter params (role.id=5d9c0543f8e04065bb3d8bcd11156c1d, scope.project.id=6cd2be8a8d2a48ce87a8453fb81f9427, user.id=5b2e21c1e08c42f18233d33bd9c6be68) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:14:54.221783 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f11870-9278-4cbd-9b7d-ba7099725a65 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:14:54.223221 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f11870-9278-4cbd-9b7d-ba7099725a65 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:14:54.241738 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 98/184] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Sep 13 15:14:54 2022] GET /identity/v3/role_assignments?user.id=5b2e21c1e08c42f18233d33bd9c6be68&scope.project.id=6cd2be8a8d2a48ce87a8453fb81f9427&role.id=5d9c0543f8e04065bb3d8bcd11156c1d => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:14:54.241738 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99081c7-a70c-4765-b415-d66b463c9d83 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:54.241738 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99081c7-a70c-4765-b415-d66b463c9d83 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:54.241738 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99081c7-a70c-4765-b415-d66b463c9d83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:54.264923 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-d99081c7-a70c-4765-b415-d66b463c9d83 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:14:54.266305 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-d99081c7-a70c-4765-b415-d66b463c9d83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:14:54.316728 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcefd65-0c7d-4657-bbc1-372790e236f2 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:14:54.340691 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:14:54.355319 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 99/185] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:14:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 15:14:54.356867 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99081c7-a70c-4765-b415-d66b463c9d83 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:14:54.357786 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539f08ee-9d5e-45be-a9e3-26d85c50b186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:14:54.358450 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539f08ee-9d5e-45be-a9e3-26d85c50b186 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:54.358791 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539f08ee-9d5e-45be-a9e3-26d85c50b186 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:54.359066 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539f08ee-9d5e-45be-a9e3-26d85c50b186 None admin] PATH_INFO: `/v3/users/5b2e21c1e08c42f18233d33bd9c6be68` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:54.360306 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539f08ee-9d5e-45be-a9e3-26d85c50b186 None admin] RBAC: Authorizing `identity:get_user(user_id=5b2e21c1e08c42f18233d33bd9c6be68)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:14:54.361976 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539f08ee-9d5e-45be-a9e3-26d85c50b186 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:14:54.364086 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 87/186] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Sep 13 15:14:54 2022] GET /identity/v3/users/5b2e21c1e08c42f18233d33bd9c6be68 => generated 275 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:14:54.364584 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539f08ee-9d5e-45be-a9e3-26d85c50b186 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:14:54.462141 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:14:54.471276 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99081c7-a70c-4765-b415-d66b463c9d83 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:14:54.476498 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539f08ee-9d5e-45be-a9e3-26d85c50b186 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:14:54.512651 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2154c3d-bda0-4bbe-9da5-d33a3ab4aa55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:14:54.512856 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad12bb8-8772-4238-b2e3-d2d88711d5b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:14:54.513292 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad12bb8-8772-4238-b2e3-d2d88711d5b4 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:54.513398 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2154c3d-bda0-4bbe-9da5-d33a3ab4aa55 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:54.513570 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2154c3d-bda0-4bbe-9da5-d33a3ab4aa55 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:54.513664 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad12bb8-8772-4238-b2e3-d2d88711d5b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:54.513865 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad12bb8-8772-4238-b2e3-d2d88711d5b4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:54.513958 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2154c3d-bda0-4bbe-9da5-d33a3ab4aa55 None admin] PATH_INFO: `/v3/users/2d52ccc9cb61411ab11b4dc5348bc630` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:54.514607 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad12bb8-8772-4238-b2e3-d2d88711d5b4 None admin] RBAC: Adding query filter params (role.id=3fae3d3a28e147d3b2bede2378ff79ae, scope.project.id=6cd2be8a8d2a48ce87a8453fb81f9427, user.id=5b2e21c1e08c42f18233d33bd9c6be68) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:14:54.514918 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad12bb8-8772-4238-b2e3-d2d88711d5b4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:14:54.516358 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad12bb8-8772-4238-b2e3-d2d88711d5b4 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:14:54.523010 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 88/187] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Sep 13 15:14:54 2022] GET /identity/v3/role_assignments?user.id=5b2e21c1e08c42f18233d33bd9c6be68&scope.project.id=6cd2be8a8d2a48ce87a8453fb81f9427&role.id=3fae3d3a28e147d3b2bede2378ff79ae => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:14:54.523820 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad12bb8-8772-4238-b2e3-d2d88711d5b4 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:14:54.530189 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2154c3d-bda0-4bbe-9da5-d33a3ab4aa55 None admin] RBAC: Authorizing `identity:get_user(user_id=2d52ccc9cb61411ab11b4dc5348bc630)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:14:54.531676 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2154c3d-bda0-4bbe-9da5-d33a3ab4aa55 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:14:54.533636 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 100/188] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Sep 13 15:14:54 2022] GET /identity/v3/users/2d52ccc9cb61411ab11b4dc5348bc630 => generated 283 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:14:54.538522 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2154c3d-bda0-4bbe-9da5-d33a3ab4aa55 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:14:54.604259 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:14:54.665410 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad12bb8-8772-4238-b2e3-d2d88711d5b4 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:14:54.689514 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2154c3d-bda0-4bbe-9da5-d33a3ab4aa55 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:14:54.714713 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07340093-da3f-4306-9f85-b40b3619b854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:14:54.715950 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07340093-da3f-4306-9f85-b40b3619b854 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:54.716237 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07340093-da3f-4306-9f85-b40b3619b854 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:54.716574 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07340093-da3f-4306-9f85-b40b3619b854 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:54.731331 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07340093-da3f-4306-9f85-b40b3619b854 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 15:14:54.734986 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9c66a5-c105-4a07-9412-d5ab70dbc408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:14:54.735710 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9c66a5-c105-4a07-9412-d5ab70dbc408 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:54.736090 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9c66a5-c105-4a07-9412-d5ab70dbc408 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:54.736464 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9c66a5-c105-4a07-9412-d5ab70dbc408 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:54.736903 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-07340093-da3f-4306-9f85-b40b3619b854 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 15:14:54.736903 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:14:54.736903 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:14:54.736903 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:14:54.736903 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:14:54.736903 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:14:54.736903 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:14:54.736903 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:14:54.736903 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:14:54.736903 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:14:54.736903 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:14:54.736903 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:14:54.736903 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 15:14:54.736903 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 15:14:54.736903 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 15:14:54.736903 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 15:14:54.737999 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 15:14:54.737999 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 15:14:54.737999 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 15:14:54.737999 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 15:14:54.737999 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:14:54.737999 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:14:54.737999 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:14:54.737999 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:14:54.737999 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:14:54.737999 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:14:54.737999 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:14:54.737999 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Sep 13 15:14:54.737999 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:14:54.737999 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:14:54.737999 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:14:54.737999 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:14:54.738962 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:14:54.738962 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:14:54.738962 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:14:54.738962 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:14:54.738962 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 15:14:54.738962 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 15:14:54.738962 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 15:14:54.738962 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 15:14:54.738962 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 15:14:54.738962 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 15:14:54.738962 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 15:14:54.738962 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Sep 13 15:14:54.738962 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 89/189] 10.222.0.27 () {56 vars in 1114 bytes} [Tue Sep 13 15:14:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:14:54.738962 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07340093-da3f-4306-9f85-b40b3619b854 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:14:54.752393 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:14:54.828437 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9c66a5-c105-4a07-9412-d5ab70dbc408 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:14:54.830121 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9c66a5-c105-4a07-9412-d5ab70dbc408 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:14:54.850793 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07340093-da3f-4306-9f85-b40b3619b854 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:14:54.864559 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:14:54.887112 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ab9fd2-43c4-4ee2-8c9f-5e38abbf4d43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:14:54.887741 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ab9fd2-43c4-4ee2-8c9f-5e38abbf4d43 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:54.888060 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ab9fd2-43c4-4ee2-8c9f-5e38abbf4d43 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:54.888337 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ab9fd2-43c4-4ee2-8c9f-5e38abbf4d43 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:54.889454 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ab9fd2-43c4-4ee2-8c9f-5e38abbf4d43 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:14:54.890931 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ab9fd2-43c4-4ee2-8c9f-5e38abbf4d43 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:14:54.892507 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 90/190] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 13 15:14:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:14:54.893270 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ab9fd2-43c4-4ee2-8c9f-5e38abbf4d43 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:14:54.928179 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 101/191] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Sep 13 15:14:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 15:14:54.929010 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9c66a5-c105-4a07-9412-d5ab70dbc408 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:14:54.969203 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:14:55.002392 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ab9fd2-43c4-4ee2-8c9f-5e38abbf4d43 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:14:55.025297 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9c66a5-c105-4a07-9412-d5ab70dbc408 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:14:55.035028 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08c45e7-d168-4cbd-b9a9-2d3cbdb0d811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:14:55.035641 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08c45e7-d168-4cbd-b9a9-2d3cbdb0d811 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:55.035922 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08c45e7-d168-4cbd-b9a9-2d3cbdb0d811 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:55.036198 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08c45e7-d168-4cbd-b9a9-2d3cbdb0d811 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:55.059883 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0797fe7-2e32-4ba1-865b-a44b461194ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:14:55.060513 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0797fe7-2e32-4ba1-865b-a44b461194ec None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:55.060797 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0797fe7-2e32-4ba1-865b-a44b461194ec None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:55.061079 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0797fe7-2e32-4ba1-865b-a44b461194ec None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:55.070933 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0797fe7-2e32-4ba1-865b-a44b461194ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 15:14:55.076834 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-f0797fe7-2e32-4ba1-865b-a44b461194ec None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 15:14:55.076834 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:14:55.076834 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:14:55.076834 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:14:55.076834 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:14:55.076834 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:14:55.076834 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:14:55.076834 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:14:55.076834 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:14:55.076834 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:14:55.076834 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:14:55.076834 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:14:55.076834 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 15:14:55.076834 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 15:14:55.076834 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 15:14:55.076834 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 15:14:55.077753 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 15:14:55.077753 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 15:14:55.077753 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 15:14:55.077753 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 15:14:55.077753 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:14:55.077753 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:14:55.077753 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:14:55.077753 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:14:55.077753 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:14:55.077753 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:14:55.077753 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:14:55.077753 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Sep 13 15:14:55.077753 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:14:55.077753 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:14:55.077753 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:14:55.077753 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:14:55.078553 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:14:55.078553 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:14:55.078553 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:14:55.078553 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:14:55.078553 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 15:14:55.078553 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 15:14:55.078553 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 15:14:55.078553 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 15:14:55.078553 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 15:14:55.078553 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 15:14:55.078553 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 15:14:55.078553 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Sep 13 15:14:55.078553 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 102/192] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Sep 13 15:14:54 2022] GET /identity/v3/roles/reader => generated 84 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:14:55.079222 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0797fe7-2e32-4ba1-865b-a44b461194ec None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:14:55.089330 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:14:55.110131 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08c45e7-d168-4cbd-b9a9-2d3cbdb0d811 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:14:55.111605 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08c45e7-d168-4cbd-b9a9-2d3cbdb0d811 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:14:55.177046 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:14:55.180826 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0797fe7-2e32-4ba1-865b-a44b461194ec None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:14:55.208349 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 91/193] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Sep 13 15:14:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 15:14:55.208991 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08c45e7-d168-4cbd-b9a9-2d3cbdb0d811 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:14:55.217226 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40901908-11ab-417d-a325-d3b584bab5d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:14:55.217965 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40901908-11ab-417d-a325-d3b584bab5d6 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:55.218269 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40901908-11ab-417d-a325-d3b584bab5d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:55.218547 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40901908-11ab-417d-a325-d3b584bab5d6 None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:55.219215 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40901908-11ab-417d-a325-d3b584bab5d6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:14:55.219522 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40901908-11ab-417d-a325-d3b584bab5d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:14:55.220947 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40901908-11ab-417d-a325-d3b584bab5d6 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:14:55.234134 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 103/194] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Sep 13 15:14:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:14:55.234134 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40901908-11ab-417d-a325-d3b584bab5d6 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:14:55.292864 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:14:55.313020 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08c45e7-d168-4cbd-b9a9-2d3cbdb0d811 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:14:55.328548 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40901908-11ab-417d-a325-d3b584bab5d6 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:14:55.348563 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8651994e-de9e-4f1a-b1e6-7832f6026a44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:14:55.349178 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8651994e-de9e-4f1a-b1e6-7832f6026a44 None admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:55.349457 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8651994e-de9e-4f1a-b1e6-7832f6026a44 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:55.349752 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8651994e-de9e-4f1a-b1e6-7832f6026a44 None admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:55.350409 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8651994e-de9e-4f1a-b1e6-7832f6026a44 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:14:55.351865 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8651994e-de9e-4f1a-b1e6-7832f6026a44 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:14:55.361844 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89560cc-02f2-420c-ab9d-6e22fa642d65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:14:55.362556 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89560cc-02f2-420c-ab9d-6e22fa642d65 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:55.362903 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89560cc-02f2-420c-ab9d-6e22fa642d65 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:55.363256 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89560cc-02f2-420c-ab9d-6e22fa642d65 None admin] PATH_INFO: `/v3/projects/80da76bc27b24b528f68fdc359d52a49` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:55.364462 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89560cc-02f2-420c-ab9d-6e22fa642d65 None admin] RBAC: Authorizing `identity:get_project(project_id=80da76bc27b24b528f68fdc359d52a49)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:14:55.365929 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89560cc-02f2-420c-ab9d-6e22fa642d65 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:14:55.367752 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 104/195] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Sep 13 15:14:55 2022] GET /identity/v3/projects/80da76bc27b24b528f68fdc359d52a49 => generated 312 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:14:55.368500 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89560cc-02f2-420c-ab9d-6e22fa642d65 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:14:55.382751 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 92/196] 10.222.0.27 () {60 vars in 1132 bytes} [Tue Sep 13 15:14:55 2022] POST /identity/v3/users => generated 297 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:14:55.382751 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8651994e-de9e-4f1a-b1e6-7832f6026a44 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:14:55.409513 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:14:55.491808 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89560cc-02f2-420c-ab9d-6e22fa642d65 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:14:55.506967 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8651994e-de9e-4f1a-b1e6-7832f6026a44 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:14:55.533322 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b7db81-525c-4597-840b-901d21b8cf0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:14:55.534085 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b7db81-525c-4597-840b-901d21b8cf0f None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:55.534370 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b7db81-525c-4597-840b-901d21b8cf0f None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:55.534648 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b7db81-525c-4597-840b-901d21b8cf0f None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:55.535396 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b7db81-525c-4597-840b-901d21b8cf0f None admin] RBAC: Adding query filter params (name=reader) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:14:55.535709 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b7db81-525c-4597-840b-901d21b8cf0f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:14:55.537392 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b7db81-525c-4597-840b-901d21b8cf0f None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:14:55.544600 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8ad928-230c-4641-8a54-29d52eac63a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:14:55.545249 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8ad928-230c-4641-8a54-29d52eac63a4 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:55.545530 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8ad928-230c-4641-8a54-29d52eac63a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:55.545830 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8ad928-230c-4641-8a54-29d52eac63a4 None admin] PATH_INFO: `/v3/projects/bcdaddc5cabe41a8982e616719a29740` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:55.546971 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8ad928-230c-4641-8a54-29d52eac63a4 None admin] RBAC: Authorizing `identity:get_project(project_id=bcdaddc5cabe41a8982e616719a29740)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:14:55.552363 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 105/197] 10.222.0.27 () {56 vars in 1101 bytes} [Tue Sep 13 15:14:55 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:14:55.552528 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8ad928-230c-4641-8a54-29d52eac63a4 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:14:55.552622 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b7db81-525c-4597-840b-901d21b8cf0f None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:14:55.552704 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 93/198] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Sep 13 15:14:55 2022] GET /identity/v3/projects/bcdaddc5cabe41a8982e616719a29740 => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:14:55.552704 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8ad928-230c-4641-8a54-29d52eac63a4 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:14:55.554385 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:14:55.655579 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:14:55.665620 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b7db81-525c-4597-840b-901d21b8cf0f None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:14:55.675089 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8ad928-230c-4641-8a54-29d52eac63a4 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:14:55.716358 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e13e3d-5563-4e88-97b3-9f6daa6d7d48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:14:55.716358 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e13e3d-5563-4e88-97b3-9f6daa6d7d48 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:55.716731 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e13e3d-5563-4e88-97b3-9f6daa6d7d48 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:55.717009 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e13e3d-5563-4e88-97b3-9f6daa6d7d48 None admin] PATH_INFO: `/v3/users/2d52ccc9cb61411ab11b4dc5348bc630` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:55.720201 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e13e3d-5563-4e88-97b3-9f6daa6d7d48 None admin] RBAC: Authorizing `identity:get_user(user_id=2d52ccc9cb61411ab11b4dc5348bc630)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:14:55.720201 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e13e3d-5563-4e88-97b3-9f6daa6d7d48 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:14:55.721355 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 106/199] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Sep 13 15:14:55 2022] GET /identity/v3/users/2d52ccc9cb61411ab11b4dc5348bc630 => generated 283 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:14:55.725725 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8449aae5-c78e-4787-be3c-b39a17d2ff18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:14:55.725913 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e13e3d-5563-4e88-97b3-9f6daa6d7d48 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:14:55.725996 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8449aae5-c78e-4787-be3c-b39a17d2ff18 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:55.725996 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8449aae5-c78e-4787-be3c-b39a17d2ff18 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:55.725996 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8449aae5-c78e-4787-be3c-b39a17d2ff18 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:55.725996 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8449aae5-c78e-4787-be3c-b39a17d2ff18 None admin] RBAC: Adding query filter params (role.id=3fae3d3a28e147d3b2bede2378ff79ae, scope.project.id=80da76bc27b24b528f68fdc359d52a49, user.id=5b2e21c1e08c42f18233d33bd9c6be68) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:14:55.725996 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8449aae5-c78e-4787-be3c-b39a17d2ff18 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:14:55.728452 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8449aae5-c78e-4787-be3c-b39a17d2ff18 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:14:55.734704 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 94/200] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Sep 13 15:14:55 2022] GET /identity/v3/role_assignments?user.id=5b2e21c1e08c42f18233d33bd9c6be68&scope.project.id=80da76bc27b24b528f68fdc359d52a49&role.id=3fae3d3a28e147d3b2bede2378ff79ae => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:14:55.735721 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8449aae5-c78e-4787-be3c-b39a17d2ff18 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:14:55.815975 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:14:55.862823 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8449aae5-c78e-4787-be3c-b39a17d2ff18 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:14:55.868389 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e13e3d-5563-4e88-97b3-9f6daa6d7d48 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:14:55.903897 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744226de-ce55-4656-8c22-4c46bcc9a5cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:14:55.904622 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744226de-ce55-4656-8c22-4c46bcc9a5cb None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:55.905046 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744226de-ce55-4656-8c22-4c46bcc9a5cb None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:55.905396 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744226de-ce55-4656-8c22-4c46bcc9a5cb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:55.906437 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744226de-ce55-4656-8c22-4c46bcc9a5cb None admin] RBAC: Adding query filter params (role.id=f34412ad29f1478cba775b033129f71f, scope.project.id=bcdaddc5cabe41a8982e616719a29740, user.id=2d52ccc9cb61411ab11b4dc5348bc630) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:14:55.906820 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744226de-ce55-4656-8c22-4c46bcc9a5cb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:14:55.908360 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744226de-ce55-4656-8c22-4c46bcc9a5cb None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:14:55.921820 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 95/201] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Sep 13 15:14:55 2022] GET /identity/v3/role_assignments?user.id=2d52ccc9cb61411ab11b4dc5348bc630&scope.project.id=bcdaddc5cabe41a8982e616719a29740&role.id=f34412ad29f1478cba775b033129f71f => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:14:55.922705 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744226de-ce55-4656-8c22-4c46bcc9a5cb None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:14:55.924326 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b45c4ec-4779-4e60-a1e5-4173a967004b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:14:55.924999 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b45c4ec-4779-4e60-a1e5-4173a967004b None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:55.925901 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b45c4ec-4779-4e60-a1e5-4173a967004b None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:55.926188 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b45c4ec-4779-4e60-a1e5-4173a967004b None admin] PATH_INFO: `/v3/users/51446a984d37449ea74465e626699634` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:55.929657 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b45c4ec-4779-4e60-a1e5-4173a967004b None admin] RBAC: Authorizing `identity:get_user(user_id=51446a984d37449ea74465e626699634)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:14:55.931259 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b45c4ec-4779-4e60-a1e5-4173a967004b None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:14:55.933784 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 107/202] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Sep 13 15:14:55 2022] GET /identity/v3/users/51446a984d37449ea74465e626699634 => generated 289 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:14:55.945747 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b45c4ec-4779-4e60-a1e5-4173a967004b None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:14:55.999395 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:14:56.080818 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744226de-ce55-4656-8c22-4c46bcc9a5cb None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:14:56.113769 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b45c4ec-4779-4e60-a1e5-4173a967004b None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:14:56.114626 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:14:56.121861 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fcefb3-e6fe-43d6-bf48-3bbdc5de9a04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:14:56.122623 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fcefb3-e6fe-43d6-bf48-3bbdc5de9a04 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:56.122977 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fcefb3-e6fe-43d6-bf48-3bbdc5de9a04 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:56.123365 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fcefb3-e6fe-43d6-bf48-3bbdc5de9a04 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:56.198943 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed29ef84-3e12-4198-9644-9030dd478162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:14:56.199986 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed29ef84-3e12-4198-9644-9030dd478162 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:56.200478 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed29ef84-3e12-4198-9644-9030dd478162 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:56.200942 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed29ef84-3e12-4198-9644-9030dd478162 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:56.212318 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fcefb3-e6fe-43d6-bf48-3bbdc5de9a04 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:14:56.213893 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fcefb3-e6fe-43d6-bf48-3bbdc5de9a04 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:14:56.287673 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed29ef84-3e12-4198-9644-9030dd478162 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:14:56.289526 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed29ef84-3e12-4198-9644-9030dd478162 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:14:56.332579 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:14:56.348883 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 96/203] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Sep 13 15:14:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 15:14:56.355131 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fcefb3-e6fe-43d6-bf48-3bbdc5de9a04 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:14:56.388280 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:14:56.427066 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 108/204] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Sep 13 15:14:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 15:14:56.434854 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed29ef84-3e12-4198-9644-9030dd478162 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:14:56.479469 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fcefb3-e6fe-43d6-bf48-3bbdc5de9a04 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:14:56.518607 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ec4b9a-a49c-487e-b069-01029c47ee37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:14:56.519503 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ec4b9a-a49c-487e-b069-01029c47ee37 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:56.519931 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ec4b9a-a49c-487e-b069-01029c47ee37 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:56.520375 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ec4b9a-a49c-487e-b069-01029c47ee37 None admin] PATH_INFO: `/v3/projects/bcdaddc5cabe41a8982e616719a29740` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:56.521684 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ec4b9a-a49c-487e-b069-01029c47ee37 None admin] RBAC: Authorizing `identity:get_project(project_id=bcdaddc5cabe41a8982e616719a29740)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:14:56.523608 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ec4b9a-a49c-487e-b069-01029c47ee37 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:14:56.525416 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 97/205] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Sep 13 15:14:56 2022] GET /identity/v3/projects/bcdaddc5cabe41a8982e616719a29740 => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:14:56.532104 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ec4b9a-a49c-487e-b069-01029c47ee37 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:14:56.644839 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ec4b9a-a49c-487e-b069-01029c47ee37 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:14:56.654013 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:14:56.685575 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3809f0e4-4098-4bad-b6ce-7eb8c33b9f5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:14:56.686426 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3809f0e4-4098-4bad-b6ce-7eb8c33b9f5d None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:56.686611 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3809f0e4-4098-4bad-b6ce-7eb8c33b9f5d None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:56.686874 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3809f0e4-4098-4bad-b6ce-7eb8c33b9f5d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:56.687621 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3809f0e4-4098-4bad-b6ce-7eb8c33b9f5d None admin] RBAC: Adding query filter params (role.id=5d9c0543f8e04065bb3d8bcd11156c1d, scope.project.id=bcdaddc5cabe41a8982e616719a29740, user.id=2d52ccc9cb61411ab11b4dc5348bc630) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:14:56.687936 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3809f0e4-4098-4bad-b6ce-7eb8c33b9f5d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:14:56.689500 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3809f0e4-4098-4bad-b6ce-7eb8c33b9f5d None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:14:56.696637 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 98/206] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Sep 13 15:14:56 2022] GET /identity/v3/role_assignments?user.id=2d52ccc9cb61411ab11b4dc5348bc630&scope.project.id=bcdaddc5cabe41a8982e616719a29740&role.id=5d9c0543f8e04065bb3d8bcd11156c1d => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:14:56.706390 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed29ef84-3e12-4198-9644-9030dd478162 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:14:56.739878 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:14:56.757263 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce13d47-8282-4178-86f0-923a1e98e1c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:14:56.757940 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce13d47-8282-4178-86f0-923a1e98e1c0 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:56.758225 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce13d47-8282-4178-86f0-923a1e98e1c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:56.758503 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce13d47-8282-4178-86f0-923a1e98e1c0 None admin] PATH_INFO: `/v3/projects/6cd2be8a8d2a48ce87a8453fb81f9427` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:56.762588 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce13d47-8282-4178-86f0-923a1e98e1c0 None admin] RBAC: Authorizing `identity:get_project(project_id=6cd2be8a8d2a48ce87a8453fb81f9427)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:14:56.764178 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce13d47-8282-4178-86f0-923a1e98e1c0 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:14:56.766381 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 109/207] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Sep 13 15:14:56 2022] GET /identity/v3/projects/6cd2be8a8d2a48ce87a8453fb81f9427 => generated 298 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:14:56.774863 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3809f0e4-4098-4bad-b6ce-7eb8c33b9f5d None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:14:56.888832 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3809f0e4-4098-4bad-b6ce-7eb8c33b9f5d None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:14:56.925037 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1539a229-f1c2-495c-aa38-86582dfa855b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:14:56.926022 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1539a229-f1c2-495c-aa38-86582dfa855b None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:56.926514 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1539a229-f1c2-495c-aa38-86582dfa855b None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:56.927010 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1539a229-f1c2-495c-aa38-86582dfa855b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:56.928345 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1539a229-f1c2-495c-aa38-86582dfa855b None admin] RBAC: Adding query filter params (role.id=b43a33bf0d63483a868ced4dfbcc4a6d, scope.project.id=6cd2be8a8d2a48ce87a8453fb81f9427, user.id=51446a984d37449ea74465e626699634) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:14:56.928864 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1539a229-f1c2-495c-aa38-86582dfa855b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:14:56.930543 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1539a229-f1c2-495c-aa38-86582dfa855b None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:14:56.936992 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 99/208] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Sep 13 15:14:56 2022] GET /identity/v3/role_assignments?user.id=51446a984d37449ea74465e626699634&scope.project.id=6cd2be8a8d2a48ce87a8453fb81f9427&role.id=b43a33bf0d63483a868ced4dfbcc4a6d => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:14:58.153368 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4735d484-fbee-4bc0-9d78-473fda437d6a None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:58.153903 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4735d484-fbee-4bc0-9d78-473fda437d6a None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:58.153979 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4735d484-fbee-4bc0-9d78-473fda437d6a None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:58.155533 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 110/209] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:14:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:14:58.157941 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4307c7e2-ee4b-469f-bcd9-1f3f28143cae None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:58.158743 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4307c7e2-ee4b-469f-bcd9-1f3f28143cae None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:58.159228 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4307c7e2-ee4b-469f-bcd9-1f3f28143cae None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:58.160770 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 100/210] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:14:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:14:58.162073 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95ce44d-d499-4a6b-96a0-04c7781114ce None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:58.162358 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95ce44d-d499-4a6b-96a0-04c7781114ce None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:58.162632 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95ce44d-d499-4a6b-96a0-04c7781114ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:58.168427 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86dd810-67cd-496a-b52f-9cd8a364c9ef None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:58.169009 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86dd810-67cd-496a-b52f-9cd8a364c9ef None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:58.169496 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86dd810-67cd-496a-b52f-9cd8a364c9ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:58.183183 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-d95ce44d-d499-4a6b-96a0-04c7781114ce None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:14:58.184397 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-d95ce44d-d499-4a6b-96a0-04c7781114ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:14:58.189027 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-b86dd810-67cd-496a-b52f-9cd8a364c9ef None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:14:58.190470 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-b86dd810-67cd-496a-b52f-9cd8a364c9ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:14:58.230106 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:14:58.255482 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 111/211] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:14:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 15:14:58.262921 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 101/212] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:14:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 15:14:58.523449 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95ce44d-d499-4a6b-96a0-04c7781114ce None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:14:58.536912 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86dd810-67cd-496a-b52f-9cd8a364c9ef None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:14:58.630010 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95ce44d-d499-4a6b-96a0-04c7781114ce None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:14:58.641936 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86dd810-67cd-496a-b52f-9cd8a364c9ef None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:14:58.658457 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:14:58.667825 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77aac354-3bc2-4ef9-82c4-88c1bed55323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:14:58.668462 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aac354-3bc2-4ef9-82c4-88c1bed55323 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:58.668743 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aac354-3bc2-4ef9-82c4-88c1bed55323 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:58.669017 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aac354-3bc2-4ef9-82c4-88c1bed55323 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:58.670150 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77aac354-3bc2-4ef9-82c4-88c1bed55323 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:14:58.671601 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77aac354-3bc2-4ef9-82c4-88c1bed55323 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:14:58.673168 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 112/213] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 13 15:14:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:14:58.678656 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ded2dd-8fa8-490e-971a-35d3cf68f3a4 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:58.678940 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ded2dd-8fa8-490e-971a-35d3cf68f3a4 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:58.679208 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ded2dd-8fa8-490e-971a-35d3cf68f3a4 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:58.679989 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e4fe25-0e28-45fa-aa47-8d54b7fbe2ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:14:58.680435 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 113/214] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:14:58 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:14:58.681025 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e4fe25-0e28-45fa-aa47-8d54b7fbe2ad None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:58.681130 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ded2dd-8fa8-490e-971a-35d3cf68f3a4 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:14:58.682309 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e4fe25-0e28-45fa-aa47-8d54b7fbe2ad None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:58.682753 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e4fe25-0e28-45fa-aa47-8d54b7fbe2ad None admin] PATH_INFO: `/v3/roles/member` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:58.695751 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e4fe25-0e28-45fa-aa47-8d54b7fbe2ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 15:14:58.703380 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-b6e4fe25-0e28-45fa-aa47-8d54b7fbe2ad None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 15:14:58.703380 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:14:58.703380 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:14:58.703380 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:14:58.703380 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:14:58.703380 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:14:58.703380 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:14:58.703380 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:14:58.703380 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:14:58.703380 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:14:58.703380 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:14:58.703380 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:14:58.703380 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 15:14:58.703380 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 15:14:58.703380 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 15:14:58.703380 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 15:14:58.704246 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 15:14:58.704246 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 15:14:58.704246 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 15:14:58.704246 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 15:14:58.704246 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:14:58.704246 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:14:58.704246 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:14:58.704246 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:14:58.704246 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:14:58.704246 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:14:58.704246 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:14:58.704246 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Sep 13 15:14:58.704246 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:14:58.704246 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:14:58.704246 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:14:58.704246 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:14:58.705035 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:14:58.705035 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:14:58.705035 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:14:58.705035 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:14:58.705035 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 15:14:58.705035 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 15:14:58.705035 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 15:14:58.705035 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 15:14:58.705035 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 15:14:58.705035 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 15:14:58.705035 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 15:14:58.705035 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Sep 13 15:14:58.709746 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 102/215] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Sep 13 15:14:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:14:58.709746 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2d4966-b674-4b1e-924a-1ca9e4b446b4 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:58.709746 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2d4966-b674-4b1e-924a-1ca9e4b446b4 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:58.709746 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2d4966-b674-4b1e-924a-1ca9e4b446b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:58.729637 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-2b2d4966-b674-4b1e-924a-1ca9e4b446b4 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:14:58.731051 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-2b2d4966-b674-4b1e-924a-1ca9e4b446b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:14:58.745880 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:14:58.802375 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ded2dd-8fa8-490e-971a-35d3cf68f3a4 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:14:58.804561 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 103/216] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:14:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 15:14:58.810591 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2d4966-b674-4b1e-924a-1ca9e4b446b4 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:14:58.841735 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df6ba27-c4c5-4481-9f6c-fca581e9e9f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:14:58.842256 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df6ba27-c4c5-4481-9f6c-fca581e9e9f2 None admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:58.842611 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df6ba27-c4c5-4481-9f6c-fca581e9e9f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:58.842959 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df6ba27-c4c5-4481-9f6c-fca581e9e9f2 None admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:58.843739 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df6ba27-c4c5-4481-9f6c-fca581e9e9f2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:14:58.845315 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df6ba27-c4c5-4481-9f6c-fca581e9e9f2 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:14:58.871223 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 114/217] 10.222.0.27 () {60 vars in 1132 bytes} [Tue Sep 13 15:14:58 2022] POST /identity/v3/users => generated 297 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:14:58.951034 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2d4966-b674-4b1e-924a-1ca9e4b446b4 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:14:58.990904 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976ae6ef-ab95-473f-bcc3-b5a263254f1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:14:58.991533 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976ae6ef-ab95-473f-bcc3-b5a263254f1d None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:58.991816 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976ae6ef-ab95-473f-bcc3-b5a263254f1d None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:58.992092 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976ae6ef-ab95-473f-bcc3-b5a263254f1d None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:58.992774 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976ae6ef-ab95-473f-bcc3-b5a263254f1d None admin] RBAC: Adding query filter params (name=member) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:14:58.993080 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976ae6ef-ab95-473f-bcc3-b5a263254f1d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:14:58.995380 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1044ac82-cbe5-4934-aba2-5a1dea467c22 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:58.995672 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1044ac82-cbe5-4934-aba2-5a1dea467c22 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:58.995946 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1044ac82-cbe5-4934-aba2-5a1dea467c22 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:58.997516 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 115/218] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:14:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 15:14:58.998675 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976ae6ef-ab95-473f-bcc3-b5a263254f1d None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:14:59.003552 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06d79ab-f0c8-413f-8086-10a62d215440 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:59.004142 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06d79ab-f0c8-413f-8086-10a62d215440 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:59.004707 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06d79ab-f0c8-413f-8086-10a62d215440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:59.009475 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 104/219] 10.222.0.27 () {56 vars in 1101 bytes} [Tue Sep 13 15:14:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:14:59.016047 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976ae6ef-ab95-473f-bcc3-b5a263254f1d None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:14:59.030119 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:14:59.030978 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-a06d79ab-f0c8-413f-8086-10a62d215440 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:14:59.032407 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-a06d79ab-f0c8-413f-8086-10a62d215440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:14:59.093559 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:14:59.117334 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 116/220] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:14:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 15:14:59.118778 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06d79ab-f0c8-413f-8086-10a62d215440 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:14:59.141771 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976ae6ef-ab95-473f-bcc3-b5a263254f1d None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:14:59.184655 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f905d4c2-db50-4958-aff5-b12dc7b6eba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:14:59.185406 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f905d4c2-db50-4958-aff5-b12dc7b6eba1 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:59.185597 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f905d4c2-db50-4958-aff5-b12dc7b6eba1 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:59.185888 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f905d4c2-db50-4958-aff5-b12dc7b6eba1 None admin] PATH_INFO: `/v3/users/0df1b9417d6f41b393a79c181ccc7f9b` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:59.201398 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f905d4c2-db50-4958-aff5-b12dc7b6eba1 None admin] RBAC: Authorizing `identity:get_user(user_id=0df1b9417d6f41b393a79c181ccc7f9b)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:14:59.203337 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f905d4c2-db50-4958-aff5-b12dc7b6eba1 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:14:59.205076 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 105/221] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Sep 13 15:14:59 2022] GET /identity/v3/users/0df1b9417d6f41b393a79c181ccc7f9b => generated 297 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 15:14:59.210932 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f905d4c2-db50-4958-aff5-b12dc7b6eba1 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:14:59.265760 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06d79ab-f0c8-413f-8086-10a62d215440 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:14:59.294414 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:14:59.312101 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adea30c7-db38-446c-82a4-c83c88c324d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:14:59.312741 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adea30c7-db38-446c-82a4-c83c88c324d6 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:59.313024 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adea30c7-db38-446c-82a4-c83c88c324d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:59.313300 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adea30c7-db38-446c-82a4-c83c88c324d6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:59.325217 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adea30c7-db38-446c-82a4-c83c88c324d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 15:14:59.331032 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-adea30c7-db38-446c-82a4-c83c88c324d6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 15:14:59.331032 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:14:59.331032 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:14:59.331032 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:14:59.331032 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:14:59.331032 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:14:59.331032 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:14:59.331032 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:14:59.331032 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:14:59.331032 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:14:59.331032 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:14:59.331032 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:14:59.331032 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 15:14:59.331032 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 15:14:59.331032 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 15:14:59.331032 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 15:14:59.331926 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 15:14:59.331926 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 15:14:59.331926 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 15:14:59.331926 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 15:14:59.331926 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:14:59.331926 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:14:59.331926 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:14:59.331926 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:14:59.331926 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:14:59.331926 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:14:59.331926 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:14:59.331926 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Sep 13 15:14:59.331926 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:14:59.331926 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:14:59.331926 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:14:59.331926 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:14:59.332697 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:14:59.332697 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:14:59.332697 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:14:59.332697 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:14:59.332697 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 15:14:59.332697 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 15:14:59.332697 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 15:14:59.332697 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 15:14:59.332697 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 15:14:59.332697 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 15:14:59.332697 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 15:14:59.332697 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Sep 13 15:14:59.332697 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 117/222] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Sep 13 15:14:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:14:59.337599 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f905d4c2-db50-4958-aff5-b12dc7b6eba1 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:14:59.339057 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adea30c7-db38-446c-82a4-c83c88c324d6 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:14:59.381788 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de87459-7365-4911-9cb8-8900870d1c8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:14:59.382333 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de87459-7365-4911-9cb8-8900870d1c8e None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:59.382661 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de87459-7365-4911-9cb8-8900870d1c8e None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:59.382932 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de87459-7365-4911-9cb8-8900870d1c8e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:59.386601 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:14:59.470055 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adea30c7-db38-446c-82a4-c83c88c324d6 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:14:59.477684 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de87459-7365-4911-9cb8-8900870d1c8e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:14:59.479507 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de87459-7365-4911-9cb8-8900870d1c8e None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:14:59.508426 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cc95bf-d187-4046-9ad5-8719d0a798bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:14:59.509314 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cc95bf-d187-4046-9ad5-8719d0a798bc None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:59.510326 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cc95bf-d187-4046-9ad5-8719d0a798bc None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:59.510836 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cc95bf-d187-4046-9ad5-8719d0a798bc None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:59.511722 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cc95bf-d187-4046-9ad5-8719d0a798bc None admin] RBAC: Adding query filter params (name=admin) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:14:59.512126 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cc95bf-d187-4046-9ad5-8719d0a798bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:14:59.513740 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cc95bf-d187-4046-9ad5-8719d0a798bc None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:14:59.527753 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 118/223] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Sep 13 15:14:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:14:59.528878 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cc95bf-d187-4046-9ad5-8719d0a798bc None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:14:59.561785 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:14:59.613139 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 106/224] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Sep 13 15:14:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 15:14:59.614098 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de87459-7365-4911-9cb8-8900870d1c8e None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:14:59.653334 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cc95bf-d187-4046-9ad5-8719d0a798bc None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:14:59.655156 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:14:59.693613 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a89c39a-da36-4d34-a7b1-1247003afda2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:14:59.694686 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a89c39a-da36-4d34-a7b1-1247003afda2 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:59.694972 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a89c39a-da36-4d34-a7b1-1247003afda2 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:59.695626 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a89c39a-da36-4d34-a7b1-1247003afda2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:59.715828 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a89c39a-da36-4d34-a7b1-1247003afda2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 15:14:59.724640 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-4a89c39a-da36-4d34-a7b1-1247003afda2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 15:14:59.724640 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:14:59.724640 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:14:59.724640 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:14:59.724640 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:14:59.724640 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:14:59.724640 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:14:59.724640 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:14:59.724640 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:14:59.724640 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:14:59.724640 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:14:59.724640 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:14:59.724640 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 15:14:59.724640 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 15:14:59.724640 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 15:14:59.724640 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 15:14:59.725729 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 15:14:59.725729 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 15:14:59.725729 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 15:14:59.725729 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 15:14:59.725729 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:14:59.725729 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:14:59.725729 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:14:59.725729 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:14:59.725729 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:14:59.725729 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:14:59.725729 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:14:59.725729 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Sep 13 15:14:59.725729 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:14:59.725729 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:14:59.725729 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:14:59.725729 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:14:59.726707 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:14:59.726707 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:14:59.726707 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:14:59.726707 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:14:59.726707 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 15:14:59.726707 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 15:14:59.726707 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 15:14:59.726707 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 15:14:59.726707 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 15:14:59.726707 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 15:14:59.726707 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 15:14:59.726707 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Sep 13 15:14:59.726707 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 119/225] 10.222.0.27 () {56 vars in 1114 bytes} [Tue Sep 13 15:14:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:14:59.726707 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a89c39a-da36-4d34-a7b1-1247003afda2 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:14:59.740923 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de87459-7365-4911-9cb8-8900870d1c8e None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:14:59.785257 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd86307-4b3d-4fe2-86e1-853ac1402324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:14:59.785950 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd86307-4b3d-4fe2-86e1-853ac1402324 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:59.786235 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd86307-4b3d-4fe2-86e1-853ac1402324 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:59.786568 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd86307-4b3d-4fe2-86e1-853ac1402324 None admin] PATH_INFO: `/v3/users/2d52ccc9cb61411ab11b4dc5348bc630` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:59.788519 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd86307-4b3d-4fe2-86e1-853ac1402324 None admin] RBAC: Authorizing `identity:get_user(user_id=2d52ccc9cb61411ab11b4dc5348bc630)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:14:59.790395 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd86307-4b3d-4fe2-86e1-853ac1402324 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:14:59.797341 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 107/226] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Sep 13 15:14:59 2022] GET /identity/v3/users/2d52ccc9cb61411ab11b4dc5348bc630 => generated 283 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:14:59.798930 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd86307-4b3d-4fe2-86e1-853ac1402324 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:14:59.845982 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a89c39a-da36-4d34-a7b1-1247003afda2 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:14:59.849322 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:14:59.882922 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d9e24f-8eb0-4b41-8465-9eace40b52e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:14:59.883607 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d9e24f-8eb0-4b41-8465-9eace40b52e1 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:59.883887 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d9e24f-8eb0-4b41-8465-9eace40b52e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:59.884168 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d9e24f-8eb0-4b41-8465-9eace40b52e1 None admin] PATH_INFO: `/v3/projects/bcdaddc5cabe41a8982e616719a29740` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:59.885988 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d9e24f-8eb0-4b41-8465-9eace40b52e1 None admin] RBAC: Authorizing `identity:get_project(project_id=bcdaddc5cabe41a8982e616719a29740)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:14:59.887566 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d9e24f-8eb0-4b41-8465-9eace40b52e1 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:14:59.889360 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 120/227] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Sep 13 15:14:59 2022] GET /identity/v3/projects/bcdaddc5cabe41a8982e616719a29740 => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:14:59.894249 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d9e24f-8eb0-4b41-8465-9eace40b52e1 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:14:59.928412 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:14:59.936017 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd86307-4b3d-4fe2-86e1-853ac1402324 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:14:59.977734 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec747be-4256-4741-a54d-e202ecfdeafd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:14:59.978370 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec747be-4256-4741-a54d-e202ecfdeafd None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:14:59.979182 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec747be-4256-4741-a54d-e202ecfdeafd None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:14:59.979778 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec747be-4256-4741-a54d-e202ecfdeafd None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:14:59.980634 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec747be-4256-4741-a54d-e202ecfdeafd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:14:59.980935 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec747be-4256-4741-a54d-e202ecfdeafd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:14:59.982437 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec747be-4256-4741-a54d-e202ecfdeafd None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:14:59.992208 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 108/228] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Sep 13 15:14:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:14:59.993114 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec747be-4256-4741-a54d-e202ecfdeafd None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:00.004782 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d9e24f-8eb0-4b41-8465-9eace40b52e1 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:00.043511 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae094e5-175a-46ea-9496-020f215cbe7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:00.044300 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae094e5-175a-46ea-9496-020f215cbe7c None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:00.044583 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae094e5-175a-46ea-9496-020f215cbe7c None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:00.044858 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae094e5-175a-46ea-9496-020f215cbe7c None admin] PATH_INFO: `/v3/projects/bcdaddc5cabe41a8982e616719a29740` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:00.046024 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae094e5-175a-46ea-9496-020f215cbe7c None admin] RBAC: Authorizing `identity:get_project(project_id=bcdaddc5cabe41a8982e616719a29740)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:00.047520 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae094e5-175a-46ea-9496-020f215cbe7c None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:00.049429 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 121/229] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Sep 13 15:14:59 2022] GET /identity/v3/projects/bcdaddc5cabe41a8982e616719a29740 => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:15:00.050461 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae094e5-175a-46ea-9496-020f215cbe7c None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:00.117128 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:00.123281 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec747be-4256-4741-a54d-e202ecfdeafd None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:00.151685 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:00.155904 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae094e5-175a-46ea-9496-020f215cbe7c None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:00.168331 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e187eaa-3f03-4043-bf55-e8144d10dd6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:00.169411 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e187eaa-3f03-4043-bf55-e8144d10dd6f None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:00.169997 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e187eaa-3f03-4043-bf55-e8144d10dd6f None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:00.170295 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e187eaa-3f03-4043-bf55-e8144d10dd6f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:00.171070 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e187eaa-3f03-4043-bf55-e8144d10dd6f None admin] RBAC: Adding query filter params (role.id=3fae3d3a28e147d3b2bede2378ff79ae, scope.project.id=bcdaddc5cabe41a8982e616719a29740, user.id=0df1b9417d6f41b393a79c181ccc7f9b) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:15:00.173089 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e187eaa-3f03-4043-bf55-e8144d10dd6f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:00.174639 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e187eaa-3f03-4043-bf55-e8144d10dd6f None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:00.182771 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 109/230] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Sep 13 15:14:59 2022] GET /identity/v3/role_assignments?user.id=0df1b9417d6f41b393a79c181ccc7f9b&scope.project.id=bcdaddc5cabe41a8982e616719a29740&role.id=3fae3d3a28e147d3b2bede2378ff79ae => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:15:00.183213 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e187eaa-3f03-4043-bf55-e8144d10dd6f None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:00.218044 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e750fa27-1086-4696-9d0e-a5b171b68f0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:00.220535 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e750fa27-1086-4696-9d0e-a5b171b68f0e None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:00.221275 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e750fa27-1086-4696-9d0e-a5b171b68f0e None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:00.223263 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e750fa27-1086-4696-9d0e-a5b171b68f0e None admin] PATH_INFO: `/v3/users/2d52ccc9cb61411ab11b4dc5348bc630` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:00.224866 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e750fa27-1086-4696-9d0e-a5b171b68f0e None admin] RBAC: Authorizing `identity:get_user(user_id=2d52ccc9cb61411ab11b4dc5348bc630)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:00.227724 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e750fa27-1086-4696-9d0e-a5b171b68f0e None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:00.231924 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 122/231] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Sep 13 15:15:00 2022] GET /identity/v3/users/2d52ccc9cb61411ab11b4dc5348bc630 => generated 283 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:15:00.239035 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e750fa27-1086-4696-9d0e-a5b171b68f0e None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:00.402737 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e187eaa-3f03-4043-bf55-e8144d10dd6f None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:00.420543 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e750fa27-1086-4696-9d0e-a5b171b68f0e None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:00.449846 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c4d3ec-67fc-43f4-85ff-812b723e8d4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:00.449846 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c4d3ec-67fc-43f4-85ff-812b723e8d4c None admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:00.450109 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c4d3ec-67fc-43f4-85ff-812b723e8d4c None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:00.450384 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c4d3ec-67fc-43f4-85ff-812b723e8d4c None admin] PATH_INFO: `/v3/projects/bcdaddc5cabe41a8982e616719a29740/users/2d52ccc9cb61411ab11b4dc5348bc630/roles/f34412ad29f1478cba775b033129f71f` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:00.453093 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c4d3ec-67fc-43f4-85ff-812b723e8d4c None admin] RBAC: Authorizing `identity:create_grant(project_id=bcdaddc5cabe41a8982e616719a29740, user_id=2d52ccc9cb61411ab11b4dc5348bc630, role_id=f34412ad29f1478cba775b033129f71f)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:00.454874 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c4d3ec-67fc-43f4-85ff-812b723e8d4c None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:00.469733 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f31dd8-6327-4620-8c12-1ca4ec3999f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:00.471212 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f31dd8-6327-4620-8c12-1ca4ec3999f7 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:00.472318 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f31dd8-6327-4620-8c12-1ca4ec3999f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:00.472607 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f31dd8-6327-4620-8c12-1ca4ec3999f7 None admin] PATH_INFO: `/v3/projects/bcdaddc5cabe41a8982e616719a29740` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:00.474458 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f31dd8-6327-4620-8c12-1ca4ec3999f7 None admin] RBAC: Authorizing `identity:get_project(project_id=bcdaddc5cabe41a8982e616719a29740)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:00.474925 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 110/232] 10.222.0.27 () {58 vars in 1439 bytes} [Tue Sep 13 15:15:00 2022] PUT /identity/v3/projects/bcdaddc5cabe41a8982e616719a29740/users/2d52ccc9cb61411ab11b4dc5348bc630/roles/f34412ad29f1478cba775b033129f71f => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:15:00.475942 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f31dd8-6327-4620-8c12-1ca4ec3999f7 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:00.477756 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 123/233] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Sep 13 15:15:00 2022] GET /identity/v3/projects/bcdaddc5cabe41a8982e616719a29740 => generated 302 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:15:00.487144 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c4d3ec-67fc-43f4-85ff-812b723e8d4c None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:00.530003 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:00.605245 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c4d3ec-67fc-43f4-85ff-812b723e8d4c None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:00.642919 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6494fcb1-eb0b-4b37-a465-b22a3bb358cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:00.643642 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6494fcb1-eb0b-4b37-a465-b22a3bb358cf None admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:00.643929 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6494fcb1-eb0b-4b37-a465-b22a3bb358cf None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:00.644206 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6494fcb1-eb0b-4b37-a465-b22a3bb358cf None admin] PATH_INFO: `/v3/projects/bcdaddc5cabe41a8982e616719a29740/users/2d52ccc9cb61411ab11b4dc5348bc630/roles/5d9c0543f8e04065bb3d8bcd11156c1d` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:00.646504 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6494fcb1-eb0b-4b37-a465-b22a3bb358cf None admin] RBAC: Authorizing `identity:create_grant(project_id=bcdaddc5cabe41a8982e616719a29740, user_id=2d52ccc9cb61411ab11b4dc5348bc630, role_id=5d9c0543f8e04065bb3d8bcd11156c1d)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:00.647967 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6494fcb1-eb0b-4b37-a465-b22a3bb358cf None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:00.675019 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 111/234] 10.222.0.27 () {58 vars in 1439 bytes} [Tue Sep 13 15:15:00 2022] PUT /identity/v3/projects/bcdaddc5cabe41a8982e616719a29740/users/2d52ccc9cb61411ab11b4dc5348bc630/roles/5d9c0543f8e04065bb3d8bcd11156c1d => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 15:15:01.460872 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d825c5-cf86-4af1-8f0b-6c507924a0ee None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:01.461389 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d825c5-cf86-4af1-8f0b-6c507924a0ee None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:01.461461 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d825c5-cf86-4af1-8f0b-6c507924a0ee None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:01.463130 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 124/235] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:15:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:15:01.468155 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d66e8d-4e69-4607-8818-74825548ecc1 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:01.468618 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d66e8d-4e69-4607-8818-74825548ecc1 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:01.468789 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d66e8d-4e69-4607-8818-74825548ecc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:01.495877 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-18d66e8d-4e69-4607-8818-74825548ecc1 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:15:01.497082 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-18d66e8d-4e69-4607-8818-74825548ecc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:15:01.590554 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 112/236] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:15:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 15:15:01.783886 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c930b32-15c9-4b74-917a-3fed0b74c19f None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:01.784207 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c930b32-15c9-4b74-917a-3fed0b74c19f None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:01.784449 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c930b32-15c9-4b74-917a-3fed0b74c19f None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:01.786123 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 125/237] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:15:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:15:01.791233 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30e0958-ff7b-4668-ad66-2714abc6701b None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:01.791511 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30e0958-ff7b-4668-ad66-2714abc6701b None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:01.791789 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30e0958-ff7b-4668-ad66-2714abc6701b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:01.816325 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-b30e0958-ff7b-4668-ad66-2714abc6701b None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:15:01.817528 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-b30e0958-ff7b-4668-ad66-2714abc6701b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:15:01.827492 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:01.911606 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 113/238] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:15:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 15:15:02.007437 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c930b32-15c9-4b74-917a-3fed0b74c19f None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:02.059522 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:02.151394 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c930b32-15c9-4b74-917a-3fed0b74c19f None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:02.198953 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf07622-f92d-4f61-851d-9f79649ddb6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:02.199593 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf07622-f92d-4f61-851d-9f79649ddb6a None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:02.199882 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf07622-f92d-4f61-851d-9f79649ddb6a None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:02.200162 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf07622-f92d-4f61-851d-9f79649ddb6a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:02.215105 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf07622-f92d-4f61-851d-9f79649ddb6a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 15:15:02.220604 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-baf07622-f92d-4f61-851d-9f79649ddb6a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 15:15:02.220604 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:15:02.220604 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:15:02.220604 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:15:02.220604 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:15:02.220604 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:15:02.220604 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:15:02.220604 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:15:02.220604 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:15:02.220604 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:15:02.220604 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:15:02.220604 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:15:02.220604 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 15:15:02.220604 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 15:15:02.220604 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 15:15:02.220604 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 15:15:02.221463 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 15:15:02.221463 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 15:15:02.221463 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 15:15:02.221463 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 15:15:02.221463 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:15:02.221463 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:15:02.221463 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:15:02.221463 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:15:02.221463 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:15:02.221463 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:15:02.221463 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:15:02.221463 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Sep 13 15:15:02.221463 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:15:02.221463 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:15:02.221463 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:15:02.221463 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:15:02.222269 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:15:02.222269 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:15:02.222269 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:15:02.222269 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:15:02.222269 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 15:15:02.222269 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 15:15:02.222269 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 15:15:02.222269 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 15:15:02.222269 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 15:15:02.222269 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 15:15:02.222269 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 15:15:02.222269 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Sep 13 15:15:02.222269 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 126/239] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Sep 13 15:15:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:15:02.227862 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30e0958-ff7b-4668-ad66-2714abc6701b None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:02.245155 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf07622-f92d-4f61-851d-9f79649ddb6a None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:02.374261 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30e0958-ff7b-4668-ad66-2714abc6701b None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:02.385214 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:02.396628 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf07622-f92d-4f61-851d-9f79649ddb6a None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:02.414452 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf1b441-e2a1-42c1-93a5-ef92b7732fc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:02.415080 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf1b441-e2a1-42c1-93a5-ef92b7732fc1 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:02.415363 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf1b441-e2a1-42c1-93a5-ef92b7732fc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:02.415638 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf1b441-e2a1-42c1-93a5-ef92b7732fc1 None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:02.416440 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf1b441-e2a1-42c1-93a5-ef92b7732fc1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:15:02.416747 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf1b441-e2a1-42c1-93a5-ef92b7732fc1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:02.418298 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf1b441-e2a1-42c1-93a5-ef92b7732fc1 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:02.429748 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 114/240] 10.222.0.27 () {56 vars in 1101 bytes} [Tue Sep 13 15:15:02 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:15:02.433068 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf1b441-e2a1-42c1-93a5-ef92b7732fc1 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:02.442105 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:02.468963 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3399d214-aad9-4726-a450-93b2efa1e1c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:02.471517 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3399d214-aad9-4726-a450-93b2efa1e1c7 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:02.471942 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3399d214-aad9-4726-a450-93b2efa1e1c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:02.472628 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3399d214-aad9-4726-a450-93b2efa1e1c7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:02.476371 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3399d214-aad9-4726-a450-93b2efa1e1c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:02.478032 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3399d214-aad9-4726-a450-93b2efa1e1c7 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:02.480760 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 127/241] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 13 15:15:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 15:15:02.487174 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3399d214-aad9-4726-a450-93b2efa1e1c7 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:02.581332 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf1b441-e2a1-42c1-93a5-ef92b7732fc1 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:02.617552 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e460d0a4-8c54-465a-9ba1-aa80d53d6770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:02.618567 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e460d0a4-8c54-465a-9ba1-aa80d53d6770 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:02.619583 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e460d0a4-8c54-465a-9ba1-aa80d53d6770 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:02.620054 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e460d0a4-8c54-465a-9ba1-aa80d53d6770 None admin] PATH_INFO: `/v3/users/a20c544aeb3b46138b8f2a2bbb135bfd` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:02.634197 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e460d0a4-8c54-465a-9ba1-aa80d53d6770 None admin] RBAC: Authorizing `identity:get_user(user_id=a20c544aeb3b46138b8f2a2bbb135bfd)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:02.636095 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e460d0a4-8c54-465a-9ba1-aa80d53d6770 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:02.638077 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 115/242] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Sep 13 15:15:02 2022] GET /identity/v3/users/a20c544aeb3b46138b8f2a2bbb135bfd => generated 297 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 15:15:02.644474 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e460d0a4-8c54-465a-9ba1-aa80d53d6770 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:02.696290 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3399d214-aad9-4726-a450-93b2efa1e1c7 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:02.758292 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:02.795783 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd669da-3e93-42f7-9984-d82b48f263aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:02.796406 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd669da-3e93-42f7-9984-d82b48f263aa None admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:02.796937 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd669da-3e93-42f7-9984-d82b48f263aa None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:02.796937 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd669da-3e93-42f7-9984-d82b48f263aa None admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:02.797630 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd669da-3e93-42f7-9984-d82b48f263aa None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:02.799125 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd669da-3e93-42f7-9984-d82b48f263aa None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:02.803271 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e460d0a4-8c54-465a-9ba1-aa80d53d6770 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:02.829726 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 128/243] 10.222.0.27 () {60 vars in 1132 bytes} [Tue Sep 13 15:15:02 2022] POST /identity/v3/users => generated 293 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:15:02.829726 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6243765-88d4-46d2-8b65-2b9912597294 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:02.829726 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6243765-88d4-46d2-8b65-2b9912597294 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:02.829726 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6243765-88d4-46d2-8b65-2b9912597294 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:02.829726 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 129/244] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:15:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:15:02.837028 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506508f3-e2da-4f7b-8fd0-bb14c45beea4 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:02.838660 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506508f3-e2da-4f7b-8fd0-bb14c45beea4 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:02.839180 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506508f3-e2da-4f7b-8fd0-bb14c45beea4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:02.869877 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d763616f-bf19-4350-a2e6-38f306a3ec5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:02.870520 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d763616f-bf19-4350-a2e6-38f306a3ec5d None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:02.870811 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d763616f-bf19-4350-a2e6-38f306a3ec5d None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:02.871090 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d763616f-bf19-4350-a2e6-38f306a3ec5d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:02.881196 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-506508f3-e2da-4f7b-8fd0-bb14c45beea4 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:15:02.882482 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-506508f3-e2da-4f7b-8fd0-bb14c45beea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:15:02.914083 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:02.975796 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 130/245] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:15:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 15:15:03.055839 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d763616f-bf19-4350-a2e6-38f306a3ec5d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:03.057837 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d763616f-bf19-4350-a2e6-38f306a3ec5d None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:03.123244 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:03.166682 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 116/246] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Sep 13 15:15:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 522 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 15:15:03.173571 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506508f3-e2da-4f7b-8fd0-bb14c45beea4 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:03.288760 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506508f3-e2da-4f7b-8fd0-bb14c45beea4 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:03.294842 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d763616f-bf19-4350-a2e6-38f306a3ec5d None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:03.340664 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b322cd-acbf-499e-baee-b2f30dbd1d70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:03.341417 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b322cd-acbf-499e-baee-b2f30dbd1d70 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:03.341850 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b322cd-acbf-499e-baee-b2f30dbd1d70 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:03.342204 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b322cd-acbf-499e-baee-b2f30dbd1d70 None admin] PATH_INFO: `/v3/projects/bcdaddc5cabe41a8982e616719a29740` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:03.345633 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b322cd-acbf-499e-baee-b2f30dbd1d70 None admin] RBAC: Authorizing `identity:get_project(project_id=bcdaddc5cabe41a8982e616719a29740)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:03.345633 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b322cd-acbf-499e-baee-b2f30dbd1d70 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:03.348380 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 131/247] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Sep 13 15:15:03 2022] GET /identity/v3/projects/bcdaddc5cabe41a8982e616719a29740 => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:15:03.354490 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b322cd-acbf-499e-baee-b2f30dbd1d70 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:03.378215 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:03.458232 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d763616f-bf19-4350-a2e6-38f306a3ec5d None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:03.495499 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b322cd-acbf-499e-baee-b2f30dbd1d70 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:03.498812 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2cfea4-ca6d-4e59-aaa4-1f1b191c3926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:03.499714 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2cfea4-ca6d-4e59-aaa4-1f1b191c3926 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:03.500216 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2cfea4-ca6d-4e59-aaa4-1f1b191c3926 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:03.500735 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2cfea4-ca6d-4e59-aaa4-1f1b191c3926 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:03.515068 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2cfea4-ca6d-4e59-aaa4-1f1b191c3926 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 15:15:03.520153 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-ab2cfea4-ca6d-4e59-aaa4-1f1b191c3926 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 15:15:03.520153 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:15:03.520153 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:15:03.520153 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:15:03.520153 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:15:03.520153 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:15:03.520153 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:15:03.520153 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:15:03.520153 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:15:03.520153 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:15:03.520153 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:15:03.520153 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:15:03.520153 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 15:15:03.520153 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 15:15:03.520153 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 15:15:03.520153 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 15:15:03.521066 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 15:15:03.521066 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 15:15:03.521066 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 15:15:03.521066 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 15:15:03.521066 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:15:03.521066 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:15:03.521066 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:15:03.521066 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:15:03.521066 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:15:03.521066 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:15:03.521066 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:15:03.521066 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Sep 13 15:15:03.521066 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:15:03.521066 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:15:03.521066 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:15:03.521066 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:15:03.521917 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:15:03.521917 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:15:03.521917 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:15:03.521917 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:15:03.521917 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 15:15:03.521917 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 15:15:03.521917 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 15:15:03.521917 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 15:15:03.521917 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 15:15:03.521917 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 15:15:03.521917 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 15:15:03.521917 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Sep 13 15:15:03.521917 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 117/248] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Sep 13 15:15:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:15:03.522894 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce77353a-5b94-4c96-a3ed-ca88c158c169 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:03.523354 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce77353a-5b94-4c96-a3ed-ca88c158c169 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:03.523354 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce77353a-5b94-4c96-a3ed-ca88c158c169 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:03.525885 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 118/249] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:15:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:15:03.526832 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee045fe-dd55-4d9e-9f81-635e5b8b427b None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:03.527113 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee045fe-dd55-4d9e-9f81-635e5b8b427b None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:03.527385 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee045fe-dd55-4d9e-9f81-635e5b8b427b None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:03.528578 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 119/250] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:15:03 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:15:03.535338 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ffcbc1-a886-4550-ae0d-9b8a94bb7586 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:03.535338 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ffcbc1-a886-4550-ae0d-9b8a94bb7586 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:03.535338 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ffcbc1-a886-4550-ae0d-9b8a94bb7586 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:03.539893 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e23fdf0-d64c-46e0-95ca-a4b79f9c13c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:03.540507 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e23fdf0-d64c-46e0-95ca-a4b79f9c13c9 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:03.540827 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e23fdf0-d64c-46e0-95ca-a4b79f9c13c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:03.541147 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e23fdf0-d64c-46e0-95ca-a4b79f9c13c9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:03.542140 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e23fdf0-d64c-46e0-95ca-a4b79f9c13c9 None admin] RBAC: Adding query filter params (role.id=b43a33bf0d63483a868ced4dfbcc4a6d, scope.project.id=bcdaddc5cabe41a8982e616719a29740, user.id=a20c544aeb3b46138b8f2a2bbb135bfd) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:15:03.542457 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e23fdf0-d64c-46e0-95ca-a4b79f9c13c9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:03.544789 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e23fdf0-d64c-46e0-95ca-a4b79f9c13c9 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:03.553828 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 132/251] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Sep 13 15:15:03 2022] GET /identity/v3/role_assignments?user.id=a20c544aeb3b46138b8f2a2bbb135bfd&scope.project.id=bcdaddc5cabe41a8982e616719a29740&role.id=b43a33bf0d63483a868ced4dfbcc4a6d => generated 259 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 15:15:03.554465 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e23fdf0-d64c-46e0-95ca-a4b79f9c13c9 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:03.555087 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-07ffcbc1-a886-4550-ae0d-9b8a94bb7586 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:15:03.556338 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-07ffcbc1-a886-4550-ae0d-9b8a94bb7586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:15:03.588723 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:03.692242 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 120/252] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:15:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 15:15:03.693331 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea8f9a8-16a5-4fce-8b81-4e94fb6dba8a None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:03.693623 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea8f9a8-16a5-4fce-8b81-4e94fb6dba8a None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:03.693933 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea8f9a8-16a5-4fce-8b81-4e94fb6dba8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:03.704486 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:03.738767 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-7ea8f9a8-16a5-4fce-8b81-4e94fb6dba8a None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:15:03.740047 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-7ea8f9a8-16a5-4fce-8b81-4e94fb6dba8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:15:03.753290 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e23fdf0-d64c-46e0-95ca-a4b79f9c13c9 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:03.820574 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b16891-b1b1-4667-a14f-8cea9bd3aec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:03.823174 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b16891-b1b1-4667-a14f-8cea9bd3aec6 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:03.823674 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b16891-b1b1-4667-a14f-8cea9bd3aec6 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:03.824122 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b16891-b1b1-4667-a14f-8cea9bd3aec6 None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:03.825323 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b16891-b1b1-4667-a14f-8cea9bd3aec6 None admin] RBAC: Adding query filter params (name=member) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:15:03.826020 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b16891-b1b1-4667-a14f-8cea9bd3aec6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:03.828379 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b16891-b1b1-4667-a14f-8cea9bd3aec6 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:03.846740 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 133/253] 10.222.0.27 () {56 vars in 1101 bytes} [Tue Sep 13 15:15:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:15:03.854467 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b16891-b1b1-4667-a14f-8cea9bd3aec6 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:03.895175 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 121/254] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:15:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 15:15:03.988438 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b16891-b1b1-4667-a14f-8cea9bd3aec6 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:03.995830 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea8f9a8-16a5-4fce-8b81-4e94fb6dba8a None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:04.045590 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e99bf8f-0be9-40da-8f3c-d3d656ca4a0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:04.046258 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e99bf8f-0be9-40da-8f3c-d3d656ca4a0b None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:04.046537 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e99bf8f-0be9-40da-8f3c-d3d656ca4a0b None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:04.046809 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e99bf8f-0be9-40da-8f3c-d3d656ca4a0b None admin] PATH_INFO: `/v3/users/0df1b9417d6f41b393a79c181ccc7f9b` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:04.048597 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e99bf8f-0be9-40da-8f3c-d3d656ca4a0b None admin] RBAC: Authorizing `identity:get_user(user_id=0df1b9417d6f41b393a79c181ccc7f9b)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:04.050082 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e99bf8f-0be9-40da-8f3c-d3d656ca4a0b None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:04.051737 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 134/255] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Sep 13 15:15:03 2022] GET /identity/v3/users/0df1b9417d6f41b393a79c181ccc7f9b => generated 297 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:15:04.058170 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e99bf8f-0be9-40da-8f3c-d3d656ca4a0b None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:04.071129 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:04.127170 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:04.156339 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea8f9a8-16a5-4fce-8b81-4e94fb6dba8a None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:04.184727 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e99bf8f-0be9-40da-8f3c-d3d656ca4a0b None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:04.204636 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8428544a-a434-4ba4-98c0-3478df13b054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:04.205323 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8428544a-a434-4ba4-98c0-3478df13b054 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:04.205605 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8428544a-a434-4ba4-98c0-3478df13b054 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:04.205917 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8428544a-a434-4ba4-98c0-3478df13b054 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:04.224808 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8428544a-a434-4ba4-98c0-3478df13b054 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 15:15:04.230551 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e90a3a9-6822-4ddc-ad42-5ac4811ac39e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:04.230696 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-8428544a-a434-4ba4-98c0-3478df13b054 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 15:15:04.230696 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:15:04.230696 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:15:04.230696 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:15:04.230696 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:15:04.230696 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:15:04.230696 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:15:04.230696 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:15:04.230696 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:15:04.230696 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:15:04.230696 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:15:04.230696 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:15:04.230696 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 15:15:04.230696 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 15:15:04.230696 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 15:15:04.230696 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 15:15:04.231570 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 15:15:04.231570 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 15:15:04.231570 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 15:15:04.231570 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 15:15:04.231570 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:15:04.231570 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:15:04.231570 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:15:04.231570 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:15:04.231570 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:15:04.231570 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:15:04.231570 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:15:04.231570 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Sep 13 15:15:04.231570 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:15:04.231570 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:15:04.231570 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:15:04.231570 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:15:04.232861 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:15:04.232861 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:15:04.232861 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:15:04.232861 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:15:04.232861 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 15:15:04.232861 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 15:15:04.232861 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 15:15:04.232861 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 15:15:04.232861 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 15:15:04.232861 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 15:15:04.232861 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 15:15:04.232861 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Sep 13 15:15:04.233694 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e90a3a9-6822-4ddc-ad42-5ac4811ac39e None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:04.233694 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e90a3a9-6822-4ddc-ad42-5ac4811ac39e None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:04.233694 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e90a3a9-6822-4ddc-ad42-5ac4811ac39e None admin] PATH_INFO: `/v3/projects/bcdaddc5cabe41a8982e616719a29740` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:04.233914 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 122/256] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Sep 13 15:15:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 15:15:04.237439 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e90a3a9-6822-4ddc-ad42-5ac4811ac39e None admin] RBAC: Authorizing `identity:get_project(project_id=bcdaddc5cabe41a8982e616719a29740)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:04.237843 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8428544a-a434-4ba4-98c0-3478df13b054 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:04.238980 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e90a3a9-6822-4ddc-ad42-5ac4811ac39e None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:04.240818 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 135/257] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Sep 13 15:15:04 2022] GET /identity/v3/projects/bcdaddc5cabe41a8982e616719a29740 => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:15:04.246887 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e90a3a9-6822-4ddc-ad42-5ac4811ac39e None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:04.365890 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:04.408075 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e90a3a9-6822-4ddc-ad42-5ac4811ac39e None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:04.421927 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8428544a-a434-4ba4-98c0-3478df13b054 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:04.475815 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8eb9b1-29d6-41e0-bc2c-a080c7dca4a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:04.476484 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8eb9b1-29d6-41e0-bc2c-a080c7dca4a1 None admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:04.476765 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8eb9b1-29d6-41e0-bc2c-a080c7dca4a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:04.477040 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8eb9b1-29d6-41e0-bc2c-a080c7dca4a1 None admin] PATH_INFO: `/v3/projects/bcdaddc5cabe41a8982e616719a29740/users/0df1b9417d6f41b393a79c181ccc7f9b/roles/3fae3d3a28e147d3b2bede2378ff79ae` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:04.482217 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8eb9b1-29d6-41e0-bc2c-a080c7dca4a1 None admin] RBAC: Authorizing `identity:create_grant(project_id=bcdaddc5cabe41a8982e616719a29740, user_id=0df1b9417d6f41b393a79c181ccc7f9b, role_id=3fae3d3a28e147d3b2bede2378ff79ae)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:04.483674 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8eb9b1-29d6-41e0-bc2c-a080c7dca4a1 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:04.488978 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1211a2b5-49e0-4273-a237-2168932779e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:04.489657 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1211a2b5-49e0-4273-a237-2168932779e0 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:04.489896 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1211a2b5-49e0-4273-a237-2168932779e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:04.490178 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1211a2b5-49e0-4273-a237-2168932779e0 None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:04.490852 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1211a2b5-49e0-4273-a237-2168932779e0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:15:04.491156 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1211a2b5-49e0-4273-a237-2168932779e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:04.492520 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1211a2b5-49e0-4273-a237-2168932779e0 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:04.502880 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 123/258] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Sep 13 15:15:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:15:04.503776 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1211a2b5-49e0-4273-a237-2168932779e0 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:04.513695 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 136/259] 10.222.0.27 () {58 vars in 1439 bytes} [Tue Sep 13 15:15:04 2022] PUT /identity/v3/projects/bcdaddc5cabe41a8982e616719a29740/users/0df1b9417d6f41b393a79c181ccc7f9b/roles/3fae3d3a28e147d3b2bede2378ff79ae => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:15:04.514446 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8eb9b1-29d6-41e0-bc2c-a080c7dca4a1 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:04.517748 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:04.717250 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8eb9b1-29d6-41e0-bc2c-a080c7dca4a1 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:04.723419 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1211a2b5-49e0-4273-a237-2168932779e0 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:04.785580 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31026f65-cb71-4104-8ac7-1dca25a920d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:04.786169 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31026f65-cb71-4104-8ac7-1dca25a920d8 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:04.786451 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31026f65-cb71-4104-8ac7-1dca25a920d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:04.786722 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31026f65-cb71-4104-8ac7-1dca25a920d8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:04.787770 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d5c1b3-c58c-47a5-8c3d-a3fc8a09d430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:04.788394 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d5c1b3-c58c-47a5-8c3d-a3fc8a09d430 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:04.788666 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d5c1b3-c58c-47a5-8c3d-a3fc8a09d430 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:04.788936 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d5c1b3-c58c-47a5-8c3d-a3fc8a09d430 None admin] PATH_INFO: `/v3/users/2d52ccc9cb61411ab11b4dc5348bc630` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:04.790201 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d5c1b3-c58c-47a5-8c3d-a3fc8a09d430 None admin] RBAC: Authorizing `identity:get_user(user_id=2d52ccc9cb61411ab11b4dc5348bc630)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:04.791750 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d5c1b3-c58c-47a5-8c3d-a3fc8a09d430 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:04.798351 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 137/260] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Sep 13 15:15:04 2022] GET /identity/v3/users/2d52ccc9cb61411ab11b4dc5348bc630 => generated 283 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:15:04.801293 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d5c1b3-c58c-47a5-8c3d-a3fc8a09d430 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:04.814105 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31026f65-cb71-4104-8ac7-1dca25a920d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 15:15:04.819595 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-31026f65-cb71-4104-8ac7-1dca25a920d8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 15:15:04.819595 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:15:04.819595 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:15:04.819595 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:15:04.819595 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:15:04.819595 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:15:04.819595 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:15:04.819595 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:15:04.819595 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:15:04.819595 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:15:04.819595 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:15:04.819595 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:15:04.819595 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 15:15:04.819595 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 15:15:04.819595 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 15:15:04.819595 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 15:15:04.820468 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 15:15:04.820468 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 15:15:04.820468 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 15:15:04.820468 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 15:15:04.820468 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:15:04.820468 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:15:04.820468 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:15:04.820468 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:15:04.820468 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:15:04.820468 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:15:04.820468 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:15:04.820468 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Sep 13 15:15:04.820468 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:15:04.820468 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:15:04.820468 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:15:04.820468 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:15:04.821254 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:15:04.821254 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:15:04.821254 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:15:04.821254 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:15:04.821254 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 15:15:04.821254 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 15:15:04.821254 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 15:15:04.821254 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 15:15:04.821254 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 15:15:04.821254 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 15:15:04.821254 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 15:15:04.821254 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Sep 13 15:15:04.822530 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 124/261] 10.222.0.27 () {56 vars in 1114 bytes} [Tue Sep 13 15:15:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:15:04.828408 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:04.831597 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31026f65-cb71-4104-8ac7-1dca25a920d8 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:04.918341 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:04.956659 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31026f65-cb71-4104-8ac7-1dca25a920d8 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:05.000910 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fdb5e4-94de-404c-b3fc-c67494f7f1ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:05.001544 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fdb5e4-94de-404c-b3fc-c67494f7f1ea None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:05.001855 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fdb5e4-94de-404c-b3fc-c67494f7f1ea None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:05.002136 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fdb5e4-94de-404c-b3fc-c67494f7f1ea None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:05.002818 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fdb5e4-94de-404c-b3fc-c67494f7f1ea None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:15:05.003128 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fdb5e4-94de-404c-b3fc-c67494f7f1ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:05.004525 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fdb5e4-94de-404c-b3fc-c67494f7f1ea None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:05.015377 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 125/262] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Sep 13 15:15:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:15:05.025404 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fdb5e4-94de-404c-b3fc-c67494f7f1ea None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:05.031911 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d5c1b3-c58c-47a5-8c3d-a3fc8a09d430 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:05.105119 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c7a9f1-e02b-479d-90be-23c7f956e660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:05.105934 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c7a9f1-e02b-479d-90be-23c7f956e660 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:05.106219 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c7a9f1-e02b-479d-90be-23c7f956e660 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:05.106494 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c7a9f1-e02b-479d-90be-23c7f956e660 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:05.192306 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fdb5e4-94de-404c-b3fc-c67494f7f1ea None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:05.234067 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:05.249976 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0294fa40-601d-4466-8057-06e87f1ab146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:05.250667 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0294fa40-601d-4466-8057-06e87f1ab146 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:05.251027 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0294fa40-601d-4466-8057-06e87f1ab146 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:05.251300 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0294fa40-601d-4466-8057-06e87f1ab146 None admin] PATH_INFO: `/v3/users/2d52ccc9cb61411ab11b4dc5348bc630` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:05.252458 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0294fa40-601d-4466-8057-06e87f1ab146 None admin] RBAC: Authorizing `identity:get_user(user_id=2d52ccc9cb61411ab11b4dc5348bc630)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:05.253952 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0294fa40-601d-4466-8057-06e87f1ab146 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:05.255755 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c7a9f1-e02b-479d-90be-23c7f956e660 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:05.257224 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c7a9f1-e02b-479d-90be-23c7f956e660 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:05.259000 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 126/263] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Sep 13 15:15:05 2022] GET /identity/v3/users/2d52ccc9cb61411ab11b4dc5348bc630 => generated 283 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 15:15:05.264867 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0294fa40-601d-4466-8057-06e87f1ab146 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:05.274524 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:05.427583 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0294fa40-601d-4466-8057-06e87f1ab146 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:05.488358 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e5a545-50a1-4872-80cb-dcbfd26ebbae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:05.489353 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e5a545-50a1-4872-80cb-dcbfd26ebbae None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:05.489852 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e5a545-50a1-4872-80cb-dcbfd26ebbae None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:05.490509 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e5a545-50a1-4872-80cb-dcbfd26ebbae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:05.521305 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 138/264] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Sep 13 15:15:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 720 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 15:15:05.527305 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c7a9f1-e02b-479d-90be-23c7f956e660 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:05.624532 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:05.645565 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e5a545-50a1-4872-80cb-dcbfd26ebbae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:05.648029 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e5a545-50a1-4872-80cb-dcbfd26ebbae None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:05.734394 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c7a9f1-e02b-479d-90be-23c7f956e660 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:05.746535 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:05.804633 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c8fca6-8a82-42cb-82d6-f6a62775dd64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:05.805285 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c8fca6-8a82-42cb-82d6-f6a62775dd64 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:05.805569 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c8fca6-8a82-42cb-82d6-f6a62775dd64 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:05.805968 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c8fca6-8a82-42cb-82d6-f6a62775dd64 None admin] PATH_INFO: `/v3/projects/bcdaddc5cabe41a8982e616719a29740` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:05.807442 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c8fca6-8a82-42cb-82d6-f6a62775dd64 None admin] RBAC: Authorizing `identity:get_project(project_id=bcdaddc5cabe41a8982e616719a29740)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:05.808919 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c8fca6-8a82-42cb-82d6-f6a62775dd64 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:05.811233 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 139/265] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Sep 13 15:15:05 2022] GET /identity/v3/projects/bcdaddc5cabe41a8982e616719a29740 => generated 302 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:15:05.816606 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c8fca6-8a82-42cb-82d6-f6a62775dd64 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:05.827367 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 127/266] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Sep 13 15:15:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 563 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 13 15:15:05.835384 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e5a545-50a1-4872-80cb-dcbfd26ebbae None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:05.975050 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:05.981094 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c8fca6-8a82-42cb-82d6-f6a62775dd64 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:05.983372 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e5a545-50a1-4872-80cb-dcbfd26ebbae None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:06.019427 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbe6463-ec80-40b1-b93d-f9c1d06ab1b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:06.019960 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbe6463-ec80-40b1-b93d-f9c1d06ab1b9 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:06.020244 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbe6463-ec80-40b1-b93d-f9c1d06ab1b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:06.020519 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbe6463-ec80-40b1-b93d-f9c1d06ab1b9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:06.021314 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbe6463-ec80-40b1-b93d-f9c1d06ab1b9 None admin] RBAC: Adding query filter params (role.id=f34412ad29f1478cba775b033129f71f, scope.project.id=bcdaddc5cabe41a8982e616719a29740, user.id=2d52ccc9cb61411ab11b4dc5348bc630) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:15:06.021630 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbe6463-ec80-40b1-b93d-f9c1d06ab1b9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:06.022384 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1080033-7585-4016-ae60-3c5cffede91f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:06.023026 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1080033-7585-4016-ae60-3c5cffede91f None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:06.023219 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbe6463-ec80-40b1-b93d-f9c1d06ab1b9 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:06.023371 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1080033-7585-4016-ae60-3c5cffede91f None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:06.023562 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1080033-7585-4016-ae60-3c5cffede91f None admin] PATH_INFO: `/v3/projects/bcdaddc5cabe41a8982e616719a29740` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:06.029625 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 140/267] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Sep 13 15:15:05 2022] GET /identity/v3/role_assignments?user.id=2d52ccc9cb61411ab11b4dc5348bc630&scope.project.id=bcdaddc5cabe41a8982e616719a29740&role.id=f34412ad29f1478cba775b033129f71f => generated 608 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:15:06.030460 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1080033-7585-4016-ae60-3c5cffede91f None admin] RBAC: Authorizing `identity:get_project(project_id=bcdaddc5cabe41a8982e616719a29740)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:06.031953 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1080033-7585-4016-ae60-3c5cffede91f None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:06.033839 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 128/268] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Sep 13 15:15:05 2022] GET /identity/v3/projects/bcdaddc5cabe41a8982e616719a29740 => generated 302 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:15:06.043097 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbe6463-ec80-40b1-b93d-f9c1d06ab1b9 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:06.107387 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:06.178162 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbe6463-ec80-40b1-b93d-f9c1d06ab1b9 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:06.224656 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e885bb1-0a93-4962-a55b-055033130ea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:06.225586 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e885bb1-0a93-4962-a55b-055033130ea2 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:06.226070 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e885bb1-0a93-4962-a55b-055033130ea2 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:06.226528 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e885bb1-0a93-4962-a55b-055033130ea2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:06.227486 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e885bb1-0a93-4962-a55b-055033130ea2 None admin] RBAC: Adding query filter params (role.id=5d9c0543f8e04065bb3d8bcd11156c1d, scope.project.id=bcdaddc5cabe41a8982e616719a29740, user.id=2d52ccc9cb61411ab11b4dc5348bc630) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:15:06.228055 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e885bb1-0a93-4962-a55b-055033130ea2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:06.229986 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e885bb1-0a93-4962-a55b-055033130ea2 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:06.236946 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 141/269] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Sep 13 15:15:06 2022] GET /identity/v3/role_assignments?user.id=2d52ccc9cb61411ab11b4dc5348bc630&scope.project.id=bcdaddc5cabe41a8982e616719a29740&role.id=5d9c0543f8e04065bb3d8bcd11156c1d => generated 608 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:15:06.305594 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1e17d4-37da-44da-b6ee-d3d4d8f41225 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:06.305858 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1e17d4-37da-44da-b6ee-d3d4d8f41225 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:06.306650 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1e17d4-37da-44da-b6ee-d3d4d8f41225 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:06.308384 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 129/270] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:15:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:15:06.314131 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab5e5bf-d461-4d50-9f83-a5c710d551f2 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:06.314415 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab5e5bf-d461-4d50-9f83-a5c710d551f2 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:06.314689 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab5e5bf-d461-4d50-9f83-a5c710d551f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:06.335426 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-bab5e5bf-d461-4d50-9f83-a5c710d551f2 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:15:06.336697 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-bab5e5bf-d461-4d50-9f83-a5c710d551f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:15:06.431038 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 142/271] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:15:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 15:15:06.537736 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b230bb78-194e-455a-ab02-ec0c547eb269 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:06.538018 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b230bb78-194e-455a-ab02-ec0c547eb269 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:06.538541 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b230bb78-194e-455a-ab02-ec0c547eb269 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:06.540367 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 130/272] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:15:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:15:06.546632 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d65a45d-5e02-4474-a2d4-0d7965a102c0 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:06.547084 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d65a45d-5e02-4474-a2d4-0d7965a102c0 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:06.547263 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d65a45d-5e02-4474-a2d4-0d7965a102c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:06.571232 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-3d65a45d-5e02-4474-a2d4-0d7965a102c0 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:15:06.572637 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-3d65a45d-5e02-4474-a2d4-0d7965a102c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:15:06.604605 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:06.652541 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 143/273] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:15:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 15:15:06.783203 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b230bb78-194e-455a-ab02-ec0c547eb269 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:06.892786 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b230bb78-194e-455a-ab02-ec0c547eb269 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:06.933105 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff57ae6-3422-4e9a-b484-fb8a5ff15ae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:06.934178 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff57ae6-3422-4e9a-b484-fb8a5ff15ae8 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:06.934653 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff57ae6-3422-4e9a-b484-fb8a5ff15ae8 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:06.935160 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff57ae6-3422-4e9a-b484-fb8a5ff15ae8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:06.947961 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff57ae6-3422-4e9a-b484-fb8a5ff15ae8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 15:15:06.953318 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-9ff57ae6-3422-4e9a-b484-fb8a5ff15ae8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 15:15:06.953318 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:15:06.953318 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:15:06.953318 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:15:06.953318 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:15:06.953318 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:15:06.953318 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:15:06.953318 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:15:06.953318 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:15:06.953318 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:15:06.953318 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:15:06.953318 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:15:06.953318 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 15:15:06.953318 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 15:15:06.953318 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 15:15:06.953318 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 15:15:06.954203 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 15:15:06.954203 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 15:15:06.954203 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 15:15:06.954203 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 15:15:06.954203 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:15:06.954203 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:15:06.954203 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:15:06.954203 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:15:06.954203 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:15:06.954203 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:15:06.954203 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:15:06.954203 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Sep 13 15:15:06.954203 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:15:06.954203 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:15:06.954203 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:15:06.954203 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:15:06.954983 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:15:06.954983 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:15:06.954983 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:15:06.954983 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:15:06.954983 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 15:15:06.954983 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 15:15:06.954983 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 15:15:06.954983 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 15:15:06.954983 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 15:15:06.954983 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 15:15:06.954983 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 15:15:06.954983 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Sep 13 15:15:06.957661 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 131/274] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Sep 13 15:15:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:15:06.964327 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d65a45d-5e02-4474-a2d4-0d7965a102c0 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:06.970368 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff57ae6-3422-4e9a-b484-fb8a5ff15ae8 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:07.000023 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:07.085804 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d65a45d-5e02-4474-a2d4-0d7965a102c0 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:07.087608 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff57ae6-3422-4e9a-b484-fb8a5ff15ae8 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:07.120336 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed830940-4f73-4365-9294-d767cab6e6c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:07.120942 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed830940-4f73-4365-9294-d767cab6e6c2 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:07.121219 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed830940-4f73-4365-9294-d767cab6e6c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:07.121493 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed830940-4f73-4365-9294-d767cab6e6c2 None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:07.122184 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed830940-4f73-4365-9294-d767cab6e6c2 None admin] RBAC: Adding query filter params (name=member) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:15:07.122486 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed830940-4f73-4365-9294-d767cab6e6c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:07.123905 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed830940-4f73-4365-9294-d767cab6e6c2 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:07.125109 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e258247d-6acb-4d7b-902b-fed6b5ff3f30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:07.125836 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e258247d-6acb-4d7b-902b-fed6b5ff3f30 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:07.126240 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e258247d-6acb-4d7b-902b-fed6b5ff3f30 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:07.126546 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e258247d-6acb-4d7b-902b-fed6b5ff3f30 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:07.127653 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e258247d-6acb-4d7b-902b-fed6b5ff3f30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:07.129205 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e258247d-6acb-4d7b-902b-fed6b5ff3f30 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:07.130968 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 132/275] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 13 15:15:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 15:15:07.131920 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764f5b06-cf14-4712-a927-0ba2185993da None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:07.132201 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764f5b06-cf14-4712-a927-0ba2185993da None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:07.132472 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764f5b06-cf14-4712-a927-0ba2185993da None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:07.137816 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 133/276] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:15:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:15:07.137816 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764f5b06-cf14-4712-a927-0ba2185993da None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:07.138014 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 144/277] 10.222.0.27 () {56 vars in 1101 bytes} [Tue Sep 13 15:15:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:15:07.143416 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beb9b8f-1e4c-45b7-b113-c34ed3bb8c67 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:07.143636 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beb9b8f-1e4c-45b7-b113-c34ed3bb8c67 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:07.143912 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beb9b8f-1e4c-45b7-b113-c34ed3bb8c67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:07.161515 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-6beb9b8f-1e4c-45b7-b113-c34ed3bb8c67 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:15:07.162724 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-6beb9b8f-1e4c-45b7-b113-c34ed3bb8c67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:15:07.179727 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:07.229915 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 145/278] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:15:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 15:15:07.230750 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6beb9b8f-1e4c-45b7-b113-c34ed3bb8c67 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:07.250895 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:07.261172 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764f5b06-cf14-4712-a927-0ba2185993da None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:07.298120 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0cfc49-54f7-4054-aa13-106cfe228a7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:07.299013 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0cfc49-54f7-4054-aa13-106cfe228a7d None admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:07.299469 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0cfc49-54f7-4054-aa13-106cfe228a7d None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:07.299941 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0cfc49-54f7-4054-aa13-106cfe228a7d None admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:07.300763 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0cfc49-54f7-4054-aa13-106cfe228a7d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:07.302416 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0cfc49-54f7-4054-aa13-106cfe228a7d None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:07.328829 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 134/279] 10.222.0.27 () {60 vars in 1132 bytes} [Tue Sep 13 15:15:07 2022] POST /identity/v3/users => generated 293 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:15:07.365293 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6beb9b8f-1e4c-45b7-b113-c34ed3bb8c67 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:07.407890 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f072997a-f4af-445a-80f9-37f92ef49214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:07.409224 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f072997a-f4af-445a-80f9-37f92ef49214 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:07.409804 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f072997a-f4af-445a-80f9-37f92ef49214 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:07.410293 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f072997a-f4af-445a-80f9-37f92ef49214 None admin] PATH_INFO: `/v3/users/8c32a069bb404396b31571d9bdb65d8e` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:07.428656 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f072997a-f4af-445a-80f9-37f92ef49214 None admin] RBAC: Authorizing `identity:get_user(user_id=8c32a069bb404396b31571d9bdb65d8e)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:07.430653 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f072997a-f4af-445a-80f9-37f92ef49214 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:07.433468 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 146/280] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Sep 13 15:15:07 2022] GET /identity/v3/users/8c32a069bb404396b31571d9bdb65d8e => generated 293 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:15:07.439264 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0cfc49-54f7-4054-aa13-106cfe228a7d None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:07.530095 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4447b394-3591-4960-97a0-4d66b695582d None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:07.530708 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4447b394-3591-4960-97a0-4d66b695582d None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:07.531204 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4447b394-3591-4960-97a0-4d66b695582d None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:07.532748 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 147/281] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:15:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 15:15:07.537774 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4447b394-3591-4960-97a0-4d66b695582d None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:07.554419 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:07.562822 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0cfc49-54f7-4054-aa13-106cfe228a7d None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:07.605060 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea3cdfd-bfff-4093-9790-670d97aa537f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:07.605671 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea3cdfd-bfff-4093-9790-670d97aa537f None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:07.606145 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea3cdfd-bfff-4093-9790-670d97aa537f None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:07.606415 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea3cdfd-bfff-4093-9790-670d97aa537f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:07.607147 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea3cdfd-bfff-4093-9790-670d97aa537f None admin] RBAC: Adding query filter params (role.id=3fae3d3a28e147d3b2bede2378ff79ae, user.id=8c32a069bb404396b31571d9bdb65d8e, scope.system=all) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:15:07.607982 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea3cdfd-bfff-4093-9790-670d97aa537f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:07.608900 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea3cdfd-bfff-4093-9790-670d97aa537f None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:07.617147 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 135/282] 10.222.0.27 () {56 vars in 1308 bytes} [Tue Sep 13 15:15:07 2022] GET /identity/v3/role_assignments?user.id=8c32a069bb404396b31571d9bdb65d8e&scope.system=all&role.id=3fae3d3a28e147d3b2bede2378ff79ae => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 15:15:07.619703 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e8b94e-142a-4de1-9d8c-66450ce6a618 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:07.619703 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e8b94e-142a-4de1-9d8c-66450ce6a618 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:07.619703 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e8b94e-142a-4de1-9d8c-66450ce6a618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:07.640171 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-16e8b94e-142a-4de1-9d8c-66450ce6a618 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:15:07.642182 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-16e8b94e-142a-4de1-9d8c-66450ce6a618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:15:07.647012 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:07.664556 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4447b394-3591-4960-97a0-4d66b695582d None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:07.712131 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6898ea52-3198-4390-9fa8-94d38641f6eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:07.714388 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6898ea52-3198-4390-9fa8-94d38641f6eb None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:07.714855 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6898ea52-3198-4390-9fa8-94d38641f6eb None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:07.715444 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6898ea52-3198-4390-9fa8-94d38641f6eb None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:07.734002 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6898ea52-3198-4390-9fa8-94d38641f6eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 15:15:07.741794 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 136/283] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:15:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 15:15:07.741982 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-6898ea52-3198-4390-9fa8-94d38641f6eb None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 15:15:07.741982 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:15:07.741982 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:15:07.741982 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:15:07.741982 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:15:07.741982 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:15:07.741982 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:15:07.741982 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:15:07.741982 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:15:07.741982 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:15:07.741982 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:15:07.741982 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:15:07.741982 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 15:15:07.741982 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 15:15:07.741982 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 15:15:07.741982 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 15:15:07.742850 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 15:15:07.742850 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 15:15:07.742850 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 15:15:07.742850 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 15:15:07.742850 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:15:07.742850 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:15:07.742850 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:15:07.742850 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:15:07.742850 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:15:07.742850 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:15:07.742850 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:15:07.742850 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Sep 13 15:15:07.742850 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:15:07.742850 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:15:07.742850 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:15:07.742850 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:15:07.744268 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:15:07.744268 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:15:07.744268 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:15:07.744268 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:15:07.744268 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 15:15:07.744268 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 15:15:07.744268 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 15:15:07.744268 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 15:15:07.744268 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 15:15:07.744268 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 15:15:07.744268 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 15:15:07.744268 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Sep 13 15:15:07.744268 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 148/284] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Sep 13 15:15:07 2022] GET /identity/v3/roles/reader => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:15:07.749935 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e8b94e-142a-4de1-9d8c-66450ce6a618 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:07.863152 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e8b94e-142a-4de1-9d8c-66450ce6a618 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:07.900436 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766b2687-1abc-44db-8110-bb304b0f5333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:07.901934 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766b2687-1abc-44db-8110-bb304b0f5333 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:07.902481 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766b2687-1abc-44db-8110-bb304b0f5333 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:07.902959 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766b2687-1abc-44db-8110-bb304b0f5333 None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:07.903910 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766b2687-1abc-44db-8110-bb304b0f5333 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:15:07.904425 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766b2687-1abc-44db-8110-bb304b0f5333 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:07.906079 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766b2687-1abc-44db-8110-bb304b0f5333 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:07.916069 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 137/285] 10.222.0.27 () {56 vars in 1101 bytes} [Tue Sep 13 15:15:07 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:15:07.921645 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6898ea52-3198-4390-9fa8-94d38641f6eb None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:08.002702 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:08.034286 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6898ea52-3198-4390-9fa8-94d38641f6eb None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:08.042606 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766b2687-1abc-44db-8110-bb304b0f5333 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:08.048180 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:08.097483 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38438431-8dad-426b-bfcd-07d841879026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:08.098511 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38438431-8dad-426b-bfcd-07d841879026 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:08.099010 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38438431-8dad-426b-bfcd-07d841879026 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:08.099570 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38438431-8dad-426b-bfcd-07d841879026 None admin] PATH_INFO: `/v3/users/a20c544aeb3b46138b8f2a2bbb135bfd` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:08.104071 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38438431-8dad-426b-bfcd-07d841879026 None admin] RBAC: Authorizing `identity:get_user(user_id=a20c544aeb3b46138b8f2a2bbb135bfd)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:08.106086 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38438431-8dad-426b-bfcd-07d841879026 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:08.108211 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 149/286] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Sep 13 15:15:07 2022] GET /identity/v3/users/a20c544aeb3b46138b8f2a2bbb135bfd => generated 297 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 15:15:08.113898 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38438431-8dad-426b-bfcd-07d841879026 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:08.159749 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766b2687-1abc-44db-8110-bb304b0f5333 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:08.225632 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fde672f-3c35-4b95-b763-cfa2ae09b1a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:08.226295 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fde672f-3c35-4b95-b763-cfa2ae09b1a8 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:08.226583 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fde672f-3c35-4b95-b763-cfa2ae09b1a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:08.226853 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fde672f-3c35-4b95-b763-cfa2ae09b1a8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:08.246521 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fde672f-3c35-4b95-b763-cfa2ae09b1a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 15:15:08.251906 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-5fde672f-3c35-4b95-b763-cfa2ae09b1a8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 15:15:08.251906 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:15:08.251906 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:15:08.251906 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:15:08.251906 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:15:08.251906 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:15:08.251906 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:15:08.251906 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:15:08.251906 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:15:08.251906 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:15:08.251906 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:15:08.251906 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:15:08.251906 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 15:15:08.251906 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 15:15:08.251906 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 15:15:08.251906 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 15:15:08.252803 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 15:15:08.252803 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 15:15:08.252803 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 15:15:08.252803 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 15:15:08.252803 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:15:08.252803 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:15:08.252803 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:15:08.252803 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:15:08.252803 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:15:08.252803 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:15:08.252803 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:15:08.252803 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Sep 13 15:15:08.252803 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:15:08.252803 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:15:08.252803 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:15:08.252803 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:15:08.253569 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:15:08.253569 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:15:08.253569 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:15:08.253569 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:15:08.253569 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 15:15:08.253569 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 15:15:08.253569 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 15:15:08.253569 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 15:15:08.253569 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 15:15:08.253569 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 15:15:08.253569 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 15:15:08.253569 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Sep 13 15:15:08.255902 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 138/287] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Sep 13 15:15:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 15:15:08.262867 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fde672f-3c35-4b95-b763-cfa2ae09b1a8 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:08.307067 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38438431-8dad-426b-bfcd-07d841879026 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:08.342187 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:08.389393 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e07f3d-ca27-4fef-ac98-34a9cc0f3a2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:08.390072 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e07f3d-ca27-4fef-ac98-34a9cc0f3a2f None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:08.390352 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e07f3d-ca27-4fef-ac98-34a9cc0f3a2f None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:08.390627 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e07f3d-ca27-4fef-ac98-34a9cc0f3a2f None admin] PATH_INFO: `/v3/projects/bcdaddc5cabe41a8982e616719a29740` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:08.392466 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e07f3d-ca27-4fef-ac98-34a9cc0f3a2f None admin] RBAC: Authorizing `identity:get_project(project_id=bcdaddc5cabe41a8982e616719a29740)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:08.393936 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e07f3d-ca27-4fef-ac98-34a9cc0f3a2f None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:08.395589 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 150/288] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Sep 13 15:15:08 2022] GET /identity/v3/projects/bcdaddc5cabe41a8982e616719a29740 => generated 302 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 15:15:08.402941 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e07f3d-ca27-4fef-ac98-34a9cc0f3a2f None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:08.409335 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fde672f-3c35-4b95-b763-cfa2ae09b1a8 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:08.418948 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:08.453763 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4e8e83-369a-4b7f-901d-afbac037c3e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:08.454389 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4e8e83-369a-4b7f-901d-afbac037c3e2 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:08.454674 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4e8e83-369a-4b7f-901d-afbac037c3e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:08.454954 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4e8e83-369a-4b7f-901d-afbac037c3e2 None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:08.455629 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4e8e83-369a-4b7f-901d-afbac037c3e2 None admin] RBAC: Adding query filter params (name=member) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:15:08.455940 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4e8e83-369a-4b7f-901d-afbac037c3e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:08.457329 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4e8e83-369a-4b7f-901d-afbac037c3e2 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:08.467671 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 139/289] 10.222.0.27 () {56 vars in 1101 bytes} [Tue Sep 13 15:15:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:15:08.473467 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4e8e83-369a-4b7f-901d-afbac037c3e2 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:08.586324 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4e8e83-369a-4b7f-901d-afbac037c3e2 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:08.622148 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:08.626391 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49a20d4-c725-43cf-8e32-8dffcd73080b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:08.627258 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49a20d4-c725-43cf-8e32-8dffcd73080b None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:08.627847 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49a20d4-c725-43cf-8e32-8dffcd73080b None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:08.628312 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49a20d4-c725-43cf-8e32-8dffcd73080b None admin] PATH_INFO: `/v3/users/0df1b9417d6f41b393a79c181ccc7f9b` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:08.631435 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49a20d4-c725-43cf-8e32-8dffcd73080b None admin] RBAC: Authorizing `identity:get_user(user_id=0df1b9417d6f41b393a79c181ccc7f9b)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:08.639232 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49a20d4-c725-43cf-8e32-8dffcd73080b None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:08.641162 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 140/290] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Sep 13 15:15:08 2022] GET /identity/v3/users/0df1b9417d6f41b393a79c181ccc7f9b => generated 297 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 15:15:08.646851 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49a20d4-c725-43cf-8e32-8dffcd73080b None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:08.682358 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e07f3d-ca27-4fef-ac98-34a9cc0f3a2f None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:08.758303 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6cea5e-8d61-4fe3-9faf-0b402c454107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:08.759522 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6cea5e-8d61-4fe3-9faf-0b402c454107 None admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:08.759815 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6cea5e-8d61-4fe3-9faf-0b402c454107 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:08.760071 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6cea5e-8d61-4fe3-9faf-0b402c454107 None admin] PATH_INFO: `/v3/projects/bcdaddc5cabe41a8982e616719a29740/users/a20c544aeb3b46138b8f2a2bbb135bfd/roles/b43a33bf0d63483a868ced4dfbcc4a6d` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:08.762605 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6cea5e-8d61-4fe3-9faf-0b402c454107 None admin] RBAC: Authorizing `identity:create_grant(project_id=bcdaddc5cabe41a8982e616719a29740, user_id=a20c544aeb3b46138b8f2a2bbb135bfd, role_id=b43a33bf0d63483a868ced4dfbcc4a6d)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:08.764046 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6cea5e-8d61-4fe3-9faf-0b402c454107 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:08.781455 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 151/291] 10.222.0.27 () {58 vars in 1439 bytes} [Tue Sep 13 15:15:08 2022] PUT /identity/v3/projects/bcdaddc5cabe41a8982e616719a29740/users/a20c544aeb3b46138b8f2a2bbb135bfd/roles/b43a33bf0d63483a868ced4dfbcc4a6d => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 15:15:08.839143 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49a20d4-c725-43cf-8e32-8dffcd73080b None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:08.877483 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7712df6f-d073-4ee7-9b17-9ca47264f20c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:08.878248 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7712df6f-d073-4ee7-9b17-9ca47264f20c None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:08.878532 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7712df6f-d073-4ee7-9b17-9ca47264f20c None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:08.878805 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7712df6f-d073-4ee7-9b17-9ca47264f20c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:08.947982 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:08.958565 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7712df6f-d073-4ee7-9b17-9ca47264f20c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:08.960353 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7712df6f-d073-4ee7-9b17-9ca47264f20c None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:09.071071 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 141/292] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Sep 13 15:15:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 13 15:15:09.075667 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6cea5e-8d61-4fe3-9faf-0b402c454107 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:09.146677 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:09.184612 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6cea5e-8d61-4fe3-9faf-0b402c454107 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:09.230724 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaa895b-2991-4c0e-b8a9-455f11e25560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:09.231363 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaa895b-2991-4c0e-b8a9-455f11e25560 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:09.231648 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaa895b-2991-4c0e-b8a9-455f11e25560 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:09.231991 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaa895b-2991-4c0e-b8a9-455f11e25560 None admin] PATH_INFO: `/v3/projects/bcdaddc5cabe41a8982e616719a29740` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:09.233968 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaa895b-2991-4c0e-b8a9-455f11e25560 None admin] RBAC: Authorizing `identity:get_project(project_id=bcdaddc5cabe41a8982e616719a29740)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:09.235475 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaa895b-2991-4c0e-b8a9-455f11e25560 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:09.237120 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 152/293] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Sep 13 15:15:09 2022] GET /identity/v3/projects/bcdaddc5cabe41a8982e616719a29740 => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:15:09.243227 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7712df6f-d073-4ee7-9b17-9ca47264f20c None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:09.342457 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:09.351324 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7712df6f-d073-4ee7-9b17-9ca47264f20c None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:09.391395 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe787885-60a1-4363-8510-627cf162e1d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:09.392028 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe787885-60a1-4363-8510-627cf162e1d2 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:09.392314 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe787885-60a1-4363-8510-627cf162e1d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:09.392587 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe787885-60a1-4363-8510-627cf162e1d2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:09.393382 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe787885-60a1-4363-8510-627cf162e1d2 None admin] RBAC: Adding query filter params (role.id=3fae3d3a28e147d3b2bede2378ff79ae, scope.project.id=bcdaddc5cabe41a8982e616719a29740, user.id=0df1b9417d6f41b393a79c181ccc7f9b) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:15:09.393713 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe787885-60a1-4363-8510-627cf162e1d2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:09.395156 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe787885-60a1-4363-8510-627cf162e1d2 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:09.405924 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 142/294] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Sep 13 15:15:09 2022] GET /identity/v3/role_assignments?user.id=0df1b9417d6f41b393a79c181ccc7f9b&scope.project.id=bcdaddc5cabe41a8982e616719a29740&role.id=3fae3d3a28e147d3b2bede2378ff79ae => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:15:10.167616 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b408bb48-0d2d-48f0-a13a-43d3e2174026 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:10.168640 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b408bb48-0d2d-48f0-a13a-43d3e2174026 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:10.169117 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b408bb48-0d2d-48f0-a13a-43d3e2174026 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:10.170927 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 153/295] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:15:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:15:10.176340 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99a2d85-49c1-4fb9-ae74-8afbb1f875f8 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:10.177153 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99a2d85-49c1-4fb9-ae74-8afbb1f875f8 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:10.177625 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99a2d85-49c1-4fb9-ae74-8afbb1f875f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:10.183142 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2181987a-3721-44ff-9bec-641469115b8d None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:10.183436 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2181987a-3721-44ff-9bec-641469115b8d None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:10.183712 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2181987a-3721-44ff-9bec-641469115b8d None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:10.185268 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 154/296] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:15:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 15:15:10.190184 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afd1c9e-832f-4ce2-95c3-d4c9aa0dc1ac None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:10.190470 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afd1c9e-832f-4ce2-95c3-d4c9aa0dc1ac None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:10.190751 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afd1c9e-832f-4ce2-95c3-d4c9aa0dc1ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:10.198747 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-d99a2d85-49c1-4fb9-ae74-8afbb1f875f8 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:15:10.199930 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-d99a2d85-49c1-4fb9-ae74-8afbb1f875f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:15:10.209584 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-0afd1c9e-832f-4ce2-95c3-d4c9aa0dc1ac None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:15:10.211093 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-0afd1c9e-832f-4ce2-95c3-d4c9aa0dc1ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:15:10.293727 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 143/297] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:15:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 15:15:10.296677 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 155/298] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:15:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 15:15:10.347070 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fe41cf-a626-4e12-af92-7764a8461dd5 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:10.347368 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fe41cf-a626-4e12-af92-7764a8461dd5 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:10.347632 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fe41cf-a626-4e12-af92-7764a8461dd5 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:10.349273 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 144/299] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:15:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:15:10.354905 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1a9834-1b3e-4b04-82b6-829480dccaac None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:10.355192 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1a9834-1b3e-4b04-82b6-829480dccaac None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:10.355470 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1a9834-1b3e-4b04-82b6-829480dccaac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:10.374855 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-4b1a9834-1b3e-4b04-82b6-829480dccaac None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:15:10.376098 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-4b1a9834-1b3e-4b04-82b6-829480dccaac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:15:10.437954 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:10.445376 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 156/300] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:15:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 15:15:10.573402 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fe41cf-a626-4e12-af92-7764a8461dd5 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:10.578444 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1a9834-1b3e-4b04-82b6-829480dccaac None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:10.671446 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:10.689015 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fe41cf-a626-4e12-af92-7764a8461dd5 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:10.713499 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1a9834-1b3e-4b04-82b6-829480dccaac None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:10.726481 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45dde2f-d4f3-4103-8c25-5f96ccffea50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:10.727171 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45dde2f-d4f3-4103-8c25-5f96ccffea50 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:10.727452 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45dde2f-d4f3-4103-8c25-5f96ccffea50 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:10.727881 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45dde2f-d4f3-4103-8c25-5f96ccffea50 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:10.739888 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45dde2f-d4f3-4103-8c25-5f96ccffea50 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 15:15:10.745918 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-a45dde2f-d4f3-4103-8c25-5f96ccffea50 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 15:15:10.745918 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:15:10.745918 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:15:10.745918 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:15:10.745918 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:15:10.745918 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:15:10.745918 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:15:10.745918 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:15:10.745918 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:15:10.745918 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:15:10.745918 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:15:10.745918 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:15:10.745918 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 15:15:10.745918 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 15:15:10.745918 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 15:15:10.745918 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 15:15:10.746986 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 15:15:10.746986 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 15:15:10.746986 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 15:15:10.746986 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 15:15:10.746986 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:15:10.746986 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:15:10.746986 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:15:10.746986 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:15:10.746986 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:15:10.746986 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:15:10.746986 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:15:10.746986 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Sep 13 15:15:10.746986 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:15:10.746986 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:15:10.746986 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:15:10.746986 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:15:10.747977 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:15:10.747977 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:15:10.747977 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:15:10.747977 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:15:10.747977 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 15:15:10.747977 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 15:15:10.747977 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 15:15:10.747977 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 15:15:10.747977 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 15:15:10.747977 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 15:15:10.747977 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 15:15:10.747977 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Sep 13 15:15:10.749909 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 145/301] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Sep 13 15:15:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:15:10.750814 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45dde2f-d4f3-4103-8c25-5f96ccffea50 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:10.757533 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a806df-ebc5-457a-b405-f80ca21a7594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:10.758200 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a806df-ebc5-457a-b405-f80ca21a7594 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:10.758475 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a806df-ebc5-457a-b405-f80ca21a7594 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:10.758741 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a806df-ebc5-457a-b405-f80ca21a7594 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:10.772274 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a806df-ebc5-457a-b405-f80ca21a7594 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 15:15:10.778117 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-04a806df-ebc5-457a-b405-f80ca21a7594 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 15:15:10.778117 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:15:10.778117 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:15:10.778117 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:15:10.778117 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:15:10.778117 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:15:10.778117 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:15:10.778117 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:15:10.778117 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:15:10.778117 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:15:10.778117 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:15:10.778117 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:15:10.778117 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 15:15:10.778117 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 15:15:10.778117 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 15:15:10.778117 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 15:15:10.779007 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 15:15:10.779007 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 15:15:10.779007 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 15:15:10.779007 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 15:15:10.779007 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:15:10.779007 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:15:10.779007 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:15:10.779007 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:15:10.779007 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:15:10.779007 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:15:10.779007 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:15:10.779007 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Sep 13 15:15:10.779007 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:15:10.779007 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:15:10.779007 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:15:10.779007 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:15:10.779803 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:15:10.779803 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:15:10.779803 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:15:10.779803 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:15:10.779803 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 15:15:10.779803 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 15:15:10.779803 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 15:15:10.779803 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 15:15:10.779803 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 15:15:10.779803 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 15:15:10.779803 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 15:15:10.779803 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Sep 13 15:15:10.779803 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 157/302] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Sep 13 15:15:10 2022] GET /identity/v3/roles/reader => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 15:15:10.779803 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a806df-ebc5-457a-b405-f80ca21a7594 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:10.841267 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:10.864970 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45dde2f-d4f3-4103-8c25-5f96ccffea50 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:10.889352 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a806df-ebc5-457a-b405-f80ca21a7594 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:10.901359 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe355f3-6c08-4bc0-83df-eccaf66da79a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:10.902027 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe355f3-6c08-4bc0-83df-eccaf66da79a None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:10.902311 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe355f3-6c08-4bc0-83df-eccaf66da79a None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:10.902609 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe355f3-6c08-4bc0-83df-eccaf66da79a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:10.903734 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe355f3-6c08-4bc0-83df-eccaf66da79a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:10.905181 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe355f3-6c08-4bc0-83df-eccaf66da79a None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:10.906794 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 146/303] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 13 15:15:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:15:10.912165 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe355f3-6c08-4bc0-83df-eccaf66da79a None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:10.926148 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c7bb26-b271-4a87-8760-e9b931234994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:10.927239 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c7bb26-b271-4a87-8760-e9b931234994 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:10.927765 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:10.928561 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c7bb26-b271-4a87-8760-e9b931234994 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:10.929034 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c7bb26-b271-4a87-8760-e9b931234994 None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:10.929962 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c7bb26-b271-4a87-8760-e9b931234994 None admin] RBAC: Adding query filter params (name=member) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:15:10.931373 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c7bb26-b271-4a87-8760-e9b931234994 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:10.933283 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c7bb26-b271-4a87-8760-e9b931234994 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:10.942123 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 158/304] 10.222.0.27 () {56 vars in 1101 bytes} [Tue Sep 13 15:15:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:15:10.943159 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c7bb26-b271-4a87-8760-e9b931234994 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:11.025397 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe355f3-6c08-4bc0-83df-eccaf66da79a None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:11.042679 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c7bb26-b271-4a87-8760-e9b931234994 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:11.059655 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:11.065806 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4172cf27-4803-4005-812f-586ca34b828d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:11.066419 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4172cf27-4803-4005-812f-586ca34b828d None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:11.066697 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4172cf27-4803-4005-812f-586ca34b828d None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:11.066962 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4172cf27-4803-4005-812f-586ca34b828d None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:11.067632 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4172cf27-4803-4005-812f-586ca34b828d None admin] RBAC: Adding query filter params (name=reader) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:15:11.067909 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4172cf27-4803-4005-812f-586ca34b828d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:11.069270 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4172cf27-4803-4005-812f-586ca34b828d None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:11.082812 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 147/305] 10.222.0.27 () {56 vars in 1101 bytes} [Tue Sep 13 15:15:10 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:15:11.082812 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4172cf27-4803-4005-812f-586ca34b828d None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:11.084020 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6094f053-edf6-4cb6-a13f-dd8c9dc962c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:11.084693 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6094f053-edf6-4cb6-a13f-dd8c9dc962c2 None admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:11.084980 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6094f053-edf6-4cb6-a13f-dd8c9dc962c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:11.085286 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6094f053-edf6-4cb6-a13f-dd8c9dc962c2 None admin] PATH_INFO: `/v3/groups` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:11.085948 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6094f053-edf6-4cb6-a13f-dd8c9dc962c2 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:11.087973 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6094f053-edf6-4cb6-a13f-dd8c9dc962c2 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:11.106379 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 159/306] 10.222.0.27 () {60 vars in 1134 bytes} [Tue Sep 13 15:15:10 2022] POST /identity/v3/groups => generated 229 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:15:11.107199 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6094f053-edf6-4cb6-a13f-dd8c9dc962c2 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:11.186090 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:11.224240 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4172cf27-4803-4005-812f-586ca34b828d None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:11.228249 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6094f053-edf6-4cb6-a13f-dd8c9dc962c2 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:11.272812 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1786700-cff7-4bd7-9e06-3db0c372930f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:11.273614 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1786700-cff7-4bd7-9e06-3db0c372930f None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:11.274022 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1786700-cff7-4bd7-9e06-3db0c372930f None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:11.274397 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1786700-cff7-4bd7-9e06-3db0c372930f None admin] PATH_INFO: `/v3/users/bc8d26b094504c838fe14d2c8e7ddec0` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:11.275930 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdaca7e-61a0-41c1-86cf-9732b0ec2848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:11.276580 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdaca7e-61a0-41c1-86cf-9732b0ec2848 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:11.276989 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdaca7e-61a0-41c1-86cf-9732b0ec2848 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:11.277366 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdaca7e-61a0-41c1-86cf-9732b0ec2848 None admin] PATH_INFO: `/v3/users/8c32a069bb404396b31571d9bdb65d8e` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:11.278698 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdaca7e-61a0-41c1-86cf-9732b0ec2848 None admin] RBAC: Authorizing `identity:get_user(user_id=8c32a069bb404396b31571d9bdb65d8e)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:11.280205 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdaca7e-61a0-41c1-86cf-9732b0ec2848 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:11.282098 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 148/307] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Sep 13 15:15:11 2022] GET /identity/v3/users/8c32a069bb404396b31571d9bdb65d8e => generated 293 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:15:11.288096 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdaca7e-61a0-41c1-86cf-9732b0ec2848 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:11.291326 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1786700-cff7-4bd7-9e06-3db0c372930f None admin] RBAC: Authorizing `identity:get_user(user_id=bc8d26b094504c838fe14d2c8e7ddec0)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:11.293058 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1786700-cff7-4bd7-9e06-3db0c372930f None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:11.295198 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 160/308] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Sep 13 15:15:11 2022] GET /identity/v3/users/bc8d26b094504c838fe14d2c8e7ddec0 => generated 293 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:15:11.300989 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1786700-cff7-4bd7-9e06-3db0c372930f None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:11.344354 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:11.417040 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1786700-cff7-4bd7-9e06-3db0c372930f None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:11.420343 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdaca7e-61a0-41c1-86cf-9732b0ec2848 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:11.456027 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92473b88-78f3-428b-a8c1-44ce9884bb6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:11.456634 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92473b88-78f3-428b-a8c1-44ce9884bb6e None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:11.456915 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92473b88-78f3-428b-a8c1-44ce9884bb6e None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:11.457192 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92473b88-78f3-428b-a8c1-44ce9884bb6e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:11.457945 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92473b88-78f3-428b-a8c1-44ce9884bb6e None admin] RBAC: Adding query filter params (role.id=b43a33bf0d63483a868ced4dfbcc4a6d, user.id=bc8d26b094504c838fe14d2c8e7ddec0, scope.system=all) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:15:11.458261 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92473b88-78f3-428b-a8c1-44ce9884bb6e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:11.458862 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3aa411-1216-4baf-b6b6-f05550dde81c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:11.459509 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3aa411-1216-4baf-b6b6-f05550dde81c None admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:11.459680 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92473b88-78f3-428b-a8c1-44ce9884bb6e None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:11.459775 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3aa411-1216-4baf-b6b6-f05550dde81c None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:11.460052 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3aa411-1216-4baf-b6b6-f05550dde81c None admin] PATH_INFO: `/v3/system/users/8c32a069bb404396b31571d9bdb65d8e/roles/3fae3d3a28e147d3b2bede2378ff79ae` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:11.461441 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3aa411-1216-4baf-b6b6-f05550dde81c None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=8c32a069bb404396b31571d9bdb65d8e, role_id=3fae3d3a28e147d3b2bede2378ff79ae)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:11.463792 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3aa411-1216-4baf-b6b6-f05550dde81c None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:11.470273 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 161/309] 10.222.0.27 () {56 vars in 1308 bytes} [Tue Sep 13 15:15:11 2022] GET /identity/v3/role_assignments?user.id=bc8d26b094504c838fe14d2c8e7ddec0&scope.system=all&role.id=b43a33bf0d63483a868ced4dfbcc4a6d => generated 226 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 15:15:11.470273 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0394545-d2cf-4c9b-83dd-19ed2e48863c None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:11.470273 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0394545-d2cf-4c9b-83dd-19ed2e48863c None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:11.470273 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0394545-d2cf-4c9b-83dd-19ed2e48863c None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:11.470273 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 162/310] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:15:11 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:15:11.475082 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf71dbc7-8d14-4102-a4cc-199d3139337b None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:11.475332 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf71dbc7-8d14-4102-a4cc-199d3139337b None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:11.475627 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf71dbc7-8d14-4102-a4cc-199d3139337b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:11.488244 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 149/311] 10.222.0.27 () {58 vars in 1334 bytes} [Tue Sep 13 15:15:11 2022] PUT /identity/v3/system/users/8c32a069bb404396b31571d9bdb65d8e/roles/3fae3d3a28e147d3b2bede2378ff79ae => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 15:15:11.498845 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-cf71dbc7-8d14-4102-a4cc-199d3139337b None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:15:11.500270 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-cf71dbc7-8d14-4102-a4cc-199d3139337b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:15:11.584130 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 163/312] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:15:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 15:15:11.859978 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3aa411-1216-4baf-b6b6-f05550dde81c None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:11.873192 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:11.970837 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3aa411-1216-4baf-b6b6-f05550dde81c None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:12.007125 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6448af-592b-4f86-8c9c-6ae295e8382c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:12.007765 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6448af-592b-4f86-8c9c-6ae295e8382c None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:12.008045 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6448af-592b-4f86-8c9c-6ae295e8382c None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:12.008322 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6448af-592b-4f86-8c9c-6ae295e8382c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:12.022831 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6448af-592b-4f86-8c9c-6ae295e8382c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 15:15:12.029250 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-7e6448af-592b-4f86-8c9c-6ae295e8382c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 15:15:12.029250 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:15:12.029250 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:15:12.029250 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:15:12.029250 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:15:12.029250 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:15:12.029250 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:15:12.029250 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:15:12.029250 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:15:12.029250 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:15:12.029250 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:15:12.029250 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:15:12.029250 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 15:15:12.029250 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 15:15:12.029250 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 15:15:12.029250 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 15:15:12.030144 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 15:15:12.030144 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 15:15:12.030144 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 15:15:12.030144 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 15:15:12.030144 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:15:12.030144 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:15:12.030144 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:15:12.030144 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:15:12.030144 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:15:12.030144 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:15:12.030144 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:15:12.030144 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Sep 13 15:15:12.030144 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:15:12.030144 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:15:12.030144 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:15:12.030144 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:15:12.030949 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:15:12.030949 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:15:12.030949 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:15:12.030949 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:15:12.030949 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 15:15:12.030949 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 15:15:12.030949 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 15:15:12.030949 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 15:15:12.030949 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 15:15:12.030949 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 15:15:12.030949 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 15:15:12.030949 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Sep 13 15:15:12.030949 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 150/313] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Sep 13 15:15:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:15:12.036384 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf71dbc7-8d14-4102-a4cc-199d3139337b None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:12.073377 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:12.148249 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf71dbc7-8d14-4102-a4cc-199d3139337b None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:12.184143 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c898ba-8410-466f-b486-3268e467c8a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:12.184786 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c898ba-8410-466f-b486-3268e467c8a7 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:12.185063 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c898ba-8410-466f-b486-3268e467c8a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:12.185330 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c898ba-8410-466f-b486-3268e467c8a7 None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:12.186016 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c898ba-8410-466f-b486-3268e467c8a7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:15:12.186317 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c898ba-8410-466f-b486-3268e467c8a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:12.187682 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c898ba-8410-466f-b486-3268e467c8a7 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:12.196893 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 164/314] 10.222.0.27 () {56 vars in 1101 bytes} [Tue Sep 13 15:15:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:15:12.202640 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6448af-592b-4f86-8c9c-6ae295e8382c None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:12.275477 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:12.313065 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6448af-592b-4f86-8c9c-6ae295e8382c None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:12.348924 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4e93e6-0c0a-4942-9053-10efde8ccd9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:12.349559 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4e93e6-0c0a-4942-9053-10efde8ccd9a None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:12.349870 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4e93e6-0c0a-4942-9053-10efde8ccd9a None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:12.350143 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4e93e6-0c0a-4942-9053-10efde8ccd9a None admin] PATH_INFO: `/v3/users/a20c544aeb3b46138b8f2a2bbb135bfd` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:12.351288 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4e93e6-0c0a-4942-9053-10efde8ccd9a None admin] RBAC: Authorizing `identity:get_user(user_id=a20c544aeb3b46138b8f2a2bbb135bfd)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:12.352846 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4e93e6-0c0a-4942-9053-10efde8ccd9a None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:12.354777 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 151/315] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Sep 13 15:15:12 2022] GET /identity/v3/users/a20c544aeb3b46138b8f2a2bbb135bfd => generated 297 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:15:12.360537 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c898ba-8410-466f-b486-3268e467c8a7 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:12.471444 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:12.480717 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c898ba-8410-466f-b486-3268e467c8a7 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:12.515480 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575f3816-1592-464b-ac46-e52a6ddf066d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:12.516088 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575f3816-1592-464b-ac46-e52a6ddf066d None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:12.516372 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575f3816-1592-464b-ac46-e52a6ddf066d None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:12.516645 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575f3816-1592-464b-ac46-e52a6ddf066d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:12.585997 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575f3816-1592-464b-ac46-e52a6ddf066d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:12.587737 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575f3816-1592-464b-ac46-e52a6ddf066d None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:12.678698 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:12.689654 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 165/316] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Sep 13 15:15:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 15:15:12.695068 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4e93e6-0c0a-4942-9053-10efde8ccd9a None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:12.801988 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4e93e6-0c0a-4942-9053-10efde8ccd9a None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:12.838485 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1e7c4e-16b3-4315-ac8b-c2d2537c6824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:12.839073 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1e7c4e-16b3-4315-ac8b-c2d2537c6824 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:12.839351 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1e7c4e-16b3-4315-ac8b-c2d2537c6824 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:12.839624 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1e7c4e-16b3-4315-ac8b-c2d2537c6824 None admin] PATH_INFO: `/v3/projects/bcdaddc5cabe41a8982e616719a29740` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:12.840753 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1e7c4e-16b3-4315-ac8b-c2d2537c6824 None admin] RBAC: Authorizing `identity:get_project(project_id=bcdaddc5cabe41a8982e616719a29740)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:12.842226 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1e7c4e-16b3-4315-ac8b-c2d2537c6824 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:12.844155 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 152/317] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Sep 13 15:15:12 2022] GET /identity/v3/projects/bcdaddc5cabe41a8982e616719a29740 => generated 302 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:15:12.849859 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575f3816-1592-464b-ac46-e52a6ddf066d None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:12.959590 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575f3816-1592-464b-ac46-e52a6ddf066d None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:12.999297 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9cf377-e243-4845-a69b-117808f8ef33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:12.999825 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9cf377-e243-4845-a69b-117808f8ef33 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:13.000109 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9cf377-e243-4845-a69b-117808f8ef33 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:13.000382 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9cf377-e243-4845-a69b-117808f8ef33 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:13.001110 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9cf377-e243-4845-a69b-117808f8ef33 None admin] RBAC: Adding query filter params (role.id=b43a33bf0d63483a868ced4dfbcc4a6d, scope.project.id=bcdaddc5cabe41a8982e616719a29740, user.id=a20c544aeb3b46138b8f2a2bbb135bfd) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:15:13.001429 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9cf377-e243-4845-a69b-117808f8ef33 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:13.002967 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9cf377-e243-4845-a69b-117808f8ef33 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:13.009503 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 166/318] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Sep 13 15:15:12 2022] GET /identity/v3/role_assignments?user.id=a20c544aeb3b46138b8f2a2bbb135bfd&scope.project.id=bcdaddc5cabe41a8982e616719a29740&role.id=b43a33bf0d63483a868ced4dfbcc4a6d => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:15:13.458729 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f0c124-7070-44fc-8ff2-ba25cc104218 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:13.459249 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f0c124-7070-44fc-8ff2-ba25cc104218 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:13.459249 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f0c124-7070-44fc-8ff2-ba25cc104218 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:13.460642 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 153/319] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:15:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:15:13.465830 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab8abd3-5c9c-4278-a531-dfd5296a5f4c None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:13.466212 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab8abd3-5c9c-4278-a531-dfd5296a5f4c None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:13.466373 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab8abd3-5c9c-4278-a531-dfd5296a5f4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:13.485029 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-bab8abd3-5c9c-4278-a531-dfd5296a5f4c None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:15:13.486257 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-bab8abd3-5c9c-4278-a531-dfd5296a5f4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:15:13.538489 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:13.557300 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 167/320] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:15:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 15:15:13.768944 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949d0b37-149b-47fa-b672-52831a0f0be1 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:13.769251 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949d0b37-149b-47fa-b672-52831a0f0be1 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:13.769491 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949d0b37-149b-47fa-b672-52831a0f0be1 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:13.770995 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 154/321] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:15:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:15:13.776161 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d18e940-77c8-4c40-9ec7-2eaadbf36e72 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:13.776269 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f043299f-ae9b-4887-9590-09e5e90c19ce None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:13.776436 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d18e940-77c8-4c40-9ec7-2eaadbf36e72 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:13.776546 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f043299f-ae9b-4887-9590-09e5e90c19ce None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:13.776711 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d18e940-77c8-4c40-9ec7-2eaadbf36e72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:13.776801 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f043299f-ae9b-4887-9590-09e5e90c19ce None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:13.778251 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 168/322] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:15:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:15:13.782818 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077b70ea-4427-4f7a-b0e4-6d2c384b1316 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:13.783107 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077b70ea-4427-4f7a-b0e4-6d2c384b1316 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:13.783380 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077b70ea-4427-4f7a-b0e4-6d2c384b1316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:13.784066 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:13.795863 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-7d18e940-77c8-4c40-9ec7-2eaadbf36e72 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:15:13.796984 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-7d18e940-77c8-4c40-9ec7-2eaadbf36e72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:15:13.801728 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-077b70ea-4427-4f7a-b0e4-6d2c384b1316 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:15:13.802872 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-077b70ea-4427-4f7a-b0e4-6d2c384b1316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:15:13.865976 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 155/323] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:15:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 15:15:13.870052 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d18e940-77c8-4c40-9ec7-2eaadbf36e72 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:13.872745 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 169/324] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:15:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 15:15:13.966540 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d18e940-77c8-4c40-9ec7-2eaadbf36e72 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:14.000462 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d85969-d7a8-4714-ba3d-9f8c7073b62d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:14.001024 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d85969-d7a8-4714-ba3d-9f8c7073b62d None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:14.001304 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d85969-d7a8-4714-ba3d-9f8c7073b62d None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:14.001573 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d85969-d7a8-4714-ba3d-9f8c7073b62d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:14.002688 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d85969-d7a8-4714-ba3d-9f8c7073b62d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:14.004120 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d85969-d7a8-4714-ba3d-9f8c7073b62d None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:14.010036 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 156/325] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 13 15:15:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:15:14.011687 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077b70ea-4427-4f7a-b0e4-6d2c384b1316 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:14.112276 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077b70ea-4427-4f7a-b0e4-6d2c384b1316 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:14.128535 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:14.139876 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d85969-d7a8-4714-ba3d-9f8c7073b62d None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:14.143056 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:14.148109 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa7d464-97b3-4576-b934-1ae47731a9f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:14.148721 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa7d464-97b3-4576-b934-1ae47731a9f9 None admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:14.148997 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa7d464-97b3-4576-b934-1ae47731a9f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:14.149919 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa7d464-97b3-4576-b934-1ae47731a9f9 None admin] PATH_INFO: `/v3/groups` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:14.150683 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa7d464-97b3-4576-b934-1ae47731a9f9 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:14.152119 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa7d464-97b3-4576-b934-1ae47731a9f9 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:14.166688 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 170/326] 10.222.0.27 () {60 vars in 1134 bytes} [Tue Sep 13 15:15:14 2022] POST /identity/v3/groups => generated 226 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:15:14.170799 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa7d464-97b3-4576-b934-1ae47731a9f9 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:14.252855 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d85969-d7a8-4714-ba3d-9f8c7073b62d None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:14.288018 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa7d464-97b3-4576-b934-1ae47731a9f9 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:14.295031 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027f6b15-d64d-4707-9bd5-5389aaa0ec0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:14.295690 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027f6b15-d64d-4707-9bd5-5389aaa0ec0a None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:14.295968 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027f6b15-d64d-4707-9bd5-5389aaa0ec0a None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:14.296238 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027f6b15-d64d-4707-9bd5-5389aaa0ec0a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:14.311321 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027f6b15-d64d-4707-9bd5-5389aaa0ec0a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 15:15:14.317087 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-027f6b15-d64d-4707-9bd5-5389aaa0ec0a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 15:15:14.317087 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:15:14.317087 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:15:14.317087 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:15:14.317087 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:15:14.317087 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:15:14.317087 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:15:14.317087 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:15:14.317087 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:15:14.317087 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:15:14.317087 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:15:14.317087 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:15:14.317087 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 15:15:14.317087 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 15:15:14.317087 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 15:15:14.317087 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 15:15:14.318242 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 15:15:14.318242 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 15:15:14.318242 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 15:15:14.318242 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 15:15:14.318242 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:15:14.318242 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:15:14.318242 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:15:14.318242 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:15:14.318242 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:15:14.318242 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:15:14.318242 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:15:14.318242 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Sep 13 15:15:14.318242 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:15:14.318242 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:15:14.318242 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:15:14.318242 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:15:14.319139 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:15:14.319139 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:15:14.319139 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:15:14.319139 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:15:14.319139 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 15:15:14.319139 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 15:15:14.319139 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 15:15:14.319139 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 15:15:14.319139 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 15:15:14.319139 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 15:15:14.319139 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 15:15:14.319139 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Sep 13 15:15:14.322267 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 157/327] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Sep 13 15:15:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 15:15:14.328351 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027f6b15-d64d-4707-9bd5-5389aaa0ec0a None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:14.331110 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75be90e8-37ee-479c-a100-ec6f61a09ebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:14.331760 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75be90e8-37ee-479c-a100-ec6f61a09ebd None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:14.332047 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75be90e8-37ee-479c-a100-ec6f61a09ebd None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:14.332327 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75be90e8-37ee-479c-a100-ec6f61a09ebd None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:14.345485 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75be90e8-37ee-479c-a100-ec6f61a09ebd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 15:15:14.351337 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-75be90e8-37ee-479c-a100-ec6f61a09ebd None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 15:15:14.351337 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:15:14.351337 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:15:14.351337 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:15:14.351337 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:15:14.351337 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:15:14.351337 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:15:14.351337 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:15:14.351337 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:15:14.351337 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:15:14.351337 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:15:14.351337 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:15:14.351337 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 15:15:14.351337 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 15:15:14.351337 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 15:15:14.351337 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 15:15:14.352211 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 15:15:14.352211 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 15:15:14.352211 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 15:15:14.352211 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 15:15:14.352211 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:15:14.352211 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:15:14.352211 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:15:14.352211 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:15:14.352211 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:15:14.352211 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:15:14.352211 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:15:14.352211 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Sep 13 15:15:14.352211 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:15:14.352211 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:15:14.352211 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:15:14.352211 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:15:14.353056 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:15:14.353056 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:15:14.353056 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:15:14.353056 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:15:14.353056 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 15:15:14.353056 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 15:15:14.353056 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 15:15:14.353056 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 15:15:14.353056 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 15:15:14.353056 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 15:15:14.353056 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 15:15:14.353056 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Sep 13 15:15:14.353056 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 171/328] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Sep 13 15:15:14 2022] GET /identity/v3/roles/reader => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:15:14.358877 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75be90e8-37ee-479c-a100-ec6f61a09ebd None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:14.401843 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:14.414488 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:14.468530 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027f6b15-d64d-4707-9bd5-5389aaa0ec0a None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:14.484886 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75be90e8-37ee-479c-a100-ec6f61a09ebd None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:14.508224 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d34911-dd9e-4577-b072-9df7e0df3af9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:14.508803 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d34911-dd9e-4577-b072-9df7e0df3af9 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:14.509074 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d34911-dd9e-4577-b072-9df7e0df3af9 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:14.509355 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d34911-dd9e-4577-b072-9df7e0df3af9 None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:14.510048 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d34911-dd9e-4577-b072-9df7e0df3af9 None admin] RBAC: Adding query filter params (name=member) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:15:14.510343 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d34911-dd9e-4577-b072-9df7e0df3af9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:14.511961 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d34911-dd9e-4577-b072-9df7e0df3af9 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:14.521319 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 158/329] 10.222.0.27 () {56 vars in 1101 bytes} [Tue Sep 13 15:15:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 15:15:14.525778 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83424c0-7672-45fc-b574-26e92f984cdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:14.526398 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83424c0-7672-45fc-b574-26e92f984cdb None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:14.526770 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83424c0-7672-45fc-b574-26e92f984cdb None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:14.526941 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83424c0-7672-45fc-b574-26e92f984cdb None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:14.527613 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83424c0-7672-45fc-b574-26e92f984cdb None admin] RBAC: Adding query filter params (name=reader) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:15:14.527910 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83424c0-7672-45fc-b574-26e92f984cdb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:14.529284 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83424c0-7672-45fc-b574-26e92f984cdb None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:14.531090 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d34911-dd9e-4577-b072-9df7e0df3af9 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:14.538820 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 172/330] 10.222.0.27 () {56 vars in 1101 bytes} [Tue Sep 13 15:15:14 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 15:15:14.544349 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83424c0-7672-45fc-b574-26e92f984cdb None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:14.668558 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d34911-dd9e-4577-b072-9df7e0df3af9 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:14.683460 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83424c0-7672-45fc-b574-26e92f984cdb None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:14.691627 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:14.703878 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:14.732328 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20a60d9-6d39-4b4b-bc55-37115eab6ecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:14.733001 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20a60d9-6d39-4b4b-bc55-37115eab6ecb None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:14.733266 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20a60d9-6d39-4b4b-bc55-37115eab6ecb None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:14.733545 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20a60d9-6d39-4b4b-bc55-37115eab6ecb None admin] PATH_INFO: `/v3/users/8c32a069bb404396b31571d9bdb65d8e` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:14.734719 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20a60d9-6d39-4b4b-bc55-37115eab6ecb None admin] RBAC: Authorizing `identity:get_user(user_id=8c32a069bb404396b31571d9bdb65d8e)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:14.735506 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830d00c8-e0e0-43a4-aa7b-e754e2baad21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:14.736175 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20a60d9-6d39-4b4b-bc55-37115eab6ecb None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:14.736477 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830d00c8-e0e0-43a4-aa7b-e754e2baad21 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:14.736901 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830d00c8-e0e0-43a4-aa7b-e754e2baad21 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:14.737322 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830d00c8-e0e0-43a4-aa7b-e754e2baad21 None admin] PATH_INFO: `/v3/users/bc8d26b094504c838fe14d2c8e7ddec0` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:14.738105 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 159/331] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Sep 13 15:15:14 2022] GET /identity/v3/users/8c32a069bb404396b31571d9bdb65d8e => generated 293 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:15:14.738946 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830d00c8-e0e0-43a4-aa7b-e754e2baad21 None admin] RBAC: Authorizing `identity:get_user(user_id=bc8d26b094504c838fe14d2c8e7ddec0)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:14.740666 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830d00c8-e0e0-43a4-aa7b-e754e2baad21 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:14.742933 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 173/332] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Sep 13 15:15:14 2022] GET /identity/v3/users/bc8d26b094504c838fe14d2c8e7ddec0 => generated 293 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 15:15:14.744353 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20a60d9-6d39-4b4b-bc55-37115eab6ecb None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:14.748828 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830d00c8-e0e0-43a4-aa7b-e754e2baad21 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:14.881561 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830d00c8-e0e0-43a4-aa7b-e754e2baad21 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:14.883256 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20a60d9-6d39-4b4b-bc55-37115eab6ecb None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:14.930368 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db1e9ea-3a73-48c3-b8ae-3c3d92307c29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:14.931086 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db1e9ea-3a73-48c3-b8ae-3c3d92307c29 None admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:14.931405 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db1e9ea-3a73-48c3-b8ae-3c3d92307c29 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:14.931640 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db1e9ea-3a73-48c3-b8ae-3c3d92307c29 None admin] PATH_INFO: `/v3/system/users/bc8d26b094504c838fe14d2c8e7ddec0/roles/b43a33bf0d63483a868ced4dfbcc4a6d` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:14.933196 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db1e9ea-3a73-48c3-b8ae-3c3d92307c29 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=bc8d26b094504c838fe14d2c8e7ddec0, role_id=b43a33bf0d63483a868ced4dfbcc4a6d)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:14.934608 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db1e9ea-3a73-48c3-b8ae-3c3d92307c29 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:14.938857 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f585090c-7828-4365-8236-ab33ffa2aac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:14.939833 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f585090c-7828-4365-8236-ab33ffa2aac4 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:14.940530 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f585090c-7828-4365-8236-ab33ffa2aac4 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:14.941160 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f585090c-7828-4365-8236-ab33ffa2aac4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:14.942291 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f585090c-7828-4365-8236-ab33ffa2aac4 None admin] RBAC: Adding query filter params (role.id=3fae3d3a28e147d3b2bede2378ff79ae, user.id=8c32a069bb404396b31571d9bdb65d8e, scope.system=all) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:15:14.942865 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f585090c-7828-4365-8236-ab33ffa2aac4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:14.944611 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f585090c-7828-4365-8236-ab33ffa2aac4 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:14.959291 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 174/333] 10.222.0.27 () {58 vars in 1334 bytes} [Tue Sep 13 15:15:14 2022] PUT /identity/v3/system/users/bc8d26b094504c838fe14d2c8e7ddec0/roles/b43a33bf0d63483a868ced4dfbcc4a6d => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 15:15:14.961030 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 160/334] 10.222.0.27 () {56 vars in 1308 bytes} [Tue Sep 13 15:15:14 2022] GET /identity/v3/role_assignments?user.id=8c32a069bb404396b31571d9bdb65d8e&scope.system=all&role.id=3fae3d3a28e147d3b2bede2378ff79ae => generated 510 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 15:15:16.740229 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384eaba9-c041-47e2-b789-7c1ecf39667b None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:16.740770 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384eaba9-c041-47e2-b789-7c1ecf39667b None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:16.740770 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384eaba9-c041-47e2-b789-7c1ecf39667b None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:16.742433 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 175/335] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:15:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:15:16.749332 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7895aa93-a17f-46d2-b7a3-70dadcedb8b3 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:16.749835 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7895aa93-a17f-46d2-b7a3-70dadcedb8b3 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:16.749933 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7895aa93-a17f-46d2-b7a3-70dadcedb8b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:16.779558 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-7895aa93-a17f-46d2-b7a3-70dadcedb8b3 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:15:16.780747 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-7895aa93-a17f-46d2-b7a3-70dadcedb8b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:15:16.834033 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:16.857217 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 161/336] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:15:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 15:15:17.313168 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cc7a08-0119-4e60-9c70-9ea5fcae7d48 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:17.313465 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cc7a08-0119-4e60-9c70-9ea5fcae7d48 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:17.313754 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cc7a08-0119-4e60-9c70-9ea5fcae7d48 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:17.315331 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 176/337] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:15:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:15:17.320564 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a8bd83-9f5b-47cc-a6b9-60a0b2d0c93a None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:17.320875 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a8bd83-9f5b-47cc-a6b9-60a0b2d0c93a None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:17.321420 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a8bd83-9f5b-47cc-a6b9-60a0b2d0c93a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:17.346725 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-84a8bd83-9f5b-47cc-a6b9-60a0b2d0c93a None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:15:17.347915 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-84a8bd83-9f5b-47cc-a6b9-60a0b2d0c93a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:15:17.425087 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 162/338] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:15:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 15:15:17.435436 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cc7a08-0119-4e60-9c70-9ea5fcae7d48 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:17.470596 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:17.568465 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cc7a08-0119-4e60-9c70-9ea5fcae7d48 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:17.609548 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d79a5c-f684-4b8b-bc9d-ffe7a93757a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:17.610223 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d79a5c-f684-4b8b-bc9d-ffe7a93757a8 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:17.610501 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d79a5c-f684-4b8b-bc9d-ffe7a93757a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:17.610776 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d79a5c-f684-4b8b-bc9d-ffe7a93757a8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:17.626300 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d79a5c-f684-4b8b-bc9d-ffe7a93757a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 15:15:17.631688 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-e8d79a5c-f684-4b8b-bc9d-ffe7a93757a8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 15:15:17.631688 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:15:17.631688 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:15:17.631688 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:15:17.631688 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:15:17.631688 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:15:17.631688 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:15:17.631688 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:15:17.631688 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:15:17.631688 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:15:17.631688 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:15:17.631688 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:15:17.631688 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 15:15:17.631688 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 15:15:17.631688 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 15:15:17.631688 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 15:15:17.633931 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 15:15:17.633931 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 15:15:17.633931 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 15:15:17.633931 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 15:15:17.633931 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:15:17.633931 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:15:17.633931 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:15:17.633931 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:15:17.633931 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:15:17.633931 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:15:17.633931 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:15:17.633931 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Sep 13 15:15:17.633931 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:15:17.633931 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:15:17.633931 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:15:17.633931 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:15:17.635892 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:15:17.635892 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:15:17.635892 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:15:17.635892 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:15:17.635892 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 15:15:17.635892 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 15:15:17.635892 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 15:15:17.635892 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 15:15:17.635892 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 15:15:17.635892 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 15:15:17.635892 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 15:15:17.635892 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Sep 13 15:15:17.635892 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 177/339] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Sep 13 15:15:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:15:17.639705 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a8bd83-9f5b-47cc-a6b9-60a0b2d0c93a None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:17.760939 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a3f808-746d-40aa-9fda-916b072e0f46 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:17.761491 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a3f808-746d-40aa-9fda-916b072e0f46 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:17.761491 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a3f808-746d-40aa-9fda-916b072e0f46 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:17.763829 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 178/340] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:15:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:15:17.769882 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54a8498-9888-4b78-b7dc-55e63cd29241 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:17.770475 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54a8498-9888-4b78-b7dc-55e63cd29241 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:17.770948 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54a8498-9888-4b78-b7dc-55e63cd29241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:17.774843 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a8bd83-9f5b-47cc-a6b9-60a0b2d0c93a None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:17.787756 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:17.814702 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-b54a8498-9888-4b78-b7dc-55e63cd29241 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:15:17.814916 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3043676b-572c-4b44-80e9-c6d0391f09be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:17.815560 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3043676b-572c-4b44-80e9-c6d0391f09be None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:17.815849 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3043676b-572c-4b44-80e9-c6d0391f09be None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:17.816186 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3043676b-572c-4b44-80e9-c6d0391f09be None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:17.816867 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3043676b-572c-4b44-80e9-c6d0391f09be None admin] RBAC: Adding query filter params (name=member) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:15:17.817180 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3043676b-572c-4b44-80e9-c6d0391f09be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:17.817497 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-b54a8498-9888-4b78-b7dc-55e63cd29241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:15:17.818628 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3043676b-572c-4b44-80e9-c6d0391f09be None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:17.829570 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 163/341] 10.222.0.27 () {56 vars in 1101 bytes} [Tue Sep 13 15:15:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:15:17.837956 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3043676b-572c-4b44-80e9-c6d0391f09be None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:17.960552 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 179/342] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:15:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 15:15:17.964633 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54a8498-9888-4b78-b7dc-55e63cd29241 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:17.995803 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:18.084081 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3043676b-572c-4b44-80e9-c6d0391f09be None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:18.158213 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54a8498-9888-4b78-b7dc-55e63cd29241 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:18.160301 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf5f9da-a560-4841-9be3-8e6260a98641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:18.160939 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf5f9da-a560-4841-9be3-8e6260a98641 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:18.161419 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf5f9da-a560-4841-9be3-8e6260a98641 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:18.161903 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf5f9da-a560-4841-9be3-8e6260a98641 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:18.201491 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cd859c-3952-47bd-8f85-6237cd5d40a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:18.202431 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cd859c-3952-47bd-8f85-6237cd5d40a6 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:18.202879 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cd859c-3952-47bd-8f85-6237cd5d40a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:18.203310 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cd859c-3952-47bd-8f85-6237cd5d40a6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:18.215381 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cd859c-3952-47bd-8f85-6237cd5d40a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 15:15:18.221411 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-61cd859c-3952-47bd-8f85-6237cd5d40a6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 15:15:18.221411 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:15:18.221411 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:15:18.221411 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:15:18.221411 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:15:18.221411 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:15:18.221411 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:15:18.221411 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:15:18.221411 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:15:18.221411 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:15:18.221411 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:15:18.221411 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:15:18.221411 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 15:15:18.221411 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 15:15:18.221411 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 15:15:18.221411 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 15:15:18.222526 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 15:15:18.222526 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 15:15:18.222526 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 15:15:18.222526 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 15:15:18.222526 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:15:18.222526 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:15:18.222526 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:15:18.222526 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:15:18.222526 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:15:18.222526 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:15:18.222526 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:15:18.222526 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Sep 13 15:15:18.222526 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:15:18.222526 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:15:18.222526 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:15:18.222526 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:15:18.223543 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:15:18.223543 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:15:18.223543 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:15:18.223543 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:15:18.223543 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 15:15:18.223543 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 15:15:18.223543 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 15:15:18.223543 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 15:15:18.223543 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 15:15:18.223543 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 15:15:18.223543 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 15:15:18.223543 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Sep 13 15:15:18.225592 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 180/343] 10.222.0.27 () {56 vars in 1114 bytes} [Tue Sep 13 15:15:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:15:18.228234 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7a09a6-26c5-4cfc-bdfd-1b49d24bb7df None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:18.228713 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7a09a6-26c5-4cfc-bdfd-1b49d24bb7df None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:18.229235 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7a09a6-26c5-4cfc-bdfd-1b49d24bb7df None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:18.231031 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 181/344] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:15:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:15:18.232452 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7a09a6-26c5-4cfc-bdfd-1b49d24bb7df None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:18.251921 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:18.315842 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf5f9da-a560-4841-9be3-8e6260a98641 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:18.317540 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf5f9da-a560-4841-9be3-8e6260a98641 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:18.331082 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:18.357002 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7a09a6-26c5-4cfc-bdfd-1b49d24bb7df None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:18.430772 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8473a622-c87e-4749-8a91-327905cb821f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:18.431257 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8473a622-c87e-4749-8a91-327905cb821f None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:18.431455 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8473a622-c87e-4749-8a91-327905cb821f None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:18.431645 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8473a622-c87e-4749-8a91-327905cb821f None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:18.432311 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8473a622-c87e-4749-8a91-327905cb821f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:15:18.432618 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8473a622-c87e-4749-8a91-327905cb821f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:18.434034 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8473a622-c87e-4749-8a91-327905cb821f None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:18.443648 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 182/345] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Sep 13 15:15:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:15:18.444939 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b415a00c-ce2f-49c8-84f5-a530ca91279b None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:18.445223 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b415a00c-ce2f-49c8-84f5-a530ca91279b None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:18.445508 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b415a00c-ce2f-49c8-84f5-a530ca91279b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:18.465250 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-b415a00c-ce2f-49c8-84f5-a530ca91279b None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:15:18.466553 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-b415a00c-ce2f-49c8-84f5-a530ca91279b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:15:18.474484 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 164/346] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Sep 13 15:15:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 638 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 15:15:18.475601 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf5f9da-a560-4841-9be3-8e6260a98641 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:18.546926 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 183/347] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:15:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 15:15:18.547960 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b415a00c-ce2f-49c8-84f5-a530ca91279b None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:18.555707 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:18.591373 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf5f9da-a560-4841-9be3-8e6260a98641 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:18.634241 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9681569-45a1-4dc8-accd-9cfbb73239f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:18.634633 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:18.634808 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9681569-45a1-4dc8-accd-9cfbb73239f3 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:18.635096 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9681569-45a1-4dc8-accd-9cfbb73239f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:18.635373 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9681569-45a1-4dc8-accd-9cfbb73239f3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:18.651092 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9681569-45a1-4dc8-accd-9cfbb73239f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 15:15:18.657093 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-d9681569-45a1-4dc8-accd-9cfbb73239f3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 15:15:18.657093 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:15:18.657093 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:15:18.657093 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:15:18.657093 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:15:18.657093 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:15:18.657093 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:15:18.657093 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:15:18.657093 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:15:18.657093 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:15:18.657093 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:15:18.657093 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:15:18.657093 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 15:15:18.657093 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 15:15:18.657093 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 15:15:18.657093 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 15:15:18.658087 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 15:15:18.658087 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 15:15:18.658087 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 15:15:18.658087 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 15:15:18.658087 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:15:18.658087 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:15:18.658087 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:15:18.658087 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:15:18.658087 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:15:18.658087 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:15:18.658087 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:15:18.658087 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Sep 13 15:15:18.658087 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:15:18.658087 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:15:18.658087 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:15:18.658087 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:15:18.658895 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:15:18.658895 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:15:18.658895 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:15:18.658895 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:15:18.658895 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 15:15:18.658895 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 15:15:18.658895 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 15:15:18.658895 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 15:15:18.658895 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 15:15:18.658895 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 15:15:18.658895 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 15:15:18.658895 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Sep 13 15:15:18.659533 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 165/348] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Sep 13 15:15:18 2022] GET /identity/v3/roles/reader => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:15:18.660490 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9681569-45a1-4dc8-accd-9cfbb73239f3 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:18.678757 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b415a00c-ce2f-49c8-84f5-a530ca91279b None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:18.715451 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fd8e5e-8201-4b09-9b0a-7ed2f3744194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:18.716093 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fd8e5e-8201-4b09-9b0a-7ed2f3744194 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:18.716362 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fd8e5e-8201-4b09-9b0a-7ed2f3744194 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:18.716643 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fd8e5e-8201-4b09-9b0a-7ed2f3744194 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:18.801211 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fd8e5e-8201-4b09-9b0a-7ed2f3744194 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:18.802969 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fd8e5e-8201-4b09-9b0a-7ed2f3744194 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:18.815173 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9681569-45a1-4dc8-accd-9cfbb73239f3 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:18.855098 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:18.862613 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922b4a67-45a2-4841-806a-a82fe7b1fef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:18.863488 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922b4a67-45a2-4841-806a-a82fe7b1fef6 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:18.864019 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922b4a67-45a2-4841-806a-a82fe7b1fef6 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:18.864548 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922b4a67-45a2-4841-806a-a82fe7b1fef6 None admin] PATH_INFO: `/v3/projects/6cd2be8a8d2a48ce87a8453fb81f9427` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:18.865930 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922b4a67-45a2-4841-806a-a82fe7b1fef6 None admin] RBAC: Authorizing `identity:get_project(project_id=6cd2be8a8d2a48ce87a8453fb81f9427)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:18.868610 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922b4a67-45a2-4841-806a-a82fe7b1fef6 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:18.870942 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 166/349] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Sep 13 15:15:18 2022] GET /identity/v3/projects/6cd2be8a8d2a48ce87a8453fb81f9427 => generated 298 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:15:18.872016 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922b4a67-45a2-4841-806a-a82fe7b1fef6 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:18.889040 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:18.925049 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 184/350] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Sep 13 15:15:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 15:15:18.926136 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fd8e5e-8201-4b09-9b0a-7ed2f3744194 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:18.997652 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922b4a67-45a2-4841-806a-a82fe7b1fef6 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:19.045521 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef7a11b-8af0-480b-b7a1-d89e7171ceaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:19.046184 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef7a11b-8af0-480b-b7a1-d89e7171ceaf None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:19.046489 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef7a11b-8af0-480b-b7a1-d89e7171ceaf None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:19.046769 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef7a11b-8af0-480b-b7a1-d89e7171ceaf None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:19.047440 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef7a11b-8af0-480b-b7a1-d89e7171ceaf None admin] RBAC: Adding query filter params (name=reader) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:15:19.048224 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef7a11b-8af0-480b-b7a1-d89e7171ceaf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:19.049602 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef7a11b-8af0-480b-b7a1-d89e7171ceaf None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:19.060392 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 167/351] 10.222.0.27 () {56 vars in 1101 bytes} [Tue Sep 13 15:15:18 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:15:19.061218 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef7a11b-8af0-480b-b7a1-d89e7171ceaf None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:19.077594 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fd8e5e-8201-4b09-9b0a-7ed2f3744194 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:19.118564 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3767148e-c8dd-49dd-abf8-e420fc82497f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:19.119321 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3767148e-c8dd-49dd-abf8-e420fc82497f None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:19.119672 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3767148e-c8dd-49dd-abf8-e420fc82497f None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:19.120017 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3767148e-c8dd-49dd-abf8-e420fc82497f None admin] PATH_INFO: `/v3/groups/6d9744616b6f4f4b9d4ddca88fb18906` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:19.127181 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3767148e-c8dd-49dd-abf8-e420fc82497f None admin] RBAC: Authorizing `identity:get_group(group_id=6d9744616b6f4f4b9d4ddca88fb18906)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:19.129484 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3767148e-c8dd-49dd-abf8-e420fc82497f None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:19.131687 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 185/352] 10.222.0.27 () {56 vars in 1180 bytes} [Tue Sep 13 15:15:18 2022] GET /identity/v3/groups/6d9744616b6f4f4b9d4ddca88fb18906 => generated 226 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:15:19.133109 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f70c157-0ec7-449c-b2e5-82b99649bae7 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:19.133681 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f70c157-0ec7-449c-b2e5-82b99649bae7 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:19.134004 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f70c157-0ec7-449c-b2e5-82b99649bae7 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:19.135371 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 186/353] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:15:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:15:19.135938 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f70c157-0ec7-449c-b2e5-82b99649bae7 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:19.144083 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:19.193320 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:19.194891 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef7a11b-8af0-480b-b7a1-d89e7171ceaf None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:19.242735 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f536aa-84e4-4d70-9372-54449a0a5e6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:19.244325 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f536aa-84e4-4d70-9372-54449a0a5e6e None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:19.244611 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f536aa-84e4-4d70-9372-54449a0a5e6e None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:19.244889 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f536aa-84e4-4d70-9372-54449a0a5e6e None admin] PATH_INFO: `/v3/projects/6cd2be8a8d2a48ce87a8453fb81f9427` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:19.246105 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f536aa-84e4-4d70-9372-54449a0a5e6e None admin] RBAC: Authorizing `identity:get_project(project_id=6cd2be8a8d2a48ce87a8453fb81f9427)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:19.247564 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f536aa-84e4-4d70-9372-54449a0a5e6e None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:19.249227 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 168/354] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Sep 13 15:15:19 2022] GET /identity/v3/projects/6cd2be8a8d2a48ce87a8453fb81f9427 => generated 298 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:15:19.250039 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f536aa-84e4-4d70-9372-54449a0a5e6e None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:19.293837 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f70c157-0ec7-449c-b2e5-82b99649bae7 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:19.332336 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1268b7-6ad7-404d-845d-a4fca33b3113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:19.332973 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1268b7-6ad7-404d-845d-a4fca33b3113 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:19.333256 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1268b7-6ad7-404d-845d-a4fca33b3113 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:19.333533 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1268b7-6ad7-404d-845d-a4fca33b3113 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:19.357538 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1268b7-6ad7-404d-845d-a4fca33b3113 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 15:15:19.362974 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-fc1268b7-6ad7-404d-845d-a4fca33b3113 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 15:15:19.362974 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:15:19.362974 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:15:19.362974 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:15:19.362974 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:15:19.362974 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:15:19.362974 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:15:19.362974 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:15:19.362974 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:15:19.362974 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:15:19.362974 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:15:19.362974 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:15:19.362974 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 15:15:19.362974 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 15:15:19.362974 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 15:15:19.362974 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 15:15:19.363856 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 15:15:19.363856 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 15:15:19.363856 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 15:15:19.363856 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 15:15:19.363856 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:15:19.363856 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:15:19.363856 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:15:19.363856 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:15:19.363856 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:15:19.363856 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:15:19.363856 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:15:19.363856 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Sep 13 15:15:19.363856 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:15:19.363856 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:15:19.363856 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:15:19.363856 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:15:19.364664 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:15:19.364664 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:15:19.364664 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:15:19.364664 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:15:19.364664 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 15:15:19.364664 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 15:15:19.364664 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 15:15:19.364664 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 15:15:19.364664 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 15:15:19.364664 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 15:15:19.364664 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 15:15:19.364664 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Sep 13 15:15:19.364664 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 187/355] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Sep 13 15:15:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:15:19.365953 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2784cf78-5545-454d-87f7-2645b35f13ba None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:19.369370 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2784cf78-5545-454d-87f7-2645b35f13ba None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:19.369370 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2784cf78-5545-454d-87f7-2645b35f13ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:19.386165 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f536aa-84e4-4d70-9372-54449a0a5e6e None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:19.389410 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-2784cf78-5545-454d-87f7-2645b35f13ba None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:15:19.390713 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-2784cf78-5545-454d-87f7-2645b35f13ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:15:19.426231 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:19.434952 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab33527-a467-43ab-8d85-12b918e4ee6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:19.435905 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab33527-a467-43ab-8d85-12b918e4ee6e None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:19.436407 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab33527-a467-43ab-8d85-12b918e4ee6e None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:19.437011 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab33527-a467-43ab-8d85-12b918e4ee6e None admin] PATH_INFO: `/v3/users/bc8d26b094504c838fe14d2c8e7ddec0` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:19.438434 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab33527-a467-43ab-8d85-12b918e4ee6e None admin] RBAC: Authorizing `identity:get_user(user_id=bc8d26b094504c838fe14d2c8e7ddec0)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:19.440222 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab33527-a467-43ab-8d85-12b918e4ee6e None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:19.442537 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 169/356] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Sep 13 15:15:19 2022] GET /identity/v3/users/bc8d26b094504c838fe14d2c8e7ddec0 => generated 293 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:15:19.442960 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab33527-a467-43ab-8d85-12b918e4ee6e None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:19.471795 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 188/357] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:15:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 15:15:19.473023 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2784cf78-5545-454d-87f7-2645b35f13ba None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:19.500884 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:19.564404 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab33527-a467-43ab-8d85-12b918e4ee6e None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:19.584803 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2784cf78-5545-454d-87f7-2645b35f13ba None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:19.611857 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57ba85a-7c89-4cba-8715-4ebdedfab774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:19.612478 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57ba85a-7c89-4cba-8715-4ebdedfab774 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:19.612765 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57ba85a-7c89-4cba-8715-4ebdedfab774 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:19.613048 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57ba85a-7c89-4cba-8715-4ebdedfab774 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:19.613933 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57ba85a-7c89-4cba-8715-4ebdedfab774 None admin] RBAC: Adding query filter params (group.id=6d9744616b6f4f4b9d4ddca88fb18906, role.id=3fae3d3a28e147d3b2bede2378ff79ae, scope.project.id=6cd2be8a8d2a48ce87a8453fb81f9427) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:15:19.614247 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57ba85a-7c89-4cba-8715-4ebdedfab774 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:19.615901 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57ba85a-7c89-4cba-8715-4ebdedfab774 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:19.622071 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 170/358] 10.222.0.27 () {56 vars in 1376 bytes} [Tue Sep 13 15:15:19 2022] GET /identity/v3/role_assignments?group.id=6d9744616b6f4f4b9d4ddca88fb18906&scope.project.id=6cd2be8a8d2a48ce87a8453fb81f9427&role.id=3fae3d3a28e147d3b2bede2378ff79ae => generated 260 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:15:19.622808 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57ba85a-7c89-4cba-8715-4ebdedfab774 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:19.624367 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a33b64-c2fb-43fc-b799-76d4a8e220cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:19.625078 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a33b64-c2fb-43fc-b799-76d4a8e220cf None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:19.625357 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a33b64-c2fb-43fc-b799-76d4a8e220cf None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:19.625684 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a33b64-c2fb-43fc-b799-76d4a8e220cf None admin] PATH_INFO: `/v3/groups/6d9744616b6f4f4b9d4ddca88fb18906` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:19.626900 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a33b64-c2fb-43fc-b799-76d4a8e220cf None admin] RBAC: Authorizing `identity:get_group(group_id=6d9744616b6f4f4b9d4ddca88fb18906)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:19.628371 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a33b64-c2fb-43fc-b799-76d4a8e220cf None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:19.630413 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 189/359] 10.222.0.27 () {56 vars in 1180 bytes} [Tue Sep 13 15:15:19 2022] GET /identity/v3/groups/6d9744616b6f4f4b9d4ddca88fb18906 => generated 226 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:15:19.631279 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a33b64-c2fb-43fc-b799-76d4a8e220cf None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:19.755828 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:19.762817 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:19.771355 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a33b64-c2fb-43fc-b799-76d4a8e220cf None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:19.809114 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57ba85a-7c89-4cba-8715-4ebdedfab774 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:19.817325 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccbfd5e-57ee-4c8d-b6bf-0ba17054bdcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:19.818017 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccbfd5e-57ee-4c8d-b6bf-0ba17054bdcb None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:19.818262 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccbfd5e-57ee-4c8d-b6bf-0ba17054bdcb None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:19.818533 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccbfd5e-57ee-4c8d-b6bf-0ba17054bdcb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:19.819297 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccbfd5e-57ee-4c8d-b6bf-0ba17054bdcb None admin] RBAC: Adding query filter params (role.id=b43a33bf0d63483a868ced4dfbcc4a6d, user.id=bc8d26b094504c838fe14d2c8e7ddec0, scope.system=all) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:15:19.819613 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccbfd5e-57ee-4c8d-b6bf-0ba17054bdcb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:19.822798 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccbfd5e-57ee-4c8d-b6bf-0ba17054bdcb None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:19.842096 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 190/360] 10.222.0.27 () {56 vars in 1308 bytes} [Tue Sep 13 15:15:19 2022] GET /identity/v3/role_assignments?user.id=bc8d26b094504c838fe14d2c8e7ddec0&scope.system=all&role.id=b43a33bf0d63483a868ced4dfbcc4a6d => generated 510 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:15:19.843718 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e608424-9cbd-49f3-a867-302633cc41fd None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:19.844136 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e608424-9cbd-49f3-a867-302633cc41fd None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:19.844427 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e608424-9cbd-49f3-a867-302633cc41fd None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:19.846494 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 191/361] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:15:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:15:19.847324 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e608424-9cbd-49f3-a867-302633cc41fd None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:19.865594 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2612ee7-7999-4b35-a2ac-260fbcc53649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:19.866389 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2612ee7-7999-4b35-a2ac-260fbcc53649 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:19.866812 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2612ee7-7999-4b35-a2ac-260fbcc53649 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:19.867096 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2612ee7-7999-4b35-a2ac-260fbcc53649 None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:19.868554 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2612ee7-7999-4b35-a2ac-260fbcc53649 None admin] RBAC: Adding query filter params (name=member) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:15:19.868892 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2612ee7-7999-4b35-a2ac-260fbcc53649 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:19.873426 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2612ee7-7999-4b35-a2ac-260fbcc53649 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:19.886830 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 171/362] 10.222.0.27 () {56 vars in 1101 bytes} [Tue Sep 13 15:15:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:15:19.887712 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2612ee7-7999-4b35-a2ac-260fbcc53649 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:20.003432 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e608424-9cbd-49f3-a867-302633cc41fd None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:20.019965 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2612ee7-7999-4b35-a2ac-260fbcc53649 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:20.045408 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49f33a0-5ee2-468b-9a34-1ffaa46ba7c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:20.046059 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49f33a0-5ee2-468b-9a34-1ffaa46ba7c2 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:20.046344 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49f33a0-5ee2-468b-9a34-1ffaa46ba7c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:20.046673 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49f33a0-5ee2-468b-9a34-1ffaa46ba7c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:20.047432 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49f33a0-5ee2-468b-9a34-1ffaa46ba7c2 None admin] RBAC: Adding query filter params (group.id=6d9744616b6f4f4b9d4ddca88fb18906, role.id=5d9c0543f8e04065bb3d8bcd11156c1d, scope.project.id=6cd2be8a8d2a48ce87a8453fb81f9427) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:15:20.047748 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49f33a0-5ee2-468b-9a34-1ffaa46ba7c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:20.049190 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49f33a0-5ee2-468b-9a34-1ffaa46ba7c2 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:20.049850 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:20.056423 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 192/363] 10.222.0.27 () {56 vars in 1376 bytes} [Tue Sep 13 15:15:19 2022] GET /identity/v3/role_assignments?group.id=6d9744616b6f4f4b9d4ddca88fb18906&scope.project.id=6cd2be8a8d2a48ce87a8453fb81f9427&role.id=5d9c0543f8e04065bb3d8bcd11156c1d => generated 260 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:15:20.057674 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55e05cf-ed75-4b27-8802-b81b5bc82687 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:20.062060 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55e05cf-ed75-4b27-8802-b81b5bc82687 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:20.062463 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55e05cf-ed75-4b27-8802-b81b5bc82687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:20.064760 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d5ec3b-b16c-48c2-a455-b8f8c8b16a1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:20.065458 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d5ec3b-b16c-48c2-a455-b8f8c8b16a1b None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:20.065682 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d5ec3b-b16c-48c2-a455-b8f8c8b16a1b None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:20.065982 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d5ec3b-b16c-48c2-a455-b8f8c8b16a1b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:20.080957 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d5ec3b-b16c-48c2-a455-b8f8c8b16a1b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 15:15:20.087774 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-65d5ec3b-b16c-48c2-a455-b8f8c8b16a1b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 15:15:20.087774 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:15:20.087774 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:15:20.087774 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:15:20.087774 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:15:20.087774 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:15:20.087774 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:15:20.087774 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:15:20.087774 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:15:20.087774 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:15:20.087774 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:15:20.087774 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:15:20.087774 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 15:15:20.087774 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 15:15:20.087774 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 15:15:20.087774 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 15:15:20.088751 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 15:15:20.088751 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 15:15:20.088751 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 15:15:20.088751 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 15:15:20.088751 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:15:20.088751 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:15:20.088751 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:15:20.088751 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:15:20.088751 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:15:20.088751 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:15:20.088751 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:15:20.088751 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Sep 13 15:15:20.088751 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:15:20.088751 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:15:20.088751 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:15:20.088751 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:15:20.089605 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:15:20.089605 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:15:20.089605 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:15:20.089605 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:15:20.089605 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 15:15:20.089605 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 15:15:20.089605 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 15:15:20.089605 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 15:15:20.089605 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 15:15:20.089605 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 15:15:20.089605 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 15:15:20.089605 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Sep 13 15:15:20.089605 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 172/364] 10.222.0.27 () {56 vars in 1114 bytes} [Tue Sep 13 15:15:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:15:20.094661 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d5ec3b-b16c-48c2-a455-b8f8c8b16a1b None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:20.109437 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-f55e05cf-ed75-4b27-8802-b81b5bc82687 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:15:20.111021 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-f55e05cf-ed75-4b27-8802-b81b5bc82687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:15:20.127655 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:20.210643 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 193/365] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:15:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 15:15:20.212471 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55e05cf-ed75-4b27-8802-b81b5bc82687 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:20.227238 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d5ec3b-b16c-48c2-a455-b8f8c8b16a1b None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:20.302274 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3131e39f-ad95-43a5-9ecb-8805583683ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:20.303299 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3131e39f-ad95-43a5-9ecb-8805583683ea None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:20.303797 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3131e39f-ad95-43a5-9ecb-8805583683ea None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:20.304272 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3131e39f-ad95-43a5-9ecb-8805583683ea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:20.358079 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55e05cf-ed75-4b27-8802-b81b5bc82687 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:20.382542 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:20.409220 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb81505-08a3-4f69-9c8d-10db882c90fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:20.410217 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb81505-08a3-4f69-9c8d-10db882c90fe None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:20.410699 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb81505-08a3-4f69-9c8d-10db882c90fe None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:20.411190 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb81505-08a3-4f69-9c8d-10db882c90fe None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:20.412107 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb81505-08a3-4f69-9c8d-10db882c90fe None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:15:20.413445 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb81505-08a3-4f69-9c8d-10db882c90fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:20.415220 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb81505-08a3-4f69-9c8d-10db882c90fe None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:20.419740 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3131e39f-ad95-43a5-9ecb-8805583683ea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:20.424225 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3131e39f-ad95-43a5-9ecb-8805583683ea None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:20.434673 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 194/366] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Sep 13 15:15:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:15:20.440578 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb81505-08a3-4f69-9c8d-10db882c90fe None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:20.458496 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:20.613147 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 173/367] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Sep 13 15:15:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 523 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 15:15:20.619128 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3131e39f-ad95-43a5-9ecb-8805583683ea None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:20.624270 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb81505-08a3-4f69-9c8d-10db882c90fe None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:20.685063 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa05998-f692-4987-8e07-e48afc8ebc3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:20.685718 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa05998-f692-4987-8e07-e48afc8ebc3a None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:20.686064 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa05998-f692-4987-8e07-e48afc8ebc3a None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:20.686279 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa05998-f692-4987-8e07-e48afc8ebc3a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:20.754850 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:20.766460 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa05998-f692-4987-8e07-e48afc8ebc3a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:20.767915 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa05998-f692-4987-8e07-e48afc8ebc3a None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:20.776620 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3131e39f-ad95-43a5-9ecb-8805583683ea None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:20.778503 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:20.824513 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c194e6df-113d-4b28-88bf-178985b2d81c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:20.825158 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c194e6df-113d-4b28-88bf-178985b2d81c None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:20.825440 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c194e6df-113d-4b28-88bf-178985b2d81c None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:20.825726 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c194e6df-113d-4b28-88bf-178985b2d81c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:20.837259 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c194e6df-113d-4b28-88bf-178985b2d81c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 15:15:20.843278 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-c194e6df-113d-4b28-88bf-178985b2d81c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 15:15:20.843278 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:15:20.843278 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:15:20.843278 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:15:20.843278 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:15:20.843278 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:15:20.843278 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:15:20.843278 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:15:20.843278 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:15:20.843278 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:15:20.843278 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:15:20.843278 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:15:20.843278 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 15:15:20.843278 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 15:15:20.843278 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 15:15:20.843278 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 15:15:20.844153 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 15:15:20.844153 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 15:15:20.844153 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 15:15:20.844153 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 15:15:20.844153 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:15:20.844153 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:15:20.844153 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:15:20.844153 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:15:20.844153 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:15:20.844153 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:15:20.844153 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:15:20.844153 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Sep 13 15:15:20.844153 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:15:20.844153 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:15:20.844153 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:15:20.844153 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:15:20.844971 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:15:20.844971 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:15:20.844971 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:15:20.844971 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:15:20.844971 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 15:15:20.844971 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 15:15:20.844971 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 15:15:20.844971 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 15:15:20.844971 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 15:15:20.844971 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 15:15:20.844971 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 15:15:20.844971 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Sep 13 15:15:20.844971 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 174/368] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Sep 13 15:15:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:15:20.845614 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c194e6df-113d-4b28-88bf-178985b2d81c None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:20.893265 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 195/369] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Sep 13 15:15:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 15:15:20.894865 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa05998-f692-4987-8e07-e48afc8ebc3a None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:20.985989 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c194e6df-113d-4b28-88bf-178985b2d81c None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:21.012433 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa05998-f692-4987-8e07-e48afc8ebc3a None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:21.024062 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:21.031115 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4d583b-5b52-4613-a6e8-15e81c694b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:21.031306 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4d583b-5b52-4613-a6e8-15e81c694b29 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:21.031565 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4d583b-5b52-4613-a6e8-15e81c694b29 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:21.031843 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4d583b-5b52-4613-a6e8-15e81c694b29 None admin] PATH_INFO: `/v3/projects/bcdaddc5cabe41a8982e616719a29740` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:21.033389 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4d583b-5b52-4613-a6e8-15e81c694b29 None admin] RBAC: Authorizing `identity:get_project(project_id=bcdaddc5cabe41a8982e616719a29740)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:21.035151 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4d583b-5b52-4613-a6e8-15e81c694b29 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:21.037241 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 175/370] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Sep 13 15:15:20 2022] GET /identity/v3/projects/bcdaddc5cabe41a8982e616719a29740 => generated 302 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:15:21.038025 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4d583b-5b52-4613-a6e8-15e81c694b29 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:21.056873 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6ffe1b-5464-4e10-8b53-4d0e6b839a2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:21.057864 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6ffe1b-5464-4e10-8b53-4d0e6b839a2f None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:21.058350 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6ffe1b-5464-4e10-8b53-4d0e6b839a2f None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:21.058849 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6ffe1b-5464-4e10-8b53-4d0e6b839a2f None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:21.059713 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6ffe1b-5464-4e10-8b53-4d0e6b839a2f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:15:21.060219 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6ffe1b-5464-4e10-8b53-4d0e6b839a2f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:21.061811 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6ffe1b-5464-4e10-8b53-4d0e6b839a2f None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:21.070570 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:21.071611 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 196/371] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Sep 13 15:15:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:15:21.072725 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6ffe1b-5464-4e10-8b53-4d0e6b839a2f None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:21.175789 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4d583b-5b52-4613-a6e8-15e81c694b29 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:21.209791 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6ffe1b-5464-4e10-8b53-4d0e6b839a2f None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:21.223782 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76f5b36-f06a-48dd-a651-c625f378a909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:21.224729 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76f5b36-f06a-48dd-a651-c625f378a909 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:21.225014 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76f5b36-f06a-48dd-a651-c625f378a909 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:21.225552 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76f5b36-f06a-48dd-a651-c625f378a909 None admin] PATH_INFO: `/v3/projects/bcdaddc5cabe41a8982e616719a29740` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:21.226709 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76f5b36-f06a-48dd-a651-c625f378a909 None admin] RBAC: Authorizing `identity:get_project(project_id=bcdaddc5cabe41a8982e616719a29740)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:21.229494 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76f5b36-f06a-48dd-a651-c625f378a909 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:21.231798 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 176/372] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Sep 13 15:15:21 2022] GET /identity/v3/projects/bcdaddc5cabe41a8982e616719a29740 => generated 302 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:15:21.238399 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76f5b36-f06a-48dd-a651-c625f378a909 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:21.252730 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bf3902-2c61-40ba-9d2c-922fc7208b4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:21.253540 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bf3902-2c61-40ba-9d2c-922fc7208b4c None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:21.253934 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bf3902-2c61-40ba-9d2c-922fc7208b4c None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:21.254374 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bf3902-2c61-40ba-9d2c-922fc7208b4c None admin] PATH_INFO: `/v3/groups/6d9744616b6f4f4b9d4ddca88fb18906` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:21.255587 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bf3902-2c61-40ba-9d2c-922fc7208b4c None admin] RBAC: Authorizing `identity:get_group(group_id=6d9744616b6f4f4b9d4ddca88fb18906)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:21.257208 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bf3902-2c61-40ba-9d2c-922fc7208b4c None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:21.259480 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 197/373] 10.222.0.27 () {56 vars in 1180 bytes} [Tue Sep 13 15:15:21 2022] GET /identity/v3/groups/6d9744616b6f4f4b9d4ddca88fb18906 => generated 226 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:15:21.260332 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bf3902-2c61-40ba-9d2c-922fc7208b4c None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:21.322466 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:21.340902 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:21.370634 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76f5b36-f06a-48dd-a651-c625f378a909 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:21.409243 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bf3902-2c61-40ba-9d2c-922fc7208b4c None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:21.421219 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24626233-3c3c-4133-923c-90d47d37167e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:21.422225 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24626233-3c3c-4133-923c-90d47d37167e None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:21.422499 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24626233-3c3c-4133-923c-90d47d37167e None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:21.422773 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24626233-3c3c-4133-923c-90d47d37167e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:21.454807 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336b0f2e-7cbb-475f-80d0-b7f953b1bff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:21.455366 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336b0f2e-7cbb-475f-80d0-b7f953b1bff2 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:21.455891 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336b0f2e-7cbb-475f-80d0-b7f953b1bff2 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:21.456172 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336b0f2e-7cbb-475f-80d0-b7f953b1bff2 None admin] PATH_INFO: `/v3/groups/6d9744616b6f4f4b9d4ddca88fb18906` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:21.459741 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336b0f2e-7cbb-475f-80d0-b7f953b1bff2 None admin] RBAC: Authorizing `identity:get_group(group_id=6d9744616b6f4f4b9d4ddca88fb18906)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:21.462502 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336b0f2e-7cbb-475f-80d0-b7f953b1bff2 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:21.465641 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 198/374] 10.222.0.27 () {56 vars in 1180 bytes} [Tue Sep 13 15:15:21 2022] GET /identity/v3/groups/6d9744616b6f4f4b9d4ddca88fb18906 => generated 226 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:15:21.466446 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336b0f2e-7cbb-475f-80d0-b7f953b1bff2 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:21.514375 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24626233-3c3c-4133-923c-90d47d37167e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:21.515939 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24626233-3c3c-4133-923c-90d47d37167e None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:21.606246 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336b0f2e-7cbb-475f-80d0-b7f953b1bff2 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:21.617090 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:21.619803 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:21.643607 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 177/375] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Sep 13 15:15:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 15:15:21.644460 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24626233-3c3c-4133-923c-90d47d37167e None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:21.644793 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fdfb07-0422-4ff5-a7e1-c77766a8126f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:21.651678 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fdfb07-0422-4ff5-a7e1-c77766a8126f None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:21.652164 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fdfb07-0422-4ff5-a7e1-c77766a8126f None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:21.652544 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fdfb07-0422-4ff5-a7e1-c77766a8126f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:21.653414 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fdfb07-0422-4ff5-a7e1-c77766a8126f None admin] RBAC: Adding query filter params (group.id=6d9744616b6f4f4b9d4ddca88fb18906, role.id=3fae3d3a28e147d3b2bede2378ff79ae, scope.project.id=bcdaddc5cabe41a8982e616719a29740) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:15:21.653854 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fdfb07-0422-4ff5-a7e1-c77766a8126f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:21.655456 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fdfb07-0422-4ff5-a7e1-c77766a8126f None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:21.665465 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 199/376] 10.222.0.27 () {56 vars in 1376 bytes} [Tue Sep 13 15:15:21 2022] GET /identity/v3/role_assignments?group.id=6d9744616b6f4f4b9d4ddca88fb18906&scope.project.id=bcdaddc5cabe41a8982e616719a29740&role.id=3fae3d3a28e147d3b2bede2378ff79ae => generated 260 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:15:21.666508 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fdfb07-0422-4ff5-a7e1-c77766a8126f None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:21.779480 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24626233-3c3c-4133-923c-90d47d37167e None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:21.797311 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fdfb07-0422-4ff5-a7e1-c77766a8126f None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:21.834925 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ebfac2-a726-4ffb-b448-0ad247776938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:21.835861 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ebfac2-a726-4ffb-b448-0ad247776938 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:21.836310 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ebfac2-a726-4ffb-b448-0ad247776938 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:21.836706 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ebfac2-a726-4ffb-b448-0ad247776938 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:21.837625 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ebfac2-a726-4ffb-b448-0ad247776938 None admin] RBAC: Adding query filter params (group.id=6d9744616b6f4f4b9d4ddca88fb18906, role.id=5d9c0543f8e04065bb3d8bcd11156c1d, scope.project.id=bcdaddc5cabe41a8982e616719a29740) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:15:21.838062 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ebfac2-a726-4ffb-b448-0ad247776938 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:21.839508 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c09b144-54bb-4e1d-88d1-96ac13b7b491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:21.839792 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ebfac2-a726-4ffb-b448-0ad247776938 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:21.840148 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c09b144-54bb-4e1d-88d1-96ac13b7b491 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:21.840429 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c09b144-54bb-4e1d-88d1-96ac13b7b491 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:21.840707 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c09b144-54bb-4e1d-88d1-96ac13b7b491 None admin] PATH_INFO: `/v3/projects/7edec545f8774b83a9353b60f81fc3c1` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:21.842091 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c09b144-54bb-4e1d-88d1-96ac13b7b491 None admin] RBAC: Authorizing `identity:get_project(project_id=7edec545f8774b83a9353b60f81fc3c1)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:21.844162 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c09b144-54bb-4e1d-88d1-96ac13b7b491 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:21.846540 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 200/377] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Sep 13 15:15:21 2022] GET /identity/v3/projects/7edec545f8774b83a9353b60f81fc3c1 => generated 344 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:15:21.851379 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 178/378] 10.222.0.27 () {56 vars in 1376 bytes} [Tue Sep 13 15:15:21 2022] GET /identity/v3/role_assignments?group.id=6d9744616b6f4f4b9d4ddca88fb18906&scope.project.id=bcdaddc5cabe41a8982e616719a29740&role.id=5d9c0543f8e04065bb3d8bcd11156c1d => generated 260 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:15:21.858041 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c09b144-54bb-4e1d-88d1-96ac13b7b491 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:21.907503 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:21.995993 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c09b144-54bb-4e1d-88d1-96ac13b7b491 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:22.038819 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952c7815-f79f-4c63-a77b-8463ad5ed192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:22.039559 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952c7815-f79f-4c63-a77b-8463ad5ed192 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:22.039844 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952c7815-f79f-4c63-a77b-8463ad5ed192 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:22.040126 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952c7815-f79f-4c63-a77b-8463ad5ed192 None admin] PATH_INFO: `/v3/groups/0321481357744c2fac7c30da9458e530` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:22.045669 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952c7815-f79f-4c63-a77b-8463ad5ed192 None admin] RBAC: Authorizing `identity:get_group(group_id=0321481357744c2fac7c30da9458e530)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:22.047168 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952c7815-f79f-4c63-a77b-8463ad5ed192 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:22.049064 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 201/379] 10.222.0.27 () {56 vars in 1180 bytes} [Tue Sep 13 15:15:21 2022] GET /identity/v3/groups/0321481357744c2fac7c30da9458e530 => generated 229 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:15:22.054860 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ebfac2-a726-4ffb-b448-0ad247776938 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:22.110397 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:22.171806 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ebfac2-a726-4ffb-b448-0ad247776938 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:22.212869 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b40226-a73f-4f61-9eca-9c9ea69ce9a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:22.213931 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b40226-a73f-4f61-9eca-9c9ea69ce9a9 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:22.214417 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b40226-a73f-4f61-9eca-9c9ea69ce9a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:22.214886 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b40226-a73f-4f61-9eca-9c9ea69ce9a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:22.215859 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b40226-a73f-4f61-9eca-9c9ea69ce9a9 None admin] RBAC: Adding query filter params (group.id=0321481357744c2fac7c30da9458e530, role.id=f34412ad29f1478cba775b033129f71f, scope.project.id=7edec545f8774b83a9353b60f81fc3c1) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:15:22.216369 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b40226-a73f-4f61-9eca-9c9ea69ce9a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:22.218031 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b40226-a73f-4f61-9eca-9c9ea69ce9a9 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:22.226348 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c3b8cb-9cbe-4dac-9877-f016b13ca9d5 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:22.226634 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c3b8cb-9cbe-4dac-9877-f016b13ca9d5 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:22.227002 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c3b8cb-9cbe-4dac-9877-f016b13ca9d5 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:22.229898 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 202/380] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:15:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:15:22.230328 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 179/381] 10.222.0.27 () {56 vars in 1376 bytes} [Tue Sep 13 15:15:22 2022] GET /identity/v3/role_assignments?group.id=0321481357744c2fac7c30da9458e530&scope.project.id=7edec545f8774b83a9353b60f81fc3c1&role.id=f34412ad29f1478cba775b033129f71f => generated 260 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:15:22.236066 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517b74da-fc38-40b7-a365-b734ac18c470 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:22.236684 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517b74da-fc38-40b7-a365-b734ac18c470 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:22.237214 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517b74da-fc38-40b7-a365-b734ac18c470 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:22.256964 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-517b74da-fc38-40b7-a365-b734ac18c470 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:15:22.259209 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-517b74da-fc38-40b7-a365-b734ac18c470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:15:22.333676 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 203/382] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:15:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 15:15:22.633991 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b40226-a73f-4f61-9eca-9c9ea69ce9a9 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:22.759962 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b40226-a73f-4f61-9eca-9c9ea69ce9a9 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:22.772696 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:22.810443 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b741279-9cf3-432c-bf61-aef37db2d353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:22.811093 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b741279-9cf3-432c-bf61-aef37db2d353 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:22.811377 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b741279-9cf3-432c-bf61-aef37db2d353 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:22.811654 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b741279-9cf3-432c-bf61-aef37db2d353 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:22.823615 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b741279-9cf3-432c-bf61-aef37db2d353 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 15:15:22.829124 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-6b741279-9cf3-432c-bf61-aef37db2d353 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 15:15:22.829124 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:15:22.829124 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:15:22.829124 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:15:22.829124 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:15:22.829124 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:15:22.829124 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:15:22.829124 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:15:22.829124 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:15:22.829124 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:15:22.829124 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:15:22.829124 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:15:22.829124 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 15:15:22.829124 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 15:15:22.829124 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 15:15:22.829124 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 15:15:22.830076 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 15:15:22.830076 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 15:15:22.830076 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 15:15:22.830076 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 15:15:22.830076 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:15:22.830076 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:15:22.830076 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:15:22.830076 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:15:22.830076 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:15:22.830076 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:15:22.830076 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:15:22.830076 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Sep 13 15:15:22.830076 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:15:22.830076 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:15:22.830076 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:15:22.830076 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:15:22.830861 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:15:22.830861 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:15:22.830861 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:15:22.830861 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:15:22.830861 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 15:15:22.830861 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 15:15:22.830861 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 15:15:22.830861 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 15:15:22.830861 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 15:15:22.830861 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 15:15:22.830861 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 15:15:22.830861 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Sep 13 15:15:22.830861 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 180/383] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Sep 13 15:15:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:15:22.837099 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517b74da-fc38-40b7-a365-b734ac18c470 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:22.873800 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:22.939585 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c679082-cd08-4697-a68b-ea81ad6e1eb7 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:22.939908 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c679082-cd08-4697-a68b-ea81ad6e1eb7 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:22.940128 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c679082-cd08-4697-a68b-ea81ad6e1eb7 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:22.941467 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 181/384] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:15:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 15:15:22.952034 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4064e769-07f9-4170-8feb-27b10945ac4c None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:22.952406 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4064e769-07f9-4170-8feb-27b10945ac4c None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:22.952760 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4064e769-07f9-4170-8feb-27b10945ac4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:22.966660 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517b74da-fc38-40b7-a365-b734ac18c470 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:22.990716 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-4064e769-07f9-4170-8feb-27b10945ac4c None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:15:22.992054 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-4064e769-07f9-4170-8feb-27b10945ac4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:15:23.009168 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c192d569-a7e9-41c0-831b-c6d8d04b3c9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:23.010162 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c192d569-a7e9-41c0-831b-c6d8d04b3c9a None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:23.010624 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c192d569-a7e9-41c0-831b-c6d8d04b3c9a None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:23.011612 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c192d569-a7e9-41c0-831b-c6d8d04b3c9a None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:23.012542 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c192d569-a7e9-41c0-831b-c6d8d04b3c9a None admin] RBAC: Adding query filter params (name=member) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:15:23.013300 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c192d569-a7e9-41c0-831b-c6d8d04b3c9a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:23.015311 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c192d569-a7e9-41c0-831b-c6d8d04b3c9a None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:23.026251 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 204/385] 10.222.0.27 () {56 vars in 1101 bytes} [Tue Sep 13 15:15:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:15:23.032630 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c192d569-a7e9-41c0-831b-c6d8d04b3c9a None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:23.109769 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 182/386] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:15:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 15:15:23.184049 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:23.194864 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c192d569-a7e9-41c0-831b-c6d8d04b3c9a None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:23.237187 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c647e8bd-5788-423e-be62-8cfb2e3d6239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:23.238204 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c647e8bd-5788-423e-be62-8cfb2e3d6239 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:23.238709 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c647e8bd-5788-423e-be62-8cfb2e3d6239 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:23.239181 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c647e8bd-5788-423e-be62-8cfb2e3d6239 None admin] PATH_INFO: `/v3/groups/6d9744616b6f4f4b9d4ddca88fb18906` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:23.240491 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c647e8bd-5788-423e-be62-8cfb2e3d6239 None admin] RBAC: Authorizing `identity:get_group(group_id=6d9744616b6f4f4b9d4ddca88fb18906)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:23.242150 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c647e8bd-5788-423e-be62-8cfb2e3d6239 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:23.244478 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 205/387] 10.222.0.27 () {56 vars in 1180 bytes} [Tue Sep 13 15:15:23 2022] GET /identity/v3/groups/6d9744616b6f4f4b9d4ddca88fb18906 => generated 226 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 15:15:23.250256 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4064e769-07f9-4170-8feb-27b10945ac4c None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:23.355697 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:23.360631 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4064e769-07f9-4170-8feb-27b10945ac4c None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:23.400038 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a58747d-0406-4077-a830-bc58ef876af6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:23.401015 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a58747d-0406-4077-a830-bc58ef876af6 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:23.401520 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a58747d-0406-4077-a830-bc58ef876af6 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:23.402007 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a58747d-0406-4077-a830-bc58ef876af6 None admin] PATH_INFO: `/v3/projects/6cd2be8a8d2a48ce87a8453fb81f9427` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:23.403524 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a58747d-0406-4077-a830-bc58ef876af6 None admin] RBAC: Authorizing `identity:get_project(project_id=6cd2be8a8d2a48ce87a8453fb81f9427)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:23.405230 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a58747d-0406-4077-a830-bc58ef876af6 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:23.407391 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 183/388] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Sep 13 15:15:23 2022] GET /identity/v3/projects/6cd2be8a8d2a48ce87a8453fb81f9427 => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:15:23.413305 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c647e8bd-5788-423e-be62-8cfb2e3d6239 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:23.446833 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a58747d-0406-4077-a830-bc58ef876af6 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:23.529467 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c647e8bd-5788-423e-be62-8cfb2e3d6239 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:23.565796 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c49c59d-12f2-48a4-a2ab-dc630876544b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:23.566461 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c49c59d-12f2-48a4-a2ab-dc630876544b None admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:23.566739 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c49c59d-12f2-48a4-a2ab-dc630876544b None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:23.567010 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c49c59d-12f2-48a4-a2ab-dc630876544b None admin] PATH_INFO: `/v3/projects/6cd2be8a8d2a48ce87a8453fb81f9427/groups/6d9744616b6f4f4b9d4ddca88fb18906/roles/3fae3d3a28e147d3b2bede2378ff79ae` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:23.568573 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a58747d-0406-4077-a830-bc58ef876af6 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:23.568936 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c49c59d-12f2-48a4-a2ab-dc630876544b None admin] RBAC: Authorizing `identity:create_grant(project_id=6cd2be8a8d2a48ce87a8453fb81f9427, group_id=6d9744616b6f4f4b9d4ddca88fb18906, role_id=3fae3d3a28e147d3b2bede2378ff79ae)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:23.570438 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c49c59d-12f2-48a4-a2ab-dc630876544b None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:23.589343 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 206/389] 10.222.0.27 () {58 vars in 1442 bytes} [Tue Sep 13 15:15:23 2022] PUT /identity/v3/projects/6cd2be8a8d2a48ce87a8453fb81f9427/groups/6d9744616b6f4f4b9d4ddca88fb18906/roles/3fae3d3a28e147d3b2bede2378ff79ae => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:15:23.611173 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425280b9-3f79-4dd3-a1bb-924298e3dd25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:23.612186 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425280b9-3f79-4dd3-a1bb-924298e3dd25 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:23.612698 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425280b9-3f79-4dd3-a1bb-924298e3dd25 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:23.613183 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425280b9-3f79-4dd3-a1bb-924298e3dd25 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:23.626992 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425280b9-3f79-4dd3-a1bb-924298e3dd25 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 15:15:23.632874 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-425280b9-3f79-4dd3-a1bb-924298e3dd25 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 15:15:23.632874 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:15:23.632874 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:15:23.632874 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:15:23.632874 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:15:23.632874 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:15:23.632874 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:15:23.632874 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:15:23.632874 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:15:23.632874 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:15:23.632874 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:15:23.632874 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:15:23.632874 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 15:15:23.632874 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 15:15:23.632874 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 15:15:23.632874 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 15:15:23.634066 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 15:15:23.634066 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 15:15:23.634066 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 15:15:23.634066 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 15:15:23.634066 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:15:23.634066 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:15:23.634066 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:15:23.634066 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:15:23.634066 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:15:23.634066 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:15:23.634066 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:15:23.634066 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Sep 13 15:15:23.634066 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:15:23.634066 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:15:23.634066 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:15:23.634066 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:15:23.634966 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:15:23.634966 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:15:23.634966 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:15:23.634966 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:15:23.634966 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 15:15:23.634966 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 15:15:23.634966 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 15:15:23.634966 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 15:15:23.634966 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 15:15:23.634966 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 15:15:23.634966 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 15:15:23.634966 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Sep 13 15:15:23.637789 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 184/390] 10.222.0.27 () {56 vars in 1114 bytes} [Tue Sep 13 15:15:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 15:15:23.644115 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c49c59d-12f2-48a4-a2ab-dc630876544b None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:23.678581 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:23.783726 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c49c59d-12f2-48a4-a2ab-dc630876544b None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:23.822500 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149b4009-4a44-4893-95cc-dd3f8b924b4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:23.823133 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149b4009-4a44-4893-95cc-dd3f8b924b4c None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:23.823414 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149b4009-4a44-4893-95cc-dd3f8b924b4c None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:23.823685 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149b4009-4a44-4893-95cc-dd3f8b924b4c None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:23.824368 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149b4009-4a44-4893-95cc-dd3f8b924b4c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:15:23.824670 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149b4009-4a44-4893-95cc-dd3f8b924b4c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:23.826079 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149b4009-4a44-4893-95cc-dd3f8b924b4c None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:23.835277 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 207/391] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Sep 13 15:15:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:15:23.841208 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425280b9-3f79-4dd3-a1bb-924298e3dd25 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:23.872625 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:23.954590 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425280b9-3f79-4dd3-a1bb-924298e3dd25 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:23.992059 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33878ef-9be4-4ef5-9187-a20a90f6ce44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:23.993342 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33878ef-9be4-4ef5-9187-a20a90f6ce44 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:23.993624 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33878ef-9be4-4ef5-9187-a20a90f6ce44 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:23.993926 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33878ef-9be4-4ef5-9187-a20a90f6ce44 None admin] PATH_INFO: `/v3/groups/6d9744616b6f4f4b9d4ddca88fb18906` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:23.995054 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33878ef-9be4-4ef5-9187-a20a90f6ce44 None admin] RBAC: Authorizing `identity:get_group(group_id=6d9744616b6f4f4b9d4ddca88fb18906)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:23.996648 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33878ef-9be4-4ef5-9187-a20a90f6ce44 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:23.998440 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 185/392] 10.222.0.27 () {56 vars in 1180 bytes} [Tue Sep 13 15:15:23 2022] GET /identity/v3/groups/6d9744616b6f4f4b9d4ddca88fb18906 => generated 226 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:15:24.004897 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149b4009-4a44-4893-95cc-dd3f8b924b4c None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:24.094792 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:24.110526 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149b4009-4a44-4893-95cc-dd3f8b924b4c None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:24.145799 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18c0d06-019e-4434-b2ef-e877ea852d60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:24.146436 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18c0d06-019e-4434-b2ef-e877ea852d60 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:24.146716 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18c0d06-019e-4434-b2ef-e877ea852d60 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:24.146989 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18c0d06-019e-4434-b2ef-e877ea852d60 None admin] PATH_INFO: `/v3/projects/6cd2be8a8d2a48ce87a8453fb81f9427` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:24.148119 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18c0d06-019e-4434-b2ef-e877ea852d60 None admin] RBAC: Authorizing `identity:get_project(project_id=6cd2be8a8d2a48ce87a8453fb81f9427)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:24.150312 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18c0d06-019e-4434-b2ef-e877ea852d60 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:24.151936 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 208/393] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Sep 13 15:15:24 2022] GET /identity/v3/projects/6cd2be8a8d2a48ce87a8453fb81f9427 => generated 298 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:15:24.157630 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33878ef-9be4-4ef5-9187-a20a90f6ce44 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:24.269371 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:24.278831 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33878ef-9be4-4ef5-9187-a20a90f6ce44 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:24.323882 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c01728-ac08-4597-a36c-eabf80fce856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:24.324561 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c01728-ac08-4597-a36c-eabf80fce856 None admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:24.324840 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c01728-ac08-4597-a36c-eabf80fce856 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:24.325112 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c01728-ac08-4597-a36c-eabf80fce856 None admin] PATH_INFO: `/v3/projects/6cd2be8a8d2a48ce87a8453fb81f9427/groups/6d9744616b6f4f4b9d4ddca88fb18906/roles/5d9c0543f8e04065bb3d8bcd11156c1d` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:24.327387 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c01728-ac08-4597-a36c-eabf80fce856 None admin] RBAC: Authorizing `identity:create_grant(project_id=6cd2be8a8d2a48ce87a8453fb81f9427, group_id=6d9744616b6f4f4b9d4ddca88fb18906, role_id=5d9c0543f8e04065bb3d8bcd11156c1d)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:24.328891 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c01728-ac08-4597-a36c-eabf80fce856 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:24.359826 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 186/394] 10.222.0.27 () {58 vars in 1442 bytes} [Tue Sep 13 15:15:24 2022] PUT /identity/v3/projects/6cd2be8a8d2a48ce87a8453fb81f9427/groups/6d9744616b6f4f4b9d4ddca88fb18906/roles/5d9c0543f8e04065bb3d8bcd11156c1d => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:15:24.729815 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eaac62-a069-4a52-ac44-031011809486 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:24.730103 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eaac62-a069-4a52-ac44-031011809486 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:24.730378 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eaac62-a069-4a52-ac44-031011809486 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:24.731841 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 209/395] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:15:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:15:24.737223 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1393dbef-003c-4ba3-aca1-35dbdf6b1ec8 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:24.737510 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1393dbef-003c-4ba3-aca1-35dbdf6b1ec8 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:24.737815 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1393dbef-003c-4ba3-aca1-35dbdf6b1ec8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:24.762328 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-1393dbef-003c-4ba3-aca1-35dbdf6b1ec8 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:15:24.763561 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-1393dbef-003c-4ba3-aca1-35dbdf6b1ec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:15:24.858130 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 187/396] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:15:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 15:15:24.903723 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7694e283-768c-4d86-95f2-828f4db170fa None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:24.904048 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7694e283-768c-4d86-95f2-828f4db170fa None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:24.904266 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7694e283-768c-4d86-95f2-828f4db170fa None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:24.905942 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 210/397] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:15:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:15:24.911021 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8666231-1451-4057-8003-555caffc8b9d None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:24.911549 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8666231-1451-4057-8003-555caffc8b9d None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:24.912046 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8666231-1451-4057-8003-555caffc8b9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:24.935426 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-c8666231-1451-4057-8003-555caffc8b9d None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:15:24.936961 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-c8666231-1451-4057-8003-555caffc8b9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:15:25.025771 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 188/398] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:15:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 15:15:25.172648 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7694e283-768c-4d86-95f2-828f4db170fa None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:25.270145 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ae20b5-9586-4092-8e81-fe59ff197ee3 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:25.270646 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ae20b5-9586-4092-8e81-fe59ff197ee3 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:25.270719 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ae20b5-9586-4092-8e81-fe59ff197ee3 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:25.272280 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 189/399] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:15:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:15:25.277683 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba94fcd9-b351-44c9-9ce6-01ae4a1026fe None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:25.277952 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba94fcd9-b351-44c9-9ce6-01ae4a1026fe None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:25.278235 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba94fcd9-b351-44c9-9ce6-01ae4a1026fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:25.297245 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7694e283-768c-4d86-95f2-828f4db170fa None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:25.298022 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-ba94fcd9-b351-44c9-9ce6-01ae4a1026fe None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:15:25.300402 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-ba94fcd9-b351-44c9-9ce6-01ae4a1026fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:15:25.319783 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:25.356449 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582e71bd-9f44-4fb0-b27c-cbca65ef67f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:25.357094 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582e71bd-9f44-4fb0-b27c-cbca65ef67f5 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:25.357378 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582e71bd-9f44-4fb0-b27c-cbca65ef67f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:25.357660 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582e71bd-9f44-4fb0-b27c-cbca65ef67f5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:25.379019 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582e71bd-9f44-4fb0-b27c-cbca65ef67f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 15:15:25.386883 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-582e71bd-9f44-4fb0-b27c-cbca65ef67f5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 15:15:25.386883 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:15:25.386883 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:15:25.386883 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:15:25.386883 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:15:25.386883 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:15:25.386883 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:15:25.386883 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:15:25.386883 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:15:25.386883 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:15:25.386883 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:15:25.386883 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:15:25.386883 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 15:15:25.386883 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 15:15:25.386883 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 15:15:25.386883 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 15:15:25.387747 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 15:15:25.387747 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 15:15:25.387747 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 15:15:25.387747 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 15:15:25.387747 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:15:25.387747 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:15:25.387747 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:15:25.387747 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:15:25.387747 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:15:25.387747 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:15:25.387747 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:15:25.387747 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Sep 13 15:15:25.387747 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:15:25.387747 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:15:25.387747 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:15:25.387747 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:15:25.388573 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:15:25.388573 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:15:25.388573 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:15:25.388573 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:15:25.388573 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 15:15:25.388573 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 15:15:25.388573 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 15:15:25.388573 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 15:15:25.388573 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 15:15:25.388573 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 15:15:25.388573 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 15:15:25.388573 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Sep 13 15:15:25.389867 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 211/400] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Sep 13 15:15:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:15:25.391790 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582e71bd-9f44-4fb0-b27c-cbca65ef67f5 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:25.412797 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:25.416741 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 190/401] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:15:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 15:15:25.422024 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba94fcd9-b351-44c9-9ce6-01ae4a1026fe None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:25.593288 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582e71bd-9f44-4fb0-b27c-cbca65ef67f5 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:25.611398 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba94fcd9-b351-44c9-9ce6-01ae4a1026fe None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:25.662061 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df19d1a6-0f42-4090-bdbd-7138f5de4a21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:25.662701 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df19d1a6-0f42-4090-bdbd-7138f5de4a21 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:25.662982 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df19d1a6-0f42-4090-bdbd-7138f5de4a21 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:25.663256 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df19d1a6-0f42-4090-bdbd-7138f5de4a21 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:25.677380 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65b5351-0c54-4540-ab16-07e9c7362627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:25.678040 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65b5351-0c54-4540-ab16-07e9c7362627 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:25.678323 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65b5351-0c54-4540-ab16-07e9c7362627 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:25.678594 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65b5351-0c54-4540-ab16-07e9c7362627 None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:25.679285 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65b5351-0c54-4540-ab16-07e9c7362627 None admin] RBAC: Adding query filter params (name=member) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:15:25.679592 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65b5351-0c54-4540-ab16-07e9c7362627 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:25.681556 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65b5351-0c54-4540-ab16-07e9c7362627 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:25.687393 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df19d1a6-0f42-4090-bdbd-7138f5de4a21 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 15:15:25.693557 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-df19d1a6-0f42-4090-bdbd-7138f5de4a21 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 15:15:25.693557 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:15:25.693557 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:15:25.693557 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:15:25.693557 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:15:25.693557 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:15:25.693557 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:15:25.693557 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:15:25.693557 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:15:25.693557 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:15:25.693557 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:15:25.693557 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:15:25.693557 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 15:15:25.693557 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 15:15:25.693557 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 15:15:25.693557 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 15:15:25.694712 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 15:15:25.694712 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 15:15:25.694712 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 15:15:25.694712 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 15:15:25.694712 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:15:25.694712 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:15:25.694712 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:15:25.694712 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:15:25.694712 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:15:25.694712 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:15:25.694712 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:15:25.694712 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Sep 13 15:15:25.694712 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:15:25.694712 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:15:25.694712 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:15:25.694712 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:15:25.696293 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:15:25.696293 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:15:25.696293 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:15:25.696293 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:15:25.696293 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 15:15:25.696293 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 15:15:25.696293 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 15:15:25.696293 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 15:15:25.696293 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 15:15:25.696293 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 15:15:25.696293 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 15:15:25.696293 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Sep 13 15:15:25.696293 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 212/402] 10.222.0.27 () {56 vars in 1114 bytes} [Tue Sep 13 15:15:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:15:25.702083 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 191/403] 10.222.0.27 () {56 vars in 1101 bytes} [Tue Sep 13 15:15:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:15:25.703439 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df19d1a6-0f42-4090-bdbd-7138f5de4a21 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:25.705082 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65b5351-0c54-4540-ab16-07e9c7362627 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:25.723287 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:25.799456 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:25.829743 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65b5351-0c54-4540-ab16-07e9c7362627 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:25.840618 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df19d1a6-0f42-4090-bdbd-7138f5de4a21 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:25.869479 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c60e80-ebe5-4a9c-996a-3b64917dd70c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:25.870070 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c60e80-ebe5-4a9c-996a-3b64917dd70c None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:25.870349 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c60e80-ebe5-4a9c-996a-3b64917dd70c None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:25.870621 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c60e80-ebe5-4a9c-996a-3b64917dd70c None admin] PATH_INFO: `/v3/groups/6d9744616b6f4f4b9d4ddca88fb18906` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:25.871798 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c60e80-ebe5-4a9c-996a-3b64917dd70c None admin] RBAC: Authorizing `identity:get_group(group_id=6d9744616b6f4f4b9d4ddca88fb18906)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:25.873387 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c60e80-ebe5-4a9c-996a-3b64917dd70c None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:25.875881 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 192/404] 10.222.0.27 () {56 vars in 1180 bytes} [Tue Sep 13 15:15:25 2022] GET /identity/v3/groups/6d9744616b6f4f4b9d4ddca88fb18906 => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 15:15:25.876645 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c60e80-ebe5-4a9c-996a-3b64917dd70c None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:25.892470 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946e0460-5152-43df-a372-b760005946ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:25.893089 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946e0460-5152-43df-a372-b760005946ad None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:25.893368 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946e0460-5152-43df-a372-b760005946ad None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:25.893927 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946e0460-5152-43df-a372-b760005946ad None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:25.895067 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946e0460-5152-43df-a372-b760005946ad None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:15:25.895386 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946e0460-5152-43df-a372-b760005946ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:25.897036 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946e0460-5152-43df-a372-b760005946ad None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:25.908889 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 213/405] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Sep 13 15:15:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:15:25.909961 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946e0460-5152-43df-a372-b760005946ad None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:25.964200 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:25.994241 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c60e80-ebe5-4a9c-996a-3b64917dd70c None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:26.034449 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d2288f-9068-4a84-a6b8-deb69412fe83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:26.035258 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d2288f-9068-4a84-a6b8-deb69412fe83 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:26.035636 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d2288f-9068-4a84-a6b8-deb69412fe83 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:26.036007 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d2288f-9068-4a84-a6b8-deb69412fe83 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:26.039909 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946e0460-5152-43df-a372-b760005946ad None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:26.048616 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d2288f-9068-4a84-a6b8-deb69412fe83 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 15:15:26.055632 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-d8d2288f-9068-4a84-a6b8-deb69412fe83 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 15:15:26.055632 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:15:26.055632 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:15:26.055632 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:15:26.055632 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:15:26.055632 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:15:26.055632 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:15:26.055632 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:15:26.055632 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:15:26.055632 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:15:26.055632 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:15:26.055632 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:15:26.055632 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 15:15:26.055632 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 15:15:26.055632 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 15:15:26.055632 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 15:15:26.056656 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 15:15:26.056656 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 15:15:26.056656 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 15:15:26.056656 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 15:15:26.056656 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:15:26.056656 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:15:26.056656 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:15:26.056656 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:15:26.056656 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:15:26.056656 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:15:26.056656 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:15:26.056656 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Sep 13 15:15:26.056656 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:15:26.056656 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:15:26.056656 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:15:26.056656 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:15:26.057480 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:15:26.057480 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:15:26.057480 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:15:26.057480 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:15:26.057480 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 15:15:26.057480 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 15:15:26.057480 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 15:15:26.057480 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 15:15:26.057480 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 15:15:26.057480 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 15:15:26.057480 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 15:15:26.057480 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Sep 13 15:15:26.058268 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 193/406] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Sep 13 15:15:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:15:26.059031 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d2288f-9068-4a84-a6b8-deb69412fe83 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:26.091193 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804d2c5c-e7f1-44e2-96d3-9b9bb78136c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:26.091193 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804d2c5c-e7f1-44e2-96d3-9b9bb78136c4 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:26.091193 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804d2c5c-e7f1-44e2-96d3-9b9bb78136c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:26.091193 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804d2c5c-e7f1-44e2-96d3-9b9bb78136c4 None admin] PATH_INFO: `/v3/projects/bcdaddc5cabe41a8982e616719a29740` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:26.091594 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804d2c5c-e7f1-44e2-96d3-9b9bb78136c4 None admin] RBAC: Authorizing `identity:get_project(project_id=bcdaddc5cabe41a8982e616719a29740)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:26.091594 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804d2c5c-e7f1-44e2-96d3-9b9bb78136c4 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:26.094190 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 214/407] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Sep 13 15:15:25 2022] GET /identity/v3/projects/bcdaddc5cabe41a8982e616719a29740 => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:15:26.095058 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804d2c5c-e7f1-44e2-96d3-9b9bb78136c4 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:26.098782 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:26.166698 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d2288f-9068-4a84-a6b8-deb69412fe83 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:26.213310 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a92fadb-fcc8-4dc4-b547-01ee6fe6fb86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:26.213963 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a92fadb-fcc8-4dc4-b547-01ee6fe6fb86 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:26.214244 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a92fadb-fcc8-4dc4-b547-01ee6fe6fb86 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:26.214513 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a92fadb-fcc8-4dc4-b547-01ee6fe6fb86 None admin] PATH_INFO: `/v3/groups/6d9744616b6f4f4b9d4ddca88fb18906` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:26.215638 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a92fadb-fcc8-4dc4-b547-01ee6fe6fb86 None admin] RBAC: Authorizing `identity:get_group(group_id=6d9744616b6f4f4b9d4ddca88fb18906)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:26.217190 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a92fadb-fcc8-4dc4-b547-01ee6fe6fb86 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:26.218968 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 194/408] 10.222.0.27 () {56 vars in 1180 bytes} [Tue Sep 13 15:15:26 2022] GET /identity/v3/groups/6d9744616b6f4f4b9d4ddca88fb18906 => generated 226 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:15:26.219759 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a92fadb-fcc8-4dc4-b547-01ee6fe6fb86 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:26.222431 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:26.229573 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804d2c5c-e7f1-44e2-96d3-9b9bb78136c4 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:26.279038 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d277a3b-13dc-4ef2-bb0f-413d8a814d8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:26.280277 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d277a3b-13dc-4ef2-bb0f-413d8a814d8c None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:26.280996 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d277a3b-13dc-4ef2-bb0f-413d8a814d8c None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:26.281505 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d277a3b-13dc-4ef2-bb0f-413d8a814d8c None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:26.282951 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d277a3b-13dc-4ef2-bb0f-413d8a814d8c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:15:26.283504 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d277a3b-13dc-4ef2-bb0f-413d8a814d8c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:26.285907 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d277a3b-13dc-4ef2-bb0f-413d8a814d8c None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:26.302808 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 215/409] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Sep 13 15:15:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:15:26.304122 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d277a3b-13dc-4ef2-bb0f-413d8a814d8c None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:26.329611 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a92fadb-fcc8-4dc4-b547-01ee6fe6fb86 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:26.365912 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39488668-5fa9-4098-be32-a96d89b0e4b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:26.366640 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39488668-5fa9-4098-be32-a96d89b0e4b6 None admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:26.367705 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39488668-5fa9-4098-be32-a96d89b0e4b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:26.367968 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39488668-5fa9-4098-be32-a96d89b0e4b6 None admin] PATH_INFO: `/v3/projects/bcdaddc5cabe41a8982e616719a29740/groups/6d9744616b6f4f4b9d4ddca88fb18906/roles/3fae3d3a28e147d3b2bede2378ff79ae` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:26.370300 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39488668-5fa9-4098-be32-a96d89b0e4b6 None admin] RBAC: Authorizing `identity:create_grant(project_id=bcdaddc5cabe41a8982e616719a29740, group_id=6d9744616b6f4f4b9d4ddca88fb18906, role_id=3fae3d3a28e147d3b2bede2378ff79ae)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:26.371767 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39488668-5fa9-4098-be32-a96d89b0e4b6 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:26.387669 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:26.388099 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 195/410] 10.222.0.27 () {58 vars in 1442 bytes} [Tue Sep 13 15:15:26 2022] PUT /identity/v3/projects/bcdaddc5cabe41a8982e616719a29740/groups/6d9744616b6f4f4b9d4ddca88fb18906/roles/3fae3d3a28e147d3b2bede2378ff79ae => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:15:26.389064 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39488668-5fa9-4098-be32-a96d89b0e4b6 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:26.433798 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d277a3b-13dc-4ef2-bb0f-413d8a814d8c None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:26.464974 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:26.473189 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7ec0d7-39d9-45b5-bf52-a8a8ffa62147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:26.474213 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7ec0d7-39d9-45b5-bf52-a8a8ffa62147 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:26.474733 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7ec0d7-39d9-45b5-bf52-a8a8ffa62147 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:26.475217 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7ec0d7-39d9-45b5-bf52-a8a8ffa62147 None admin] PATH_INFO: `/v3/projects/bcdaddc5cabe41a8982e616719a29740` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:26.477433 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7ec0d7-39d9-45b5-bf52-a8a8ffa62147 None admin] RBAC: Authorizing `identity:get_project(project_id=bcdaddc5cabe41a8982e616719a29740)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:26.479259 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7ec0d7-39d9-45b5-bf52-a8a8ffa62147 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:26.481339 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 216/411] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Sep 13 15:15:26 2022] GET /identity/v3/projects/bcdaddc5cabe41a8982e616719a29740 => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:15:26.491004 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7ec0d7-39d9-45b5-bf52-a8a8ffa62147 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:26.514915 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39488668-5fa9-4098-be32-a96d89b0e4b6 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:26.560715 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671fc4b0-4b3c-4ba0-aed4-89c195f774da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:26.561376 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671fc4b0-4b3c-4ba0-aed4-89c195f774da None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:26.561656 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671fc4b0-4b3c-4ba0-aed4-89c195f774da None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:26.561956 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671fc4b0-4b3c-4ba0-aed4-89c195f774da None admin] PATH_INFO: `/v3/groups/0321481357744c2fac7c30da9458e530` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:26.564378 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671fc4b0-4b3c-4ba0-aed4-89c195f774da None admin] RBAC: Authorizing `identity:get_group(group_id=0321481357744c2fac7c30da9458e530)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:26.565882 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671fc4b0-4b3c-4ba0-aed4-89c195f774da None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:26.567550 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 196/412] 10.222.0.27 () {56 vars in 1180 bytes} [Tue Sep 13 15:15:26 2022] GET /identity/v3/groups/0321481357744c2fac7c30da9458e530 => generated 229 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:15:26.575528 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671fc4b0-4b3c-4ba0-aed4-89c195f774da None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:26.664224 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7ec0d7-39d9-45b5-bf52-a8a8ffa62147 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:26.700966 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:26.707264 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d76edc-7b49-40cd-9d97-04bb6d96fc36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:26.708007 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d76edc-7b49-40cd-9d97-04bb6d96fc36 None admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:26.708294 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d76edc-7b49-40cd-9d97-04bb6d96fc36 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:26.708571 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d76edc-7b49-40cd-9d97-04bb6d96fc36 None admin] PATH_INFO: `/v3/projects/bcdaddc5cabe41a8982e616719a29740/groups/6d9744616b6f4f4b9d4ddca88fb18906/roles/5d9c0543f8e04065bb3d8bcd11156c1d` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:26.711801 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d76edc-7b49-40cd-9d97-04bb6d96fc36 None admin] RBAC: Authorizing `identity:create_grant(project_id=bcdaddc5cabe41a8982e616719a29740, group_id=6d9744616b6f4f4b9d4ddca88fb18906, role_id=5d9c0543f8e04065bb3d8bcd11156c1d)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:26.713597 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d76edc-7b49-40cd-9d97-04bb6d96fc36 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:26.723273 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671fc4b0-4b3c-4ba0-aed4-89c195f774da None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:26.735414 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 217/413] 10.222.0.27 () {58 vars in 1442 bytes} [Tue Sep 13 15:15:26 2022] PUT /identity/v3/projects/bcdaddc5cabe41a8982e616719a29740/groups/6d9744616b6f4f4b9d4ddca88fb18906/roles/5d9c0543f8e04065bb3d8bcd11156c1d => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:15:26.742748 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6572775d-e60d-4106-af09-84eb2af61369 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:26.742748 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6572775d-e60d-4106-af09-84eb2af61369 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:26.742748 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6572775d-e60d-4106-af09-84eb2af61369 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:26.742748 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 218/414] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:15:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:15:26.747550 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8d7ae1-c6fb-4cdb-baee-68ecbabfcff0 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:26.747855 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8d7ae1-c6fb-4cdb-baee-68ecbabfcff0 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:26.748111 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8d7ae1-c6fb-4cdb-baee-68ecbabfcff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:26.781871 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:26.786682 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-ec8d7ae1-c6fb-4cdb-baee-68ecbabfcff0 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:15:26.787926 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-ec8d7ae1-c6fb-4cdb-baee-68ecbabfcff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:15:26.794157 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81db5be4-f527-422c-b18f-9b5e1a16c66b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:26.794822 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81db5be4-f527-422c-b18f-9b5e1a16c66b None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:26.795111 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81db5be4-f527-422c-b18f-9b5e1a16c66b None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:26.795395 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81db5be4-f527-422c-b18f-9b5e1a16c66b None admin] PATH_INFO: `/v3/projects/7edec545f8774b83a9353b60f81fc3c1` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:26.796565 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81db5be4-f527-422c-b18f-9b5e1a16c66b None admin] RBAC: Authorizing `identity:get_project(project_id=7edec545f8774b83a9353b60f81fc3c1)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:26.798060 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81db5be4-f527-422c-b18f-9b5e1a16c66b None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:26.799727 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 197/415] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Sep 13 15:15:26 2022] GET /identity/v3/projects/7edec545f8774b83a9353b60f81fc3c1 => generated 344 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:15:26.807808 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81db5be4-f527-422c-b18f-9b5e1a16c66b None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:26.934913 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 219/416] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:15:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 15:15:26.979764 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81db5be4-f527-422c-b18f-9b5e1a16c66b None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:27.018926 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190f7779-3b35-41c5-8c7a-484f2dc6af9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:27.019619 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190f7779-3b35-41c5-8c7a-484f2dc6af9a None admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:27.019909 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190f7779-3b35-41c5-8c7a-484f2dc6af9a None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:27.020195 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190f7779-3b35-41c5-8c7a-484f2dc6af9a None admin] PATH_INFO: `/v3/projects/7edec545f8774b83a9353b60f81fc3c1/groups/0321481357744c2fac7c30da9458e530/roles/f34412ad29f1478cba775b033129f71f` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:27.022254 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190f7779-3b35-41c5-8c7a-484f2dc6af9a None admin] RBAC: Authorizing `identity:create_grant(project_id=7edec545f8774b83a9353b60f81fc3c1, group_id=0321481357744c2fac7c30da9458e530, role_id=f34412ad29f1478cba775b033129f71f)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:27.023839 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190f7779-3b35-41c5-8c7a-484f2dc6af9a None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:27.041223 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 198/417] 10.222.0.27 () {58 vars in 1442 bytes} [Tue Sep 13 15:15:26 2022] PUT /identity/v3/projects/7edec545f8774b83a9353b60f81fc3c1/groups/0321481357744c2fac7c30da9458e530/roles/f34412ad29f1478cba775b033129f71f => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:15:27.151155 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52cc665-783d-4ed9-a72a-8837e976ace9 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:27.151491 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52cc665-783d-4ed9-a72a-8837e976ace9 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:27.151779 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52cc665-783d-4ed9-a72a-8837e976ace9 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:27.153437 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 220/418] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:15:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:15:27.158919 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdf8c1c-45e3-42e2-b3e2-80215d7aa75f None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:27.159212 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdf8c1c-45e3-42e2-b3e2-80215d7aa75f None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:27.159497 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdf8c1c-45e3-42e2-b3e2-80215d7aa75f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:27.179184 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-6bdf8c1c-45e3-42e2-b3e2-80215d7aa75f None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:15:27.181012 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-6bdf8c1c-45e3-42e2-b3e2-80215d7aa75f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:15:27.254565 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52cc665-783d-4ed9-a72a-8837e976ace9 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:27.261036 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:27.287073 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 199/419] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:15:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 15:15:27.386723 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52cc665-783d-4ed9-a72a-8837e976ace9 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:27.415526 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:27.429308 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312d61eb-c100-4bc0-9733-0b0507f89096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:27.430510 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312d61eb-c100-4bc0-9733-0b0507f89096 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:27.430859 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312d61eb-c100-4bc0-9733-0b0507f89096 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:27.431249 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312d61eb-c100-4bc0-9733-0b0507f89096 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:27.450334 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312d61eb-c100-4bc0-9733-0b0507f89096 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 15:15:27.455550 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-312d61eb-c100-4bc0-9733-0b0507f89096 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 15:15:27.455550 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:15:27.455550 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:15:27.455550 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:15:27.455550 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:15:27.455550 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:15:27.455550 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:15:27.455550 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:15:27.455550 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:15:27.455550 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:15:27.455550 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:15:27.455550 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:15:27.455550 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 15:15:27.455550 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 15:15:27.455550 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 15:15:27.455550 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 15:15:27.456489 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 15:15:27.456489 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 15:15:27.456489 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 15:15:27.456489 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 15:15:27.456489 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:15:27.456489 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:15:27.456489 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:15:27.456489 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:15:27.456489 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:15:27.456489 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:15:27.456489 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:15:27.456489 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Sep 13 15:15:27.456489 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:15:27.456489 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:15:27.456489 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:15:27.456489 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:15:27.457301 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:15:27.457301 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:15:27.457301 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:15:27.457301 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:15:27.457301 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 15:15:27.457301 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 15:15:27.457301 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 15:15:27.457301 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 15:15:27.457301 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 15:15:27.457301 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 15:15:27.457301 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 15:15:27.457301 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Sep 13 15:15:27.457301 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 221/420] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Sep 13 15:15:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:15:27.463802 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdf8c1c-45e3-42e2-b3e2-80215d7aa75f None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:27.585075 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdf8c1c-45e3-42e2-b3e2-80215d7aa75f None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:27.625142 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479e17ee-12ab-4c06-9d80-8f8d4b5c5553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:27.626179 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479e17ee-12ab-4c06-9d80-8f8d4b5c5553 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:27.626664 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479e17ee-12ab-4c06-9d80-8f8d4b5c5553 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:27.627133 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479e17ee-12ab-4c06-9d80-8f8d4b5c5553 None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:27.627992 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479e17ee-12ab-4c06-9d80-8f8d4b5c5553 None admin] RBAC: Adding query filter params (name=member) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:15:27.628514 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479e17ee-12ab-4c06-9d80-8f8d4b5c5553 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:27.630103 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479e17ee-12ab-4c06-9d80-8f8d4b5c5553 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:27.643725 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 200/421] 10.222.0.27 () {56 vars in 1101 bytes} [Tue Sep 13 15:15:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:15:27.649210 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312d61eb-c100-4bc0-9733-0b0507f89096 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:27.801784 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479e17ee-12ab-4c06-9d80-8f8d4b5c5553 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:27.814130 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312d61eb-c100-4bc0-9733-0b0507f89096 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:27.862090 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5ee661-6f58-411f-88f7-aa5d4ced4726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:27.862628 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5ee661-6f58-411f-88f7-aa5d4ced4726 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:27.862906 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5ee661-6f58-411f-88f7-aa5d4ced4726 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:27.863177 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5ee661-6f58-411f-88f7-aa5d4ced4726 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:27.898784 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:27.978097 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:27.986939 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479e17ee-12ab-4c06-9d80-8f8d4b5c5553 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:28.002392 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5ee661-6f58-411f-88f7-aa5d4ced4726 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:28.004055 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5ee661-6f58-411f-88f7-aa5d4ced4726 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:28.054879 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0decf31f-19b8-4153-9472-4326f9854b40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:28.055529 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0decf31f-19b8-4153-9472-4326f9854b40 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:28.055813 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0decf31f-19b8-4153-9472-4326f9854b40 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:28.056088 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0decf31f-19b8-4153-9472-4326f9854b40 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:28.080275 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0decf31f-19b8-4153-9472-4326f9854b40 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 15:15:28.092016 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-0decf31f-19b8-4153-9472-4326f9854b40 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 15:15:28.092016 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:15:28.092016 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:15:28.092016 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:15:28.092016 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:15:28.092016 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:15:28.092016 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:15:28.092016 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:15:28.092016 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:15:28.092016 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:15:28.092016 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:15:28.092016 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:15:28.092016 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 15:15:28.092016 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 15:15:28.092016 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 15:15:28.092016 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 15:15:28.092938 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 15:15:28.092938 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 15:15:28.092938 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 15:15:28.092938 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 15:15:28.092938 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:15:28.092938 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:15:28.092938 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:15:28.092938 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:15:28.092938 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:15:28.092938 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:15:28.092938 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:15:28.092938 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Sep 13 15:15:28.092938 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:15:28.092938 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:15:28.092938 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:15:28.092938 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:15:28.093778 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:15:28.093778 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:15:28.093778 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:15:28.093778 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:15:28.093778 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 15:15:28.093778 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 15:15:28.093778 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 15:15:28.093778 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 15:15:28.093778 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 15:15:28.093778 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 15:15:28.093778 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 15:15:28.093778 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Sep 13 15:15:28.094405 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 201/422] 10.222.0.27 () {56 vars in 1114 bytes} [Tue Sep 13 15:15:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:15:28.099529 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0decf31f-19b8-4153-9472-4326f9854b40 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:28.202963 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 222/423] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Sep 13 15:15:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 554 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 15:15:28.211197 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5ee661-6f58-411f-88f7-aa5d4ced4726 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:28.244051 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0decf31f-19b8-4153-9472-4326f9854b40 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:28.270222 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:28.315223 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a7bd26-9e69-438c-afa1-55de916cf68c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:28.315836 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a7bd26-9e69-438c-afa1-55de916cf68c None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:28.316115 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a7bd26-9e69-438c-afa1-55de916cf68c None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:28.316383 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a7bd26-9e69-438c-afa1-55de916cf68c None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:28.317045 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a7bd26-9e69-438c-afa1-55de916cf68c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:15:28.317346 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a7bd26-9e69-438c-afa1-55de916cf68c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:28.318745 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a7bd26-9e69-438c-afa1-55de916cf68c None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:28.341021 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 202/424] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Sep 13 15:15:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 15:15:28.344698 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a7bd26-9e69-438c-afa1-55de916cf68c None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:28.376799 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:28.411578 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5ee661-6f58-411f-88f7-aa5d4ced4726 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:28.475686 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b12105-5cf0-414e-933b-7c27aafeda79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:28.476240 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b12105-5cf0-414e-933b-7c27aafeda79 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:28.477114 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b12105-5cf0-414e-933b-7c27aafeda79 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:28.477604 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b12105-5cf0-414e-933b-7c27aafeda79 None admin] PATH_INFO: `/v3/projects/6cd2be8a8d2a48ce87a8453fb81f9427` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:28.480139 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b12105-5cf0-414e-933b-7c27aafeda79 None admin] RBAC: Authorizing `identity:get_project(project_id=6cd2be8a8d2a48ce87a8453fb81f9427)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:28.482485 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b12105-5cf0-414e-933b-7c27aafeda79 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:28.485345 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 223/425] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Sep 13 15:15:28 2022] GET /identity/v3/projects/6cd2be8a8d2a48ce87a8453fb81f9427 => generated 298 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:15:28.491265 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b12105-5cf0-414e-933b-7c27aafeda79 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:28.513169 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a7bd26-9e69-438c-afa1-55de916cf68c None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:28.589774 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57539324-8c3b-4231-9583-68c0dd9dd2ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:28.590775 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57539324-8c3b-4231-9583-68c0dd9dd2ad None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:28.591260 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57539324-8c3b-4231-9583-68c0dd9dd2ad None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:28.591760 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57539324-8c3b-4231-9583-68c0dd9dd2ad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:28.615797 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b12105-5cf0-414e-933b-7c27aafeda79 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:28.668061 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c06713-638f-49a9-96e5-0763414e6419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:28.668698 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c06713-638f-49a9-96e5-0763414e6419 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:28.668979 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c06713-638f-49a9-96e5-0763414e6419 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:28.669250 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c06713-638f-49a9-96e5-0763414e6419 None admin] PATH_INFO: `/v3/groups/6d9744616b6f4f4b9d4ddca88fb18906` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:28.670404 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c06713-638f-49a9-96e5-0763414e6419 None admin] RBAC: Authorizing `identity:get_group(group_id=6d9744616b6f4f4b9d4ddca88fb18906)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:28.671920 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c06713-638f-49a9-96e5-0763414e6419 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:28.673803 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 224/426] 10.222.0.27 () {56 vars in 1180 bytes} [Tue Sep 13 15:15:28 2022] GET /identity/v3/groups/6d9744616b6f4f4b9d4ddca88fb18906 => generated 226 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:15:28.684524 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c06713-638f-49a9-96e5-0763414e6419 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:28.686798 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:28.728813 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:28.733910 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57539324-8c3b-4231-9583-68c0dd9dd2ad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:28.735388 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57539324-8c3b-4231-9583-68c0dd9dd2ad None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:28.859022 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c06713-638f-49a9-96e5-0763414e6419 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:28.906379 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a44402f-2a40-480f-ba75-046602561d15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:28.907061 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a44402f-2a40-480f-ba75-046602561d15 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:28.907342 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a44402f-2a40-480f-ba75-046602561d15 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:28.907621 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a44402f-2a40-480f-ba75-046602561d15 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:28.908483 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a44402f-2a40-480f-ba75-046602561d15 None admin] RBAC: Adding query filter params (group.id=6d9744616b6f4f4b9d4ddca88fb18906, role.id=3fae3d3a28e147d3b2bede2378ff79ae, scope.project.id=6cd2be8a8d2a48ce87a8453fb81f9427) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:15:28.908797 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a44402f-2a40-480f-ba75-046602561d15 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:28.911018 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a44402f-2a40-480f-ba75-046602561d15 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:28.918088 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 225/427] 10.222.0.27 () {56 vars in 1376 bytes} [Tue Sep 13 15:15:28 2022] GET /identity/v3/role_assignments?group.id=6d9744616b6f4f4b9d4ddca88fb18906&scope.project.id=6cd2be8a8d2a48ce87a8453fb81f9427&role.id=3fae3d3a28e147d3b2bede2378ff79ae => generated 611 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:15:28.962054 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 203/428] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Sep 13 15:15:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 617 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 15:15:28.970887 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a44402f-2a40-480f-ba75-046602561d15 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:29.059409 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea3e459-0a48-4ab5-982f-89ade63c85ba None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:29.059696 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea3e459-0a48-4ab5-982f-89ade63c85ba None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:29.059863 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea3e459-0a48-4ab5-982f-89ade63c85ba None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:29.061534 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 204/429] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:15:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:15:29.067009 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56b82c9-5bda-4029-be90-6588ecef17c2 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:29.067283 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56b82c9-5bda-4029-be90-6588ecef17c2 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:29.067553 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56b82c9-5bda-4029-be90-6588ecef17c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:29.086861 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:29.087941 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-c56b82c9-5bda-4029-be90-6588ecef17c2 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:15:29.089159 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-c56b82c9-5bda-4029-be90-6588ecef17c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:15:29.094739 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a44402f-2a40-480f-ba75-046602561d15 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:29.167061 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda1cb67-3da6-43c5-a614-ddf05e50182a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:29.167711 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda1cb67-3da6-43c5-a614-ddf05e50182a None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:29.167999 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda1cb67-3da6-43c5-a614-ddf05e50182a None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:29.168335 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda1cb67-3da6-43c5-a614-ddf05e50182a None admin] PATH_INFO: `/v3/projects/6cd2be8a8d2a48ce87a8453fb81f9427` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:29.169553 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda1cb67-3da6-43c5-a614-ddf05e50182a None admin] RBAC: Authorizing `identity:get_project(project_id=6cd2be8a8d2a48ce87a8453fb81f9427)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:29.171054 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda1cb67-3da6-43c5-a614-ddf05e50182a None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:29.173010 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 226/430] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Sep 13 15:15:28 2022] GET /identity/v3/projects/6cd2be8a8d2a48ce87a8453fb81f9427 => generated 298 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:15:29.178612 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda1cb67-3da6-43c5-a614-ddf05e50182a None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:29.213996 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 205/431] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:15:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 15:15:29.313210 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda1cb67-3da6-43c5-a614-ddf05e50182a None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:29.353325 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52af5a9-d3d2-42f4-b60c-0947332d5e0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:29.354280 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52af5a9-d3d2-42f4-b60c-0947332d5e0f None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:29.354572 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52af5a9-d3d2-42f4-b60c-0947332d5e0f None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:29.354825 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52af5a9-d3d2-42f4-b60c-0947332d5e0f None admin] PATH_INFO: `/v3/groups/6d9744616b6f4f4b9d4ddca88fb18906` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:29.355953 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52af5a9-d3d2-42f4-b60c-0947332d5e0f None admin] RBAC: Authorizing `identity:get_group(group_id=6d9744616b6f4f4b9d4ddca88fb18906)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:29.357415 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52af5a9-d3d2-42f4-b60c-0947332d5e0f None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:29.359337 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 227/432] 10.222.0.27 () {56 vars in 1180 bytes} [Tue Sep 13 15:15:29 2022] GET /identity/v3/groups/6d9744616b6f4f4b9d4ddca88fb18906 => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 15:15:29.365012 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56b82c9-5bda-4029-be90-6588ecef17c2 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:29.368578 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:29.399985 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feddb493-f36a-43d4-a322-130ee13f2241 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:29.400635 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feddb493-f36a-43d4-a322-130ee13f2241 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:29.400635 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feddb493-f36a-43d4-a322-130ee13f2241 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:29.403767 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 228/433] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:15:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 15:15:29.409738 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e92f273-25ff-439e-b316-88e71598e7d0 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:29.410077 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e92f273-25ff-439e-b316-88e71598e7d0 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:29.410351 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e92f273-25ff-439e-b316-88e71598e7d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:29.434356 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-7e92f273-25ff-439e-b316-88e71598e7d0 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:15:29.436078 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-7e92f273-25ff-439e-b316-88e71598e7d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:15:29.454419 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:29.501356 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56b82c9-5bda-4029-be90-6588ecef17c2 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:29.540242 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 229/434] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:15:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 15:15:29.551580 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29730e91-b0bd-4003-90d2-97d98db659b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:29.552556 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29730e91-b0bd-4003-90d2-97d98db659b6 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:29.552888 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29730e91-b0bd-4003-90d2-97d98db659b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:29.553174 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29730e91-b0bd-4003-90d2-97d98db659b6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:29.553976 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29730e91-b0bd-4003-90d2-97d98db659b6 None admin] RBAC: Adding query filter params (group.id=6d9744616b6f4f4b9d4ddca88fb18906, role.id=5d9c0543f8e04065bb3d8bcd11156c1d, scope.project.id=6cd2be8a8d2a48ce87a8453fb81f9427) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:15:29.554303 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29730e91-b0bd-4003-90d2-97d98db659b6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:29.555818 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29730e91-b0bd-4003-90d2-97d98db659b6 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:29.564385 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 206/435] 10.222.0.27 () {56 vars in 1376 bytes} [Tue Sep 13 15:15:29 2022] GET /identity/v3/role_assignments?group.id=6d9744616b6f4f4b9d4ddca88fb18906&scope.project.id=6cd2be8a8d2a48ce87a8453fb81f9427&role.id=5d9c0543f8e04065bb3d8bcd11156c1d => generated 611 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:15:29.579404 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e92f273-25ff-439e-b316-88e71598e7d0 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:29.703160 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e92f273-25ff-439e-b316-88e71598e7d0 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:29.748666 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d53855-d2c6-4e25-82a3-424d884dcc31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:29.749331 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d53855-d2c6-4e25-82a3-424d884dcc31 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:29.749777 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d53855-d2c6-4e25-82a3-424d884dcc31 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:29.750122 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d53855-d2c6-4e25-82a3-424d884dcc31 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:29.764422 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d53855-d2c6-4e25-82a3-424d884dcc31 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 15:15:29.769599 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-f2d53855-d2c6-4e25-82a3-424d884dcc31 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 15:15:29.769599 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:15:29.769599 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:15:29.769599 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:15:29.769599 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:15:29.769599 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:15:29.769599 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:15:29.769599 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:15:29.769599 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:15:29.769599 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:15:29.769599 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:15:29.769599 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:15:29.769599 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 15:15:29.769599 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 15:15:29.769599 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 15:15:29.769599 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 15:15:29.770790 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 15:15:29.770790 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 15:15:29.770790 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 15:15:29.770790 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 15:15:29.770790 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:15:29.770790 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:15:29.770790 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:15:29.770790 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:15:29.770790 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:15:29.770790 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:15:29.770790 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:15:29.770790 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Sep 13 15:15:29.770790 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:15:29.770790 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:15:29.770790 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:15:29.770790 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:15:29.771814 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:15:29.771814 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:15:29.771814 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:15:29.771814 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:15:29.771814 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 15:15:29.771814 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 15:15:29.771814 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 15:15:29.771814 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 15:15:29.771814 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 15:15:29.771814 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 15:15:29.771814 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 15:15:29.771814 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Sep 13 15:15:29.773947 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 230/436] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Sep 13 15:15:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:15:29.780779 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29730e91-b0bd-4003-90d2-97d98db659b6 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:29.866110 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d53855-d2c6-4e25-82a3-424d884dcc31 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:29.879850 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:29.896965 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:29.944001 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29730e91-b0bd-4003-90d2-97d98db659b6 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:29.997105 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd357e0f-1554-42d6-ad24-dfdb9357b4bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:29.997790 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd357e0f-1554-42d6-ad24-dfdb9357b4bf None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:29.998080 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd357e0f-1554-42d6-ad24-dfdb9357b4bf None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:29.998356 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd357e0f-1554-42d6-ad24-dfdb9357b4bf None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:29.999038 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd357e0f-1554-42d6-ad24-dfdb9357b4bf None admin] RBAC: Adding query filter params (name=member) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:15:29.999349 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd357e0f-1554-42d6-ad24-dfdb9357b4bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:30.000917 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd357e0f-1554-42d6-ad24-dfdb9357b4bf None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:30.010570 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d53855-d2c6-4e25-82a3-424d884dcc31 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:30.011256 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 207/437] 10.222.0.27 () {56 vars in 1101 bytes} [Tue Sep 13 15:15:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 15:15:30.012592 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0611dc2a-17f9-4cc2-b2be-dfd4bf1507d8 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:30.012884 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0611dc2a-17f9-4cc2-b2be-dfd4bf1507d8 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:30.013155 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0611dc2a-17f9-4cc2-b2be-dfd4bf1507d8 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:30.014684 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 208/438] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:15:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:15:30.020327 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0611dc2a-17f9-4cc2-b2be-dfd4bf1507d8 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:30.063648 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0dffc4-7c4a-4abf-bc9d-0dcf556c70b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:30.064344 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0dffc4-7c4a-4abf-bc9d-0dcf556c70b5 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:30.064628 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0dffc4-7c4a-4abf-bc9d-0dcf556c70b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:30.064926 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0dffc4-7c4a-4abf-bc9d-0dcf556c70b5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:30.076514 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0dffc4-7c4a-4abf-bc9d-0dcf556c70b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 15:15:30.082780 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-ad0dffc4-7c4a-4abf-bc9d-0dcf556c70b5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 15:15:30.082780 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:15:30.082780 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:15:30.082780 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:15:30.082780 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:15:30.082780 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:15:30.082780 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:15:30.082780 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:15:30.082780 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:15:30.082780 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:15:30.082780 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:15:30.082780 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:15:30.082780 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 15:15:30.082780 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 15:15:30.082780 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 15:15:30.082780 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 15:15:30.083689 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 15:15:30.083689 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 15:15:30.083689 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 15:15:30.083689 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 15:15:30.083689 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:15:30.083689 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:15:30.083689 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:15:30.083689 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:15:30.083689 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:15:30.083689 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:15:30.083689 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:15:30.083689 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Sep 13 15:15:30.083689 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:15:30.083689 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:15:30.083689 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:15:30.083689 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:15:30.084462 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:15:30.084462 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:15:30.084462 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:15:30.084462 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:15:30.084462 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 15:15:30.084462 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 15:15:30.084462 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 15:15:30.084462 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 15:15:30.084462 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 15:15:30.084462 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 15:15:30.084462 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 15:15:30.084462 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Sep 13 15:15:30.084462 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 231/439] 10.222.0.27 () {56 vars in 1114 bytes} [Tue Sep 13 15:15:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:15:30.084462 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eee7b6-f82a-4955-b8c9-c22b1372b614 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:30.085164 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eee7b6-f82a-4955-b8c9-c22b1372b614 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:30.085164 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eee7b6-f82a-4955-b8c9-c22b1372b614 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:30.103921 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-02eee7b6-f82a-4955-b8c9-c22b1372b614 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:15:30.105139 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-02eee7b6-f82a-4955-b8c9-c22b1372b614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:15:30.149308 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0611dc2a-17f9-4cc2-b2be-dfd4bf1507d8 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:30.170228 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:30.175945 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 232/440] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:15:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 15:15:30.176759 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eee7b6-f82a-4955-b8c9-c22b1372b614 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:30.187142 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:30.197268 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67664f2-9220-43e9-bd52-75489d9a19cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:30.198144 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67664f2-9220-43e9-bd52-75489d9a19cc None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:30.198621 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67664f2-9220-43e9-bd52-75489d9a19cc None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:30.199216 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67664f2-9220-43e9-bd52-75489d9a19cc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:30.271910 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67664f2-9220-43e9-bd52-75489d9a19cc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:30.274010 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67664f2-9220-43e9-bd52-75489d9a19cc None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:30.281186 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eee7b6-f82a-4955-b8c9-c22b1372b614 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:30.316898 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36e4307-3aa5-47b0-8444-df28c4b44c40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:30.317982 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36e4307-3aa5-47b0-8444-df28c4b44c40 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:30.318266 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36e4307-3aa5-47b0-8444-df28c4b44c40 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:30.318578 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36e4307-3aa5-47b0-8444-df28c4b44c40 None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:30.319247 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36e4307-3aa5-47b0-8444-df28c4b44c40 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:15:30.319551 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36e4307-3aa5-47b0-8444-df28c4b44c40 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:30.321927 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36e4307-3aa5-47b0-8444-df28c4b44c40 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:30.330566 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 233/441] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Sep 13 15:15:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:15:30.336378 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36e4307-3aa5-47b0-8444-df28c4b44c40 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:30.380859 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 209/442] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Sep 13 15:15:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 15:15:30.386993 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67664f2-9220-43e9-bd52-75489d9a19cc None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:30.397371 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:30.414253 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:30.440779 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36e4307-3aa5-47b0-8444-df28c4b44c40 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:30.475085 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c429c9-ef7f-4fc2-98f8-5bc4af24e272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:30.475709 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c429c9-ef7f-4fc2-98f8-5bc4af24e272 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:30.475983 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c429c9-ef7f-4fc2-98f8-5bc4af24e272 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:30.476818 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c429c9-ef7f-4fc2-98f8-5bc4af24e272 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:30.491363 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67664f2-9220-43e9-bd52-75489d9a19cc None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:30.525787 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9051648-124e-4efb-be5c-efe107c25038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:30.526409 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9051648-124e-4efb-be5c-efe107c25038 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:30.526689 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9051648-124e-4efb-be5c-efe107c25038 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:30.526960 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9051648-124e-4efb-be5c-efe107c25038 None admin] PATH_INFO: `/v3/projects/bcdaddc5cabe41a8982e616719a29740` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:30.528084 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9051648-124e-4efb-be5c-efe107c25038 None admin] RBAC: Authorizing `identity:get_project(project_id=bcdaddc5cabe41a8982e616719a29740)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:30.529529 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9051648-124e-4efb-be5c-efe107c25038 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:30.531168 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 210/443] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Sep 13 15:15:30 2022] GET /identity/v3/projects/bcdaddc5cabe41a8982e616719a29740 => generated 302 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 15:15:30.531923 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9051648-124e-4efb-be5c-efe107c25038 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:30.543415 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c429c9-ef7f-4fc2-98f8-5bc4af24e272 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:30.544883 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c429c9-ef7f-4fc2-98f8-5bc4af24e272 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:30.601074 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:30.627823 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:30.634373 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9051648-124e-4efb-be5c-efe107c25038 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:30.642925 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 234/444] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Sep 13 15:15:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 13 15:15:30.643759 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c429c9-ef7f-4fc2-98f8-5bc4af24e272 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:30.668911 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c74701-3031-468c-ae86-20868924e4f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:30.669461 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c74701-3031-468c-ae86-20868924e4f2 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:30.669770 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c74701-3031-468c-ae86-20868924e4f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:30.670048 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c74701-3031-468c-ae86-20868924e4f2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:30.680651 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c74701-3031-468c-ae86-20868924e4f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 15:15:30.685518 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-a6c74701-3031-468c-ae86-20868924e4f2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 15:15:30.685518 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:15:30.685518 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:15:30.685518 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:15:30.685518 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:15:30.685518 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:15:30.685518 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:15:30.685518 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:15:30.685518 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:15:30.685518 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:15:30.685518 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:15:30.685518 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:15:30.685518 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 15:15:30.685518 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 15:15:30.685518 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 15:15:30.685518 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 15:15:30.686628 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 15:15:30.686628 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 15:15:30.686628 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 15:15:30.686628 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 15:15:30.686628 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:15:30.686628 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:15:30.686628 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:15:30.686628 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:15:30.686628 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:15:30.686628 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:15:30.686628 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:15:30.686628 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Sep 13 15:15:30.686628 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:15:30.686628 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:15:30.686628 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:15:30.686628 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:15:30.687544 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:15:30.687544 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:15:30.687544 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:15:30.687544 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:15:30.687544 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 15:15:30.687544 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 15:15:30.687544 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 15:15:30.687544 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 15:15:30.687544 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 15:15:30.687544 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 15:15:30.687544 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 15:15:30.687544 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Sep 13 15:15:30.687544 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 211/445] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Sep 13 15:15:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:15:30.688574 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c74701-3031-468c-ae86-20868924e4f2 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:30.746440 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c429c9-ef7f-4fc2-98f8-5bc4af24e272 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:30.778776 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c0197d-50af-4a3d-98b9-8147b90bc5ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:30.779644 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c0197d-50af-4a3d-98b9-8147b90bc5ee None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:30.779931 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c0197d-50af-4a3d-98b9-8147b90bc5ee None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:30.780204 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c0197d-50af-4a3d-98b9-8147b90bc5ee None admin] PATH_INFO: `/v3/groups/6d9744616b6f4f4b9d4ddca88fb18906` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:30.781309 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c0197d-50af-4a3d-98b9-8147b90bc5ee None admin] RBAC: Authorizing `identity:get_group(group_id=6d9744616b6f4f4b9d4ddca88fb18906)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:30.782807 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c0197d-50af-4a3d-98b9-8147b90bc5ee None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:30.784525 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 235/446] 10.222.0.27 () {56 vars in 1180 bytes} [Tue Sep 13 15:15:30 2022] GET /identity/v3/groups/6d9744616b6f4f4b9d4ddca88fb18906 => generated 226 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:15:30.785113 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c0197d-50af-4a3d-98b9-8147b90bc5ee None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:30.788249 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c74701-3031-468c-ae86-20868924e4f2 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:30.812774 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:30.823505 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f04c9e-fba6-4f94-98a8-c1fe2e8b9e6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:30.824133 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f04c9e-fba6-4f94-98a8-c1fe2e8b9e6f None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:30.824420 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f04c9e-fba6-4f94-98a8-c1fe2e8b9e6f None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:30.824701 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f04c9e-fba6-4f94-98a8-c1fe2e8b9e6f None admin] PATH_INFO: `/v3/projects/bcdaddc5cabe41a8982e616719a29740` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:30.825868 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f04c9e-fba6-4f94-98a8-c1fe2e8b9e6f None admin] RBAC: Authorizing `identity:get_project(project_id=bcdaddc5cabe41a8982e616719a29740)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:30.827318 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f04c9e-fba6-4f94-98a8-c1fe2e8b9e6f None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:30.828936 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 212/447] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Sep 13 15:15:30 2022] GET /identity/v3/projects/bcdaddc5cabe41a8982e616719a29740 => generated 302 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:15:30.829686 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f04c9e-fba6-4f94-98a8-c1fe2e8b9e6f None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:30.855773 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:30.888570 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c0197d-50af-4a3d-98b9-8147b90bc5ee None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:30.922872 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d147d229-3696-4647-a124-32a451ee5ab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:30.923401 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d147d229-3696-4647-a124-32a451ee5ab5 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:30.923682 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d147d229-3696-4647-a124-32a451ee5ab5 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:30.923955 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d147d229-3696-4647-a124-32a451ee5ab5 None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:30.924612 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d147d229-3696-4647-a124-32a451ee5ab5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:15:30.924915 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d147d229-3696-4647-a124-32a451ee5ab5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:30.926323 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d147d229-3696-4647-a124-32a451ee5ab5 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:30.930392 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f04c9e-fba6-4f94-98a8-c1fe2e8b9e6f None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:30.934713 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 236/448] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Sep 13 15:15:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:15:30.935511 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d147d229-3696-4647-a124-32a451ee5ab5 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:30.965931 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b85490-d2f7-4c67-975c-516e5a1800d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:30.966538 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b85490-d2f7-4c67-975c-516e5a1800d6 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:30.966818 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b85490-d2f7-4c67-975c-516e5a1800d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:30.967092 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b85490-d2f7-4c67-975c-516e5a1800d6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:30.968097 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b85490-d2f7-4c67-975c-516e5a1800d6 None admin] RBAC: Adding query filter params (group.id=6d9744616b6f4f4b9d4ddca88fb18906, role.id=3fae3d3a28e147d3b2bede2378ff79ae, scope.project.id=bcdaddc5cabe41a8982e616719a29740) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:15:30.968412 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b85490-d2f7-4c67-975c-516e5a1800d6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:30.970504 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b85490-d2f7-4c67-975c-516e5a1800d6 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:30.975478 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 213/449] 10.222.0.27 () {56 vars in 1376 bytes} [Tue Sep 13 15:15:30 2022] GET /identity/v3/role_assignments?group.id=6d9744616b6f4f4b9d4ddca88fb18906&scope.project.id=bcdaddc5cabe41a8982e616719a29740&role.id=3fae3d3a28e147d3b2bede2378ff79ae => generated 611 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:15:30.976828 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b85490-d2f7-4c67-975c-516e5a1800d6 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:31.050986 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:31.064721 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d147d229-3696-4647-a124-32a451ee5ab5 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:31.075958 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:31.090860 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b85490-d2f7-4c67-975c-516e5a1800d6 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:31.104939 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de60c5d-2ae6-477a-a4c6-71c141ff8ae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:31.105612 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de60c5d-2ae6-477a-a4c6-71c141ff8ae4 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:31.105930 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de60c5d-2ae6-477a-a4c6-71c141ff8ae4 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:31.106214 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de60c5d-2ae6-477a-a4c6-71c141ff8ae4 None admin] PATH_INFO: `/v3/groups/6d9744616b6f4f4b9d4ddca88fb18906` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:31.107467 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de60c5d-2ae6-477a-a4c6-71c141ff8ae4 None admin] RBAC: Authorizing `identity:get_group(group_id=6d9744616b6f4f4b9d4ddca88fb18906)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:31.108958 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de60c5d-2ae6-477a-a4c6-71c141ff8ae4 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:31.110848 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 237/450] 10.222.0.27 () {56 vars in 1180 bytes} [Tue Sep 13 15:15:30 2022] GET /identity/v3/groups/6d9744616b6f4f4b9d4ddca88fb18906 => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:15:31.116800 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de60c5d-2ae6-477a-a4c6-71c141ff8ae4 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:31.130074 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307a34c6-7c44-4a4c-ac7c-1591b89a8cc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:31.130699 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307a34c6-7c44-4a4c-ac7c-1591b89a8cc9 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:31.130984 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307a34c6-7c44-4a4c-ac7c-1591b89a8cc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:31.131256 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307a34c6-7c44-4a4c-ac7c-1591b89a8cc9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:31.213527 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307a34c6-7c44-4a4c-ac7c-1591b89a8cc9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:31.215258 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307a34c6-7c44-4a4c-ac7c-1591b89a8cc9 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:31.241758 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de60c5d-2ae6-477a-a4c6-71c141ff8ae4 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:31.280844 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5654ba1d-c145-45f6-957d-f19d74191ab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:31.281460 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5654ba1d-c145-45f6-957d-f19d74191ab9 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:31.281838 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5654ba1d-c145-45f6-957d-f19d74191ab9 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:31.282047 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5654ba1d-c145-45f6-957d-f19d74191ab9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:31.282779 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5654ba1d-c145-45f6-957d-f19d74191ab9 None admin] RBAC: Adding query filter params (group.id=6d9744616b6f4f4b9d4ddca88fb18906, role.id=5d9c0543f8e04065bb3d8bcd11156c1d, scope.project.id=bcdaddc5cabe41a8982e616719a29740) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:15:31.283089 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5654ba1d-c145-45f6-957d-f19d74191ab9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:31.284522 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5654ba1d-c145-45f6-957d-f19d74191ab9 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:31.294491 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 238/451] 10.222.0.27 () {56 vars in 1376 bytes} [Tue Sep 13 15:15:31 2022] GET /identity/v3/role_assignments?group.id=6d9744616b6f4f4b9d4ddca88fb18906&scope.project.id=bcdaddc5cabe41a8982e616719a29740&role.id=5d9c0543f8e04065bb3d8bcd11156c1d => generated 611 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:15:31.313630 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:31.331094 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 214/452] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Sep 13 15:15:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 15:15:31.337340 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5654ba1d-c145-45f6-957d-f19d74191ab9 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:31.368928 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:31.455293 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5654ba1d-c145-45f6-957d-f19d74191ab9 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:31.490174 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847732b5-01f4-4801-8ef4-268e42570873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:31.490735 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847732b5-01f4-4801-8ef4-268e42570873 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:31.491016 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847732b5-01f4-4801-8ef4-268e42570873 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:31.491293 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847732b5-01f4-4801-8ef4-268e42570873 None admin] PATH_INFO: `/v3/projects/7edec545f8774b83a9353b60f81fc3c1` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:31.493081 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847732b5-01f4-4801-8ef4-268e42570873 None admin] RBAC: Authorizing `identity:get_project(project_id=7edec545f8774b83a9353b60f81fc3c1)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:31.494554 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847732b5-01f4-4801-8ef4-268e42570873 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:31.496189 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 239/453] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Sep 13 15:15:31 2022] GET /identity/v3/projects/7edec545f8774b83a9353b60f81fc3c1 => generated 344 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:15:31.501800 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307a34c6-7c44-4a4c-ac7c-1591b89a8cc9 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:31.600591 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307a34c6-7c44-4a4c-ac7c-1591b89a8cc9 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:31.635603 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c11b0e-e207-4096-abf7-4ece12da62e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:31.636924 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c11b0e-e207-4096-abf7-4ece12da62e7 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:31.637208 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c11b0e-e207-4096-abf7-4ece12da62e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:31.637485 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c11b0e-e207-4096-abf7-4ece12da62e7 None admin] PATH_INFO: `/v3/groups/0321481357744c2fac7c30da9458e530` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:31.638720 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c11b0e-e207-4096-abf7-4ece12da62e7 None admin] RBAC: Authorizing `identity:get_group(group_id=0321481357744c2fac7c30da9458e530)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:31.640167 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c11b0e-e207-4096-abf7-4ece12da62e7 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:31.641754 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 215/454] 10.222.0.27 () {56 vars in 1180 bytes} [Tue Sep 13 15:15:31 2022] GET /identity/v3/groups/0321481357744c2fac7c30da9458e530 => generated 229 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:15:31.647612 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847732b5-01f4-4801-8ef4-268e42570873 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:31.737695 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:31.747457 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847732b5-01f4-4801-8ef4-268e42570873 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:31.779288 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cde821-88e4-483a-8199-5849534f5015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:31.779880 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cde821-88e4-483a-8199-5849534f5015 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:31.780158 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cde821-88e4-483a-8199-5849534f5015 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:31.780431 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cde821-88e4-483a-8199-5849534f5015 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:31.781145 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cde821-88e4-483a-8199-5849534f5015 None admin] RBAC: Adding query filter params (group.id=0321481357744c2fac7c30da9458e530, role.id=f34412ad29f1478cba775b033129f71f, scope.project.id=7edec545f8774b83a9353b60f81fc3c1) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:15:31.781466 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cde821-88e4-483a-8199-5849534f5015 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:31.782906 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cde821-88e4-483a-8199-5849534f5015 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:31.788369 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 240/455] 10.222.0.27 () {56 vars in 1376 bytes} [Tue Sep 13 15:15:31 2022] GET /identity/v3/role_assignments?group.id=0321481357744c2fac7c30da9458e530&scope.project.id=7edec545f8774b83a9353b60f81fc3c1&role.id=f34412ad29f1478cba775b033129f71f => generated 611 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:15:34.416500 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ed0d47-06f0-4fdd-84a5-55c3927505d9 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:34.417620 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ed0d47-06f0-4fdd-84a5-55c3927505d9 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:34.418221 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ed0d47-06f0-4fdd-84a5-55c3927505d9 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:34.420021 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 216/456] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:15:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:15:34.425640 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2671a93a-bd04-440c-adb3-e11316231064 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:34.426069 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2671a93a-bd04-440c-adb3-e11316231064 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:34.426230 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2671a93a-bd04-440c-adb3-e11316231064 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:34.450888 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-2671a93a-bd04-440c-adb3-e11316231064 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:15:34.452299 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-2671a93a-bd04-440c-adb3-e11316231064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:15:34.547337 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 241/457] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:15:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 15:15:34.706392 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00532256-630e-4d38-b852-296ba9cf6f3a None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:34.707016 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00532256-630e-4d38-b852-296ba9cf6f3a None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:34.707499 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00532256-630e-4d38-b852-296ba9cf6f3a None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:34.715432 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe54cda-005f-44a3-92bd-5a0b6232eea5 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:34.715716 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe54cda-005f-44a3-92bd-5a0b6232eea5 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:34.716162 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe54cda-005f-44a3-92bd-5a0b6232eea5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:34.722748 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 217/458] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:15:34 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:15:34.751237 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-bfe54cda-005f-44a3-92bd-5a0b6232eea5 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:15:34.752450 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-bfe54cda-005f-44a3-92bd-5a0b6232eea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:15:34.841936 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 242/459] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:15:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 15:15:34.955285 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00532256-630e-4d38-b852-296ba9cf6f3a None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:35.037382 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:35.094570 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00532256-630e-4d38-b852-296ba9cf6f3a None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:35.095145 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8a4021-c7d6-4142-be5b-4260746fd848 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:35.095429 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8a4021-c7d6-4142-be5b-4260746fd848 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:35.095700 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8a4021-c7d6-4142-be5b-4260746fd848 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:35.098810 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 243/460] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:15:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:15:35.110398 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01b9a63-bd95-400b-aa99-940faaef1895 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:35.110682 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01b9a63-bd95-400b-aa99-940faaef1895 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:35.110959 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01b9a63-bd95-400b-aa99-940faaef1895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:35.137180 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58242e08-a28b-4722-ae45-5863e2789fc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:35.137857 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58242e08-a28b-4722-ae45-5863e2789fc5 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:35.138197 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58242e08-a28b-4722-ae45-5863e2789fc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:35.138411 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58242e08-a28b-4722-ae45-5863e2789fc5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:35.142854 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-d01b9a63-bd95-400b-aa99-940faaef1895 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:15:35.144284 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-d01b9a63-bd95-400b-aa99-940faaef1895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:15:35.150708 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58242e08-a28b-4722-ae45-5863e2789fc5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:35.152578 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58242e08-a28b-4722-ae45-5863e2789fc5 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:35.154704 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:35.170414 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-58242e08-a28b-4722-ae45-5863e2789fc5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 15:15:35.170414 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:15:35.170414 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:15:35.170414 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:15:35.170414 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:15:35.170414 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:15:35.170414 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:15:35.170414 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:15:35.170414 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:15:35.170414 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:15:35.170414 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:15:35.170414 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:15:35.170414 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 15:15:35.170414 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 15:15:35.170414 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 15:15:35.170414 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 15:15:35.171401 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:15:35.171401 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:15:35.171401 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:15:35.171401 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:15:35.171401 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:15:35.171401 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:15:35.171401 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:15:35.171401 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Sep 13 15:15:35.171401 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:15:35.171401 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:15:35.171401 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:15:35.171401 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:15:35.171401 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:15:35.171401 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:15:35.171401 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:15:35.171401 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:15:35.171401 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 15:15:35.172261 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 15:15:35.172261 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 15:15:35.172261 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Sep 13 15:15:35.172261 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 218/461] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 13 15:15:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:15:35.172977 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddc6681-6665-4d29-8b2a-c735d522cf8a None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:35.173264 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddc6681-6665-4d29-8b2a-c735d522cf8a None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:35.173540 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddc6681-6665-4d29-8b2a-c735d522cf8a None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:35.174796 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 219/462] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:15:35 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:15:35.179674 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddc6681-6665-4d29-8b2a-c735d522cf8a None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:35.222035 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 244/463] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:15:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 15:15:35.223320 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c751e0f-ab70-4a37-b372-fa8490633bbf None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:35.223611 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c751e0f-ab70-4a37-b372-fa8490633bbf None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:35.223892 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c751e0f-ab70-4a37-b372-fa8490633bbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:35.242941 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-1c751e0f-ab70-4a37-b372-fa8490633bbf None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:15:35.244148 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-1c751e0f-ab70-4a37-b372-fa8490633bbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:15:35.308067 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddc6681-6665-4d29-8b2a-c735d522cf8a None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:35.318380 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:35.329881 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 245/464] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:15:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 15:15:35.330753 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c751e0f-ab70-4a37-b372-fa8490633bbf None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:35.372206 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd7cd98-12d6-4fd4-bcc1-9926d32b2d4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:35.372817 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd7cd98-12d6-4fd4-bcc1-9926d32b2d4a None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:35.373094 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd7cd98-12d6-4fd4-bcc1-9926d32b2d4a None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:35.373366 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd7cd98-12d6-4fd4-bcc1-9926d32b2d4a None admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:35.374035 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd7cd98-12d6-4fd4-bcc1-9926d32b2d4a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:15:35.374337 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd7cd98-12d6-4fd4-bcc1-9926d32b2d4a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:35.375702 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd7cd98-12d6-4fd4-bcc1-9926d32b2d4a None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:35.405234 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 220/465] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Sep 13 15:15:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:15:35.412419 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd7cd98-12d6-4fd4-bcc1-9926d32b2d4a None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:35.475750 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:35.500342 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c751e0f-ab70-4a37-b372-fa8490633bbf None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:35.538187 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4834b5e2-348d-4f26-afc8-c62bb0458829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:35.539340 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4834b5e2-348d-4f26-afc8-c62bb0458829 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:35.539870 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4834b5e2-348d-4f26-afc8-c62bb0458829 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:35.540328 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4834b5e2-348d-4f26-afc8-c62bb0458829 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:35.551624 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4834b5e2-348d-4f26-afc8-c62bb0458829 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:35.553367 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4834b5e2-348d-4f26-afc8-c62bb0458829 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:35.572325 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-4834b5e2-348d-4f26-afc8-c62bb0458829 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 15:15:35.572325 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:15:35.572325 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:15:35.572325 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:15:35.572325 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:15:35.572325 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:15:35.572325 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:15:35.572325 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:15:35.572325 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:15:35.572325 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:15:35.572325 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:15:35.572325 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:15:35.572325 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 15:15:35.572325 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 15:15:35.572325 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 15:15:35.572325 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 15:15:35.573452 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:15:35.573452 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:15:35.573452 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:15:35.573452 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:15:35.573452 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:15:35.573452 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:15:35.573452 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:15:35.573452 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Sep 13 15:15:35.573452 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:15:35.573452 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:15:35.573452 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:15:35.573452 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:15:35.573452 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:15:35.573452 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:15:35.573452 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:15:35.573452 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:15:35.573452 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 15:15:35.574573 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 15:15:35.574573 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 15:15:35.574573 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Sep 13 15:15:35.576353 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 246/466] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 13 15:15:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:15:35.577366 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4834b5e2-348d-4f26-afc8-c62bb0458829 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:35.592667 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd7cd98-12d6-4fd4-bcc1-9926d32b2d4a None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:35.639634 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337b815d-1692-4073-92ea-7f4f96672fde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:35.640926 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337b815d-1692-4073-92ea-7f4f96672fde None admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:35.641309 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337b815d-1692-4073-92ea-7f4f96672fde None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:35.641687 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337b815d-1692-4073-92ea-7f4f96672fde None admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:35.642744 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337b815d-1692-4073-92ea-7f4f96672fde None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:35.644947 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337b815d-1692-4073-92ea-7f4f96672fde None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:35.671869 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 221/467] 10.222.0.27 () {60 vars in 1132 bytes} [Tue Sep 13 15:15:35 2022] POST /identity/v3/users => generated 246 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 15:15:35.672814 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337b815d-1692-4073-92ea-7f4f96672fde None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:35.701351 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4834b5e2-348d-4f26-afc8-c62bb0458829 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:35.707904 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:35.751956 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:35.766744 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7fc626-1d57-4c9c-b8f7-b398e76ead28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:35.767544 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7fc626-1d57-4c9c-b8f7-b398e76ead28 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:35.767950 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7fc626-1d57-4c9c-b8f7-b398e76ead28 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:35.768299 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7fc626-1d57-4c9c-b8f7-b398e76ead28 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:35.781571 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7fc626-1d57-4c9c-b8f7-b398e76ead28 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:35.782699 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7fc626-1d57-4c9c-b8f7-b398e76ead28 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:35.800198 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-8e7fc626-1d57-4c9c-b8f7-b398e76ead28 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 15:15:35.800198 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:15:35.800198 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:15:35.800198 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:15:35.800198 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:15:35.800198 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:15:35.800198 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:15:35.800198 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:15:35.800198 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:15:35.800198 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:15:35.800198 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:15:35.800198 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:15:35.800198 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 15:15:35.800198 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 15:15:35.800198 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 15:15:35.800198 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 15:15:35.801171 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:15:35.801171 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:15:35.801171 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:15:35.801171 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:15:35.801171 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:15:35.801171 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:15:35.801171 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:15:35.801171 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Sep 13 15:15:35.801171 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:15:35.801171 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:15:35.801171 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:15:35.801171 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:15:35.801171 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:15:35.801171 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:15:35.801171 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:15:35.801171 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:15:35.801171 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 15:15:35.802522 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 15:15:35.802522 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 15:15:35.802522 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Sep 13 15:15:35.802522 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 247/468] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 13 15:15:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:15:35.807976 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7fc626-1d57-4c9c-b8f7-b398e76ead28 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:35.823621 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337b815d-1692-4073-92ea-7f4f96672fde None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:35.872624 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddbe253-bee2-454b-8c77-677f837c9001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:35.873503 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddbe253-bee2-454b-8c77-677f837c9001 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:35.873954 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddbe253-bee2-454b-8c77-677f837c9001 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:35.874369 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddbe253-bee2-454b-8c77-677f837c9001 None admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:35.875178 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddbe253-bee2-454b-8c77-677f837c9001 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:15:35.876088 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddbe253-bee2-454b-8c77-677f837c9001 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:35.877913 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddbe253-bee2-454b-8c77-677f837c9001 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:35.892947 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 222/469] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Sep 13 15:15:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:15:35.896340 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddbe253-bee2-454b-8c77-677f837c9001 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:35.935445 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7fc626-1d57-4c9c-b8f7-b398e76ead28 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:35.977731 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed7fb62-e0ef-4132-bb6a-8999d1ef8975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:35.978477 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed7fb62-e0ef-4132-bb6a-8999d1ef8975 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:35.978758 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed7fb62-e0ef-4132-bb6a-8999d1ef8975 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:35.979032 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed7fb62-e0ef-4132-bb6a-8999d1ef8975 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:35.989826 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed7fb62-e0ef-4132-bb6a-8999d1ef8975 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:35.991297 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed7fb62-e0ef-4132-bb6a-8999d1ef8975 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:35.993921 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:36.006303 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-fed7fb62-e0ef-4132-bb6a-8999d1ef8975 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 15:15:36.006303 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:15:36.006303 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:15:36.006303 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:15:36.006303 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:15:36.006303 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:15:36.006303 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:15:36.006303 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:15:36.006303 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:15:36.006303 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:15:36.006303 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:15:36.006303 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:15:36.006303 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 15:15:36.006303 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 15:15:36.006303 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 15:15:36.006303 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 15:15:36.009770 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:15:36.009770 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:15:36.009770 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:15:36.009770 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:15:36.009770 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:15:36.009770 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:15:36.009770 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:15:36.009770 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Sep 13 15:15:36.009770 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:15:36.009770 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:15:36.009770 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:15:36.009770 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:15:36.009770 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:15:36.009770 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:15:36.009770 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:15:36.009770 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:15:36.009770 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 15:15:36.010724 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 15:15:36.010724 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 15:15:36.010724 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Sep 13 15:15:36.010724 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 248/470] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 13 15:15:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:15:36.010724 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed7fb62-e0ef-4132-bb6a-8999d1ef8975 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:36.018634 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddbe253-bee2-454b-8c77-677f837c9001 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:36.043005 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:36.058217 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1af163c-7516-4164-a727-0fdf6b86f10a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:36.058824 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1af163c-7516-4164-a727-0fdf6b86f10a None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:36.059107 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1af163c-7516-4164-a727-0fdf6b86f10a None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:36.059380 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1af163c-7516-4164-a727-0fdf6b86f10a None admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:36.060022 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1af163c-7516-4164-a727-0fdf6b86f10a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:15:36.060334 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1af163c-7516-4164-a727-0fdf6b86f10a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:36.061711 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1af163c-7516-4164-a727-0fdf6b86f10a None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:36.074387 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 223/471] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Sep 13 15:15:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:15:36.075413 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f42b495-4d1f-4623-be89-6a56bf089852 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:36.075699 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f42b495-4d1f-4623-be89-6a56bf089852 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:36.075968 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f42b495-4d1f-4623-be89-6a56bf089852 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:36.077161 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 224/472] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:15:36 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:15:36.078382 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f42b495-4d1f-4623-be89-6a56bf089852 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:36.127298 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed7fb62-e0ef-4132-bb6a-8999d1ef8975 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:36.162606 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7080dff-66a3-4e53-a572-ece146b58b27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:36.163214 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7080dff-66a3-4e53-a572-ece146b58b27 None admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:36.163592 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7080dff-66a3-4e53-a572-ece146b58b27 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:36.163875 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7080dff-66a3-4e53-a572-ece146b58b27 None admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:36.164523 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7080dff-66a3-4e53-a572-ece146b58b27 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:36.166033 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7080dff-66a3-4e53-a572-ece146b58b27 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:36.187916 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 249/473] 10.222.0.27 () {60 vars in 1132 bytes} [Tue Sep 13 15:15:36 2022] POST /identity/v3/users => generated 248 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:15:36.188831 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7080dff-66a3-4e53-a572-ece146b58b27 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:36.203127 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f42b495-4d1f-4623-be89-6a56bf089852 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:36.246030 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b127f7b5-f1bb-41c3-8e7f-bc35cd65551a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:36.246829 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b127f7b5-f1bb-41c3-8e7f-bc35cd65551a None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:36.247209 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b127f7b5-f1bb-41c3-8e7f-bc35cd65551a None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:36.247610 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b127f7b5-f1bb-41c3-8e7f-bc35cd65551a None admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:36.248377 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b127f7b5-f1bb-41c3-8e7f-bc35cd65551a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:15:36.248788 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b127f7b5-f1bb-41c3-8e7f-bc35cd65551a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:36.250998 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b127f7b5-f1bb-41c3-8e7f-bc35cd65551a None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:36.267580 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 225/474] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Sep 13 15:15:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:15:36.269553 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa2ef20-f561-4353-a369-57049c98fe49 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:36.269963 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa2ef20-f561-4353-a369-57049c98fe49 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:36.270497 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa2ef20-f561-4353-a369-57049c98fe49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:36.283925 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:36.300252 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-ffa2ef20-f561-4353-a369-57049c98fe49 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:15:36.301684 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-ffa2ef20-f561-4353-a369-57049c98fe49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:15:36.318084 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:36.338715 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7080dff-66a3-4e53-a572-ece146b58b27 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:36.386434 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269abe0f-a812-49a4-8f28-99cd9eeaa227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:36.387298 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269abe0f-a812-49a4-8f28-99cd9eeaa227 None admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:36.387725 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269abe0f-a812-49a4-8f28-99cd9eeaa227 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:36.388145 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269abe0f-a812-49a4-8f28-99cd9eeaa227 None admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:36.388504 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 226/475] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:15:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 15:15:36.389306 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269abe0f-a812-49a4-8f28-99cd9eeaa227 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:36.389520 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa2ef20-f561-4353-a369-57049c98fe49 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:36.391073 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269abe0f-a812-49a4-8f28-99cd9eeaa227 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:36.430282 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 250/476] 10.222.0.27 () {60 vars in 1132 bytes} [Tue Sep 13 15:15:36 2022] POST /identity/v3/users => generated 249 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:15:36.522987 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa2ef20-f561-4353-a369-57049c98fe49 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:36.564107 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0016c8-240c-46c1-831e-40f72f17c57b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:36.564731 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0016c8-240c-46c1-831e-40f72f17c57b None admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:36.565081 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0016c8-240c-46c1-831e-40f72f17c57b None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:36.565359 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0016c8-240c-46c1-831e-40f72f17c57b None admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:36.566114 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0016c8-240c-46c1-831e-40f72f17c57b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:36.567633 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0016c8-240c-46c1-831e-40f72f17c57b None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:36.577291 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:36.595947 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 227/477] 10.222.0.27 () {60 vars in 1132 bytes} [Tue Sep 13 15:15:36 2022] POST /identity/v3/users => generated 248 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:15:36.675215 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269abe0f-a812-49a4-8f28-99cd9eeaa227 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:36.802176 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269abe0f-a812-49a4-8f28-99cd9eeaa227 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:36.843261 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e73db51-9a52-4181-903c-7f4363746d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:36.843870 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e73db51-9a52-4181-903c-7f4363746d5d None admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:36.844154 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e73db51-9a52-4181-903c-7f4363746d5d None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:36.844433 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e73db51-9a52-4181-903c-7f4363746d5d None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:36.845112 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e73db51-9a52-4181-903c-7f4363746d5d None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:36.846602 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e73db51-9a52-4181-903c-7f4363746d5d None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:36.856137 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.sql.core [None req-1e73db51-9a52-4181-903c-7f4363746d5d None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 13 15:15:36.856137 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 13 15:15:36.856137 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [parameters: {'id': 'c3f3c4c3bf2e4370810d64a04f2efd9a', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 13 15:15:36.856137 dv-cinder-857434-2-smb devstack@keystone.service[81449]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81449) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 13 15:15:36.873466 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-1e73db51-9a52-4181-903c-7f4363746d5d None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 13 15:15:36.873466 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:15:36.873466 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 13 15:15:36.873466 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 13 15:15:36.873466 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 13 15:15:36.873466 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 13 15:15:36.873466 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 13 15:15:36.873466 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application result = self._query(query) Sep 13 15:15:36.873466 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 13 15:15:36.873466 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application conn.query(q) Sep 13 15:15:36.873466 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 13 15:15:36.873466 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 13 15:15:36.873466 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 13 15:15:36.873466 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application result.read() Sep 13 15:15:36.873466 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 13 15:15:36.874437 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 13 15:15:36.874437 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 13 15:15:36.874437 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 13 15:15:36.874437 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 13 15:15:36.874437 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 13 15:15:36.874437 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 13 15:15:36.874437 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 13 15:15:36.874437 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 13 15:15:36.874437 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Sep 13 15:15:36.874437 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 13 15:15:36.874437 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Sep 13 15:15:36.874437 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:15:36.874437 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 13 15:15:36.874437 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 13 15:15:36.874437 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Sep 13 15:15:36.874437 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return ref.to_dict() Sep 13 15:15:36.874437 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 13 15:15:36.874437 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application next(self.gen) Sep 13 15:15:36.875365 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 13 15:15:36.875365 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application yield resource Sep 13 15:15:36.875365 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 13 15:15:36.875365 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application next(self.gen) Sep 13 15:15:36.875365 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 13 15:15:36.875365 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self.session.rollback() Sep 13 15:15:36.875365 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 13 15:15:36.875365 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self.force_reraise() Sep 13 15:15:36.875365 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 13 15:15:36.875365 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise self.value Sep 13 15:15:36.875365 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 13 15:15:36.875365 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 13 15:15:36.875365 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 13 15:15:36.875365 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application session.commit() Sep 13 15:15:36.875365 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 13 15:15:36.875365 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 13 15:15:36.875365 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 13 15:15:36.876226 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self._prepare_impl() Sep 13 15:15:36.876226 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 13 15:15:36.876226 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self.session.flush() Sep 13 15:15:36.876226 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 13 15:15:36.876226 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self._flush(objects) Sep 13 15:15:36.876226 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 13 15:15:36.876226 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 13 15:15:36.876226 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 13 15:15:36.876226 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application compat.raise_( Sep 13 15:15:36.876226 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 13 15:15:36.876226 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception Sep 13 15:15:36.876226 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 13 15:15:36.876226 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application flush_context.execute() Sep 13 15:15:36.876226 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 13 15:15:36.876226 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rec.execute(self) Sep 13 15:15:36.876226 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 13 15:15:36.876226 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 13 15:15:36.877103 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 13 15:15:36.877103 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 13 15:15:36.877103 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 13 15:15:36.877103 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 13 15:15:36.877103 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 13 15:15:36.877103 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 13 15:15:36.877103 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 13 15:15:36.877103 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 13 15:15:36.877103 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 13 15:15:36.877103 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 13 15:15:36.877103 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 13 15:15:36.877103 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 13 15:15:36.877103 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 13 15:15:36.877103 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 13 15:15:36.877103 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 13 15:15:36.877103 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception Sep 13 15:15:36.879166 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 13 15:15:36.879166 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 13 15:15:36.879166 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 13 15:15:36.879166 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 13 15:15:36.879166 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 13 15:15:36.879166 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application result = self._query(query) Sep 13 15:15:36.879166 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 13 15:15:36.879166 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application conn.query(q) Sep 13 15:15:36.879166 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 13 15:15:36.879166 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 13 15:15:36.879166 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 13 15:15:36.879166 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application result.read() Sep 13 15:15:36.879166 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 13 15:15:36.879166 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 13 15:15:36.879166 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 13 15:15:36.879166 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 13 15:15:36.881089 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 13 15:15:36.881089 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 13 15:15:36.881089 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 13 15:15:36.881089 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 13 15:15:36.881089 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 13 15:15:36.881089 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 13 15:15:36.881089 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [parameters: {'id': 'c3f3c4c3bf2e4370810d64a04f2efd9a', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 13 15:15:36.881089 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 13 15:15:36.881089 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Sep 13 15:15:36.881089 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 15:15:36.881089 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Sep 13 15:15:36.881089 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:15:36.881089 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:15:36.881089 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:15:36.881089 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:15:36.881089 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:15:36.882438 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:15:36.882438 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:15:36.882438 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:15:36.882438 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:15:36.882438 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:15:36.882438 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:15:36.882438 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Sep 13 15:15:36.882438 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Sep 13 15:15:36.882438 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:15:36.882438 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:15:36.882438 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Sep 13 15:15:36.882438 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Sep 13 15:15:36.882438 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 13 15:15:36.882438 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 13 15:15:36.882438 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 13 15:15:36.882438 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Sep 13 15:15:36.884335 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 251/478] 10.222.0.27 () {60 vars in 1131 bytes} [Tue Sep 13 15:15:36 2022] POST /identity/v3/roles => generated 144 bytes in 201 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Sep 13 15:15:36.884482 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0016c8-240c-46c1-831e-40f72f17c57b None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:36.994008 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0016c8-240c-46c1-831e-40f72f17c57b None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:37.030166 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec3516f-70cb-4d32-a51a-e3e79e95f4dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:37.030805 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec3516f-70cb-4d32-a51a-e3e79e95f4dc None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:37.031089 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec3516f-70cb-4d32-a51a-e3e79e95f4dc None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:37.031368 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec3516f-70cb-4d32-a51a-e3e79e95f4dc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:37.043622 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec3516f-70cb-4d32-a51a-e3e79e95f4dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 15:15:37.049101 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-4ec3516f-70cb-4d32-a51a-e3e79e95f4dc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 15:15:37.049101 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:15:37.049101 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:15:37.049101 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:15:37.049101 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:15:37.049101 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:15:37.049101 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:15:37.049101 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:15:37.049101 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:15:37.049101 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:15:37.049101 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:15:37.049101 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:15:37.049101 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 15:15:37.049101 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 15:15:37.049101 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 15:15:37.049101 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 15:15:37.051202 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 15:15:37.051202 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 15:15:37.051202 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 15:15:37.051202 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 15:15:37.051202 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:15:37.051202 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:15:37.051202 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:15:37.051202 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:15:37.051202 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:15:37.051202 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:15:37.051202 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:15:37.051202 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Sep 13 15:15:37.051202 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:15:37.051202 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:15:37.051202 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:15:37.051202 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:15:37.053090 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:15:37.053090 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:15:37.053090 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:15:37.053090 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:15:37.053090 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 15:15:37.053090 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 15:15:37.053090 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 15:15:37.053090 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 15:15:37.053090 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 15:15:37.053090 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 15:15:37.053090 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 15:15:37.053090 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Sep 13 15:15:37.055354 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 228/479] 10.222.0.27 () {56 vars in 1114 bytes} [Tue Sep 13 15:15:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:15:37.059115 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e73db51-9a52-4181-903c-7f4363746d5d None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:37.071367 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:37.173944 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e73db51-9a52-4181-903c-7f4363746d5d None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:37.214087 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460d41cb-5a5d-44ac-b621-b975ea9c6e0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:37.214942 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460d41cb-5a5d-44ac-b621-b975ea9c6e0f None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:37.215390 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460d41cb-5a5d-44ac-b621-b975ea9c6e0f None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:37.215808 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460d41cb-5a5d-44ac-b621-b975ea9c6e0f None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:37.216615 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460d41cb-5a5d-44ac-b621-b975ea9c6e0f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:15:37.217065 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460d41cb-5a5d-44ac-b621-b975ea9c6e0f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:37.218606 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460d41cb-5a5d-44ac-b621-b975ea9c6e0f None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:37.227520 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 252/480] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Sep 13 15:15:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:15:38.255421 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56456964-fd03-4c09-a90f-fc89b9037cdd None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:38.255944 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56456964-fd03-4c09-a90f-fc89b9037cdd None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:38.256232 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56456964-fd03-4c09-a90f-fc89b9037cdd None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:38.258220 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 229/481] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:15:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:15:38.263822 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda96a6f-66b5-478f-9db0-4a72c4b81ff0 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:38.264576 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda96a6f-66b5-478f-9db0-4a72c4b81ff0 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:38.264858 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda96a6f-66b5-478f-9db0-4a72c4b81ff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:38.293995 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-bda96a6f-66b5-478f-9db0-4a72c4b81ff0 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:15:38.295210 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-bda96a6f-66b5-478f-9db0-4a72c4b81ff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:15:38.376493 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:38.387266 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 253/482] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:15:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 15:15:38.774483 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56456964-fd03-4c09-a90f-fc89b9037cdd None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:38.838191 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:38.906877 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56456964-fd03-4c09-a90f-fc89b9037cdd None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:38.960584 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c6cbc4-4577-4460-9592-c910dd6adc3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:38.961254 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c6cbc4-4577-4460-9592-c910dd6adc3a None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:38.961534 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c6cbc4-4577-4460-9592-c910dd6adc3a None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:38.961851 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c6cbc4-4577-4460-9592-c910dd6adc3a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:38.979504 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c6cbc4-4577-4460-9592-c910dd6adc3a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 15:15:38.984431 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-77c6cbc4-4577-4460-9592-c910dd6adc3a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 15:15:38.984431 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:15:38.984431 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:15:38.984431 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:15:38.984431 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:15:38.984431 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:15:38.984431 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:15:38.984431 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:15:38.984431 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:15:38.984431 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:15:38.984431 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:15:38.984431 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:15:38.984431 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 15:15:38.984431 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 15:15:38.984431 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 15:15:38.984431 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 15:15:38.985312 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 15:15:38.985312 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 15:15:38.985312 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 15:15:38.985312 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 15:15:38.985312 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:15:38.985312 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:15:38.985312 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:15:38.985312 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:15:38.985312 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:15:38.985312 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:15:38.985312 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:15:38.985312 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Sep 13 15:15:38.985312 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:15:38.985312 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:15:38.985312 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:15:38.985312 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:15:38.986176 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:15:38.986176 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:15:38.986176 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:15:38.986176 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:15:38.986176 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 15:15:38.986176 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 15:15:38.986176 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 15:15:38.986176 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 15:15:38.986176 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 15:15:38.986176 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 15:15:38.986176 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 15:15:38.986176 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Sep 13 15:15:38.988206 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 230/483] 10.222.0.27 () {56 vars in 1102 bytes} [Tue Sep 13 15:15:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:15:38.993906 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda96a6f-66b5-478f-9db0-4a72c4b81ff0 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:39.060381 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5066372d-f4a8-4cd0-87b4-0acfe929297b None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:39.060727 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5066372d-f4a8-4cd0-87b4-0acfe929297b None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:39.060944 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5066372d-f4a8-4cd0-87b4-0acfe929297b None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:39.062603 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 231/484] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:15:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 15:15:39.079163 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70edd6f1-e02b-4413-ae0f-7898690ba9d8 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:39.079515 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70edd6f1-e02b-4413-ae0f-7898690ba9d8 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:39.079707 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70edd6f1-e02b-4413-ae0f-7898690ba9d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:39.103533 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-70edd6f1-e02b-4413-ae0f-7898690ba9d8 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:15:39.104750 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-70edd6f1-e02b-4413-ae0f-7898690ba9d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:15:39.151410 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda96a6f-66b5-478f-9db0-4a72c4b81ff0 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:39.214916 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a105d3ec-a6be-46c8-a4e4-29b85497ac1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:39.215579 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a105d3ec-a6be-46c8-a4e4-29b85497ac1c None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:39.215859 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a105d3ec-a6be-46c8-a4e4-29b85497ac1c None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:39.216910 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a105d3ec-a6be-46c8-a4e4-29b85497ac1c None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:39.217590 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a105d3ec-a6be-46c8-a4e4-29b85497ac1c None admin] RBAC: Adding query filter params (name=service) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:15:39.217926 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a105d3ec-a6be-46c8-a4e4-29b85497ac1c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:39.219313 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a105d3ec-a6be-46c8-a4e4-29b85497ac1c None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:39.231597 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 232/485] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:15:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 15:15:39.235311 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 254/486] 10.222.0.27 () {56 vars in 1103 bytes} [Tue Sep 13 15:15:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:15:39.240819 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70edd6f1-e02b-4413-ae0f-7898690ba9d8 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:39.300005 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:39.389464 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70edd6f1-e02b-4413-ae0f-7898690ba9d8 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:39.394497 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556db47b-3f8f-4ac4-987f-ce4c286b4d25 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:39.394945 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556db47b-3f8f-4ac4-987f-ce4c286b4d25 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:39.395118 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556db47b-3f8f-4ac4-987f-ce4c286b4d25 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:39.396728 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 255/487] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:15:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 15:15:39.403433 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55b8738-a9c1-458c-ba5a-60a5973f6f7b None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:39.403721 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55b8738-a9c1-458c-ba5a-60a5973f6f7b None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:39.403998 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55b8738-a9c1-458c-ba5a-60a5973f6f7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:39.423081 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-f55b8738-a9c1-458c-ba5a-60a5973f6f7b None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:15:39.424271 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-f55b8738-a9c1-458c-ba5a-60a5973f6f7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:15:39.437942 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f086d02-9e0d-4ddd-b0dc-43504998661d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:39.438582 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f086d02-9e0d-4ddd-b0dc-43504998661d None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:39.438914 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f086d02-9e0d-4ddd-b0dc-43504998661d None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:39.439196 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f086d02-9e0d-4ddd-b0dc-43504998661d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:39.453038 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f086d02-9e0d-4ddd-b0dc-43504998661d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:39.455218 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f086d02-9e0d-4ddd-b0dc-43504998661d None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:39.473985 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-4f086d02-9e0d-4ddd-b0dc-43504998661d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 15:15:39.473985 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:15:39.473985 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:15:39.473985 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:15:39.473985 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:15:39.473985 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:15:39.473985 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:15:39.473985 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:15:39.473985 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:15:39.473985 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:15:39.473985 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:15:39.473985 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:15:39.473985 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 15:15:39.473985 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 15:15:39.473985 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 15:15:39.473985 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 15:15:39.474905 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:15:39.474905 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:15:39.474905 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:15:39.474905 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:15:39.474905 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:15:39.474905 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:15:39.474905 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:15:39.474905 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Sep 13 15:15:39.474905 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:15:39.474905 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:15:39.474905 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:15:39.474905 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:15:39.474905 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:15:39.474905 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:15:39.474905 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:15:39.474905 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:15:39.474905 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 15:15:39.476398 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 15:15:39.476398 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 15:15:39.476398 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Sep 13 15:15:39.476398 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 233/488] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 13 15:15:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:15:39.478142 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4835a60b-7e32-4af0-80fa-016dcbb0dd62 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:39.478434 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4835a60b-7e32-4af0-80fa-016dcbb0dd62 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:39.478717 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4835a60b-7e32-4af0-80fa-016dcbb0dd62 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:39.480207 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 234/489] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:15:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:15:39.485341 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4835a60b-7e32-4af0-80fa-016dcbb0dd62 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:39.501028 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:39.522216 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 256/490] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:15:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 15:15:39.523607 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4683bad-1dd3-4367-a220-b923fcea850e None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:39.523895 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4683bad-1dd3-4367-a220-b923fcea850e None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:39.524170 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4683bad-1dd3-4367-a220-b923fcea850e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:39.561804 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-a4683bad-1dd3-4367-a220-b923fcea850e None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:15:39.562995 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-a4683bad-1dd3-4367-a220-b923fcea850e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:15:39.633748 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:39.644789 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4835a60b-7e32-4af0-80fa-016dcbb0dd62 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:39.672812 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 257/491] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:15:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 15:15:39.682415 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4683bad-1dd3-4367-a220-b923fcea850e None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:39.684131 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d032d3-d17f-44ec-8c13-00423f284376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:39.685126 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d032d3-d17f-44ec-8c13-00423f284376 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:39.685767 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d032d3-d17f-44ec-8c13-00423f284376 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:39.686239 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d032d3-d17f-44ec-8c13-00423f284376 None admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:39.687100 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d032d3-d17f-44ec-8c13-00423f284376 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:15:39.687596 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d032d3-d17f-44ec-8c13-00423f284376 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:39.689228 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d032d3-d17f-44ec-8c13-00423f284376 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:39.703988 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 235/492] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Sep 13 15:15:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:15:39.711737 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d032d3-d17f-44ec-8c13-00423f284376 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:39.798660 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4683bad-1dd3-4367-a220-b923fcea850e None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:39.824253 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:39.835203 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae64464-0fe5-4e2a-bb6b-1cb4059dc0ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:39.835849 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae64464-0fe5-4e2a-bb6b-1cb4059dc0ab None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:39.836136 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae64464-0fe5-4e2a-bb6b-1cb4059dc0ab None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:39.836417 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae64464-0fe5-4e2a-bb6b-1cb4059dc0ab None admin] PATH_INFO: `/v3/roles/service` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:39.847543 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae64464-0fe5-4e2a-bb6b-1cb4059dc0ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 15:15:39.853500 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-cae64464-0fe5-4e2a-bb6b-1cb4059dc0ab None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 15:15:39.853500 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:15:39.853500 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:15:39.853500 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:15:39.853500 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:15:39.853500 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:15:39.853500 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:15:39.853500 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:15:39.853500 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:15:39.853500 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:15:39.853500 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:15:39.853500 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:15:39.853500 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 15:15:39.853500 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 15:15:39.853500 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 15:15:39.853500 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 15:15:39.854376 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 15:15:39.854376 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 15:15:39.854376 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 15:15:39.854376 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 15:15:39.854376 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:15:39.854376 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:15:39.854376 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:15:39.854376 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:15:39.854376 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:15:39.854376 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:15:39.854376 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:15:39.854376 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Sep 13 15:15:39.854376 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:15:39.854376 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:15:39.854376 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:15:39.854376 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:15:39.855208 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:15:39.855208 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:15:39.855208 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:15:39.855208 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:15:39.855208 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 15:15:39.855208 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 15:15:39.855208 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 15:15:39.855208 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 15:15:39.855208 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 15:15:39.855208 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 15:15:39.855208 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 15:15:39.855208 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Sep 13 15:15:39.855208 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 258/493] 10.222.0.27 () {56 vars in 1102 bytes} [Tue Sep 13 15:15:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:15:39.862158 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae64464-0fe5-4e2a-bb6b-1cb4059dc0ab None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:39.919080 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d032d3-d17f-44ec-8c13-00423f284376 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:39.961143 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8694f5-21eb-46df-aef2-dec4f1da0148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:39.961143 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8694f5-21eb-46df-aef2-dec4f1da0148 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:39.961143 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8694f5-21eb-46df-aef2-dec4f1da0148 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:39.961143 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8694f5-21eb-46df-aef2-dec4f1da0148 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:39.967783 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8694f5-21eb-46df-aef2-dec4f1da0148 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:39.969376 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8694f5-21eb-46df-aef2-dec4f1da0148 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:39.983811 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-1b8694f5-21eb-46df-aef2-dec4f1da0148 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 13 15:15:39.983811 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:15:39.983811 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:15:39.983811 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:15:39.983811 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:15:39.983811 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:15:39.983811 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:15:39.983811 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:15:39.983811 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:15:39.983811 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:15:39.983811 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:15:39.983811 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:15:39.983811 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 15:15:39.983811 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 15:15:39.983811 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 15:15:39.983811 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 15:15:39.984792 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:15:39.984792 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:15:39.984792 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 15:15:39.984792 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 15:15:39.984792 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 15:15:39.984792 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 15:15:39.984792 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:15:39.984792 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:15:39.984792 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:15:39.984792 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:15:39.984792 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:15:39.984792 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Sep 13 15:15:39.984792 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:15:39.984792 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:15:39.984792 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:15:39.984792 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:15:39.984792 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:15:39.984792 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:15:39.985681 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:15:39.985681 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:15:39.985681 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 15:15:39.985681 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 15:15:39.985681 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 15:15:39.985681 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 15:15:39.985681 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 15:15:39.985681 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 15:15:39.985681 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 13 15:15:39.985681 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Sep 13 15:15:39.985681 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 236/494] 10.222.0.27 () {56 vars in 1093 bytes} [Tue Sep 13 15:15:39 2022] GET /identity/v3/users/nova => generated 82 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:15:39.986383 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8694f5-21eb-46df-aef2-dec4f1da0148 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:39.991116 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae64464-0fe5-4e2a-bb6b-1cb4059dc0ab None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:40.004420 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:40.027435 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f235814-3f5f-4401-9f24-f9730e3e9784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:40.028095 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f235814-3f5f-4401-9f24-f9730e3e9784 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:40.028380 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f235814-3f5f-4401-9f24-f9730e3e9784 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:40.028653 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f235814-3f5f-4401-9f24-f9730e3e9784 None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:40.029316 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f235814-3f5f-4401-9f24-f9730e3e9784 None admin] RBAC: Adding query filter params (name=service) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:15:40.029624 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f235814-3f5f-4401-9f24-f9730e3e9784 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:40.031019 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f235814-3f5f-4401-9f24-f9730e3e9784 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:40.041896 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 259/495] 10.222.0.27 () {56 vars in 1103 bytes} [Tue Sep 13 15:15:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:15:40.041896 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f235814-3f5f-4401-9f24-f9730e3e9784 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:40.089923 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:40.105102 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8694f5-21eb-46df-aef2-dec4f1da0148 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:40.139938 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971bda35-ce1c-4c94-8363-525dd702a8ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:40.140603 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971bda35-ce1c-4c94-8363-525dd702a8ef None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:40.140887 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971bda35-ce1c-4c94-8363-525dd702a8ef None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:40.141164 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971bda35-ce1c-4c94-8363-525dd702a8ef None admin] PATH_INFO: `/v3/roles/service` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:40.152294 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f235814-3f5f-4401-9f24-f9730e3e9784 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:40.153867 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971bda35-ce1c-4c94-8363-525dd702a8ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 15:15:40.159418 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-971bda35-ce1c-4c94-8363-525dd702a8ef None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 15:15:40.159418 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:15:40.159418 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:15:40.159418 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:15:40.159418 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:15:40.159418 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:15:40.159418 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:15:40.159418 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:15:40.159418 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:15:40.159418 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:15:40.159418 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:15:40.159418 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:15:40.159418 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 15:15:40.159418 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 15:15:40.159418 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 15:15:40.159418 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 15:15:40.160373 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 15:15:40.160373 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 15:15:40.160373 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 15:15:40.160373 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 15:15:40.160373 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:15:40.160373 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:15:40.160373 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:15:40.160373 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:15:40.160373 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:15:40.160373 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:15:40.160373 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:15:40.160373 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Sep 13 15:15:40.160373 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:15:40.160373 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:15:40.160373 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:15:40.160373 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:15:40.161193 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:15:40.161193 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:15:40.161193 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:15:40.161193 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:15:40.161193 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 15:15:40.161193 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 15:15:40.161193 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 15:15:40.161193 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 15:15:40.161193 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 15:15:40.161193 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 15:15:40.161193 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 15:15:40.161193 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Sep 13 15:15:40.161193 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 237/496] 10.222.0.27 () {56 vars in 1102 bytes} [Tue Sep 13 15:15:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:15:40.161889 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971bda35-ce1c-4c94-8363-525dd702a8ef None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:40.192834 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92ca59e-ef84-4ee8-b91c-628f1285d7a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:40.193442 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92ca59e-ef84-4ee8-b91c-628f1285d7a9 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:40.193745 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92ca59e-ef84-4ee8-b91c-628f1285d7a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:40.194090 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92ca59e-ef84-4ee8-b91c-628f1285d7a9 None admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:40.194792 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92ca59e-ef84-4ee8-b91c-628f1285d7a9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:15:40.195100 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92ca59e-ef84-4ee8-b91c-628f1285d7a9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:40.196853 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92ca59e-ef84-4ee8-b91c-628f1285d7a9 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:40.233953 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:40.240081 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 260/497] 10.222.0.27 () {56 vars in 1133 bytes} [Tue Sep 13 15:15:40 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:15:40.240847 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92ca59e-ef84-4ee8-b91c-628f1285d7a9 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:40.266193 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971bda35-ce1c-4c94-8363-525dd702a8ef None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:40.302745 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6886ef4a-e2a1-444a-9277-7cf8a49760f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:40.303371 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6886ef4a-e2a1-444a-9277-7cf8a49760f9 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:40.303754 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6886ef4a-e2a1-444a-9277-7cf8a49760f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:40.304033 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6886ef4a-e2a1-444a-9277-7cf8a49760f9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:40.313946 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6886ef4a-e2a1-444a-9277-7cf8a49760f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 15:15:40.319711 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-6886ef4a-e2a1-444a-9277-7cf8a49760f9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 15:15:40.319711 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:15:40.319711 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:15:40.319711 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:15:40.319711 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:15:40.319711 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:15:40.319711 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:15:40.319711 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:15:40.319711 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:15:40.319711 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:15:40.319711 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:15:40.319711 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:15:40.319711 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 15:15:40.319711 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 15:15:40.319711 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 15:15:40.319711 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 15:15:40.321239 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 15:15:40.321239 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 15:15:40.321239 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 15:15:40.321239 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 15:15:40.321239 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:15:40.321239 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:15:40.321239 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:15:40.321239 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:15:40.321239 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:15:40.321239 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:15:40.321239 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:15:40.321239 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Sep 13 15:15:40.321239 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:15:40.321239 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:15:40.321239 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:15:40.321239 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:15:40.322086 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:15:40.322086 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:15:40.322086 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:15:40.322086 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:15:40.322086 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 15:15:40.322086 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 15:15:40.322086 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 15:15:40.322086 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 15:15:40.322086 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 15:15:40.322086 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 15:15:40.322086 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 15:15:40.322086 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Sep 13 15:15:40.322086 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 238/498] 10.222.0.27 () {56 vars in 1102 bytes} [Tue Sep 13 15:15:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:15:40.322086 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6886ef4a-e2a1-444a-9277-7cf8a49760f9 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:40.341033 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:40.344070 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92ca59e-ef84-4ee8-b91c-628f1285d7a9 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:40.378459 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b38c59-4ecd-49b1-9934-275553f1ccd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:40.379082 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b38c59-4ecd-49b1-9934-275553f1ccd7 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:40.379364 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b38c59-4ecd-49b1-9934-275553f1ccd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:40.379638 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b38c59-4ecd-49b1-9934-275553f1ccd7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:40.390264 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b38c59-4ecd-49b1-9934-275553f1ccd7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:40.391746 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b38c59-4ecd-49b1-9934-275553f1ccd7 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:40.406807 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-79b38c59-4ecd-49b1-9934-275553f1ccd7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 15:15:40.406807 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:15:40.406807 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:15:40.406807 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:15:40.406807 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:15:40.406807 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:15:40.406807 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:15:40.406807 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:15:40.406807 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:15:40.406807 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:15:40.406807 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:15:40.406807 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:15:40.406807 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 15:15:40.406807 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 15:15:40.406807 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 15:15:40.406807 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 15:15:40.408131 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:15:40.408131 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:15:40.408131 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:15:40.408131 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:15:40.408131 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:15:40.408131 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:15:40.408131 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:15:40.408131 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Sep 13 15:15:40.408131 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:15:40.408131 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:15:40.408131 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:15:40.408131 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:15:40.408131 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:15:40.408131 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:15:40.408131 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:15:40.408131 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:15:40.408131 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 15:15:40.408946 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 15:15:40.408946 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 15:15:40.408946 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Sep 13 15:15:40.408946 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 261/499] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 13 15:15:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:15:40.408946 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b38c59-4ecd-49b1-9934-275553f1ccd7 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:40.424521 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6886ef4a-e2a1-444a-9277-7cf8a49760f9 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:40.454051 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:40.459294 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea74c916-3650-43cb-a157-572dd4481451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:40.460488 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea74c916-3650-43cb-a157-572dd4481451 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:40.460770 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea74c916-3650-43cb-a157-572dd4481451 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:40.461215 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea74c916-3650-43cb-a157-572dd4481451 None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:40.461915 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea74c916-3650-43cb-a157-572dd4481451 None admin] RBAC: Adding query filter params (name=service) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:15:40.462221 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea74c916-3650-43cb-a157-572dd4481451 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:40.463626 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea74c916-3650-43cb-a157-572dd4481451 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:40.471833 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 239/500] 10.222.0.27 () {56 vars in 1103 bytes} [Tue Sep 13 15:15:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:15:40.473056 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01fcff2-dfdb-4759-924d-44d999bc8f88 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:40.473346 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01fcff2-dfdb-4759-924d-44d999bc8f88 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:40.473622 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01fcff2-dfdb-4759-924d-44d999bc8f88 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:40.477753 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 240/501] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:15:40 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:15:40.477753 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01fcff2-dfdb-4759-924d-44d999bc8f88 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:40.511156 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b38c59-4ecd-49b1-9934-275553f1ccd7 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:40.544329 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eead135-9960-4d32-906c-4e0b5c6a11cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:40.545164 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eead135-9960-4d32-906c-4e0b5c6a11cc None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:40.545445 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eead135-9960-4d32-906c-4e0b5c6a11cc None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:40.545754 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eead135-9960-4d32-906c-4e0b5c6a11cc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:40.566882 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:40.576340 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01fcff2-dfdb-4759-924d-44d999bc8f88 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:40.610021 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9132e4e0-1af9-48bd-aea0-dda874bc78b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:40.610549 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9132e4e0-1af9-48bd-aea0-dda874bc78b4 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:40.610827 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9132e4e0-1af9-48bd-aea0-dda874bc78b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:40.611100 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9132e4e0-1af9-48bd-aea0-dda874bc78b4 None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:40.611757 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9132e4e0-1af9-48bd-aea0-dda874bc78b4 None admin] RBAC: Adding query filter params (name=service) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:15:40.612058 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9132e4e0-1af9-48bd-aea0-dda874bc78b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:40.613421 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9132e4e0-1af9-48bd-aea0-dda874bc78b4 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:40.613526 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eead135-9960-4d32-906c-4e0b5c6a11cc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:40.615077 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eead135-9960-4d32-906c-4e0b5c6a11cc None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:40.621456 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 241/502] 10.222.0.27 () {56 vars in 1103 bytes} [Tue Sep 13 15:15:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:15:40.622265 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9132e4e0-1af9-48bd-aea0-dda874bc78b4 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:40.677551 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:40.720174 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 262/503] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Sep 13 15:15:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 15:15:40.720354 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eead135-9960-4d32-906c-4e0b5c6a11cc None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:40.726844 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9132e4e0-1af9-48bd-aea0-dda874bc78b4 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:40.761011 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f13553-fbd6-4d17-a76e-3b3013b74d43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:40.761615 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f13553-fbd6-4d17-a76e-3b3013b74d43 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:40.761927 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f13553-fbd6-4d17-a76e-3b3013b74d43 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:40.762203 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f13553-fbd6-4d17-a76e-3b3013b74d43 None admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:40.762837 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f13553-fbd6-4d17-a76e-3b3013b74d43 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:15:40.763143 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f13553-fbd6-4d17-a76e-3b3013b74d43 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:40.764549 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f13553-fbd6-4d17-a76e-3b3013b74d43 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:40.770940 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:40.782091 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 242/504] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Sep 13 15:15:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:15:40.782091 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae301b75-22e0-4682-94b9-509405b19995 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:40.782091 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae301b75-22e0-4682-94b9-509405b19995 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:40.782091 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae301b75-22e0-4682-94b9-509405b19995 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:40.797718 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-ae301b75-22e0-4682-94b9-509405b19995 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:15:40.798918 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-ae301b75-22e0-4682-94b9-509405b19995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:15:40.818487 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eead135-9960-4d32-906c-4e0b5c6a11cc None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:40.852586 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c698a443-66cf-4981-8447-cc79fcdb379d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:40.853202 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c698a443-66cf-4981-8447-cc79fcdb379d None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:40.853489 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c698a443-66cf-4981-8447-cc79fcdb379d None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:40.853788 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c698a443-66cf-4981-8447-cc79fcdb379d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:40.863419 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c698a443-66cf-4981-8447-cc79fcdb379d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:40.863789 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 243/505] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:15:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 15:15:40.864612 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae301b75-22e0-4682-94b9-509405b19995 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:40.875366 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c698a443-66cf-4981-8447-cc79fcdb379d None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:40.889938 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-c698a443-66cf-4981-8447-cc79fcdb379d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 15:15:40.889938 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:15:40.889938 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:15:40.889938 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:15:40.889938 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:15:40.889938 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:15:40.889938 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:15:40.889938 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:15:40.889938 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:15:40.889938 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:15:40.889938 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:15:40.889938 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:15:40.889938 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 15:15:40.889938 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 15:15:40.889938 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 15:15:40.889938 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 15:15:40.890881 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:15:40.890881 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:15:40.890881 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:15:40.890881 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:15:40.890881 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:15:40.890881 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:15:40.890881 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:15:40.890881 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Sep 13 15:15:40.890881 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:15:40.890881 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:15:40.890881 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:15:40.890881 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:15:40.890881 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:15:40.890881 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:15:40.890881 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:15:40.890881 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:15:40.890881 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 15:15:40.891747 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 15:15:40.891747 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 15:15:40.891747 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Sep 13 15:15:40.891747 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 263/506] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 13 15:15:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:15:40.891962 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c698a443-66cf-4981-8447-cc79fcdb379d None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:40.919355 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:40.976155 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae301b75-22e0-4682-94b9-509405b19995 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:40.997804 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c698a443-66cf-4981-8447-cc79fcdb379d None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:41.001006 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:41.013798 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bccb07f-19f9-4aaa-b622-237f7eb28dbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:41.014430 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bccb07f-19f9-4aaa-b622-237f7eb28dbe None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:41.014715 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bccb07f-19f9-4aaa-b622-237f7eb28dbe None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:41.014992 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bccb07f-19f9-4aaa-b622-237f7eb28dbe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:41.025906 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bccb07f-19f9-4aaa-b622-237f7eb28dbe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:41.027533 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bccb07f-19f9-4aaa-b622-237f7eb28dbe None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:41.035186 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c08ffd4-d888-4b36-a15e-5f5d806b8420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:41.035809 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c08ffd4-d888-4b36-a15e-5f5d806b8420 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:41.036091 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c08ffd4-d888-4b36-a15e-5f5d806b8420 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:41.036366 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c08ffd4-d888-4b36-a15e-5f5d806b8420 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:41.043250 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-2bccb07f-19f9-4aaa-b622-237f7eb28dbe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 15:15:41.043250 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:15:41.043250 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:15:41.043250 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:15:41.043250 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:15:41.043250 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:15:41.043250 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:15:41.043250 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:15:41.043250 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:15:41.043250 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:15:41.043250 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:15:41.043250 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:15:41.043250 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 15:15:41.043250 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 15:15:41.043250 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 15:15:41.043250 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 15:15:41.044184 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:15:41.044184 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:15:41.044184 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:15:41.044184 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:15:41.044184 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:15:41.044184 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:15:41.044184 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:15:41.044184 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Sep 13 15:15:41.044184 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:15:41.044184 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:15:41.044184 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:15:41.044184 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:15:41.044184 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:15:41.044184 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:15:41.044184 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:15:41.044184 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:15:41.044184 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 15:15:41.045030 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 15:15:41.045030 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 15:15:41.045030 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Sep 13 15:15:41.045030 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 244/507] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 13 15:15:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:15:41.045251 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bccb07f-19f9-4aaa-b622-237f7eb28dbe None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:41.052707 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c08ffd4-d888-4b36-a15e-5f5d806b8420 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:41.054572 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c08ffd4-d888-4b36-a15e-5f5d806b8420 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:41.073751 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-9c08ffd4-d888-4b36-a15e-5f5d806b8420 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 15:15:41.073751 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:15:41.073751 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:15:41.073751 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:15:41.073751 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:15:41.073751 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:15:41.073751 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:15:41.073751 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:15:41.073751 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:15:41.073751 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:15:41.073751 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:15:41.073751 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:15:41.073751 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 15:15:41.073751 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 15:15:41.073751 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 15:15:41.073751 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 15:15:41.074651 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:15:41.074651 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:15:41.074651 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:15:41.074651 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:15:41.074651 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:15:41.074651 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:15:41.074651 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:15:41.074651 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Sep 13 15:15:41.074651 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:15:41.074651 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:15:41.074651 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:15:41.074651 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:15:41.074651 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:15:41.074651 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:15:41.074651 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:15:41.074651 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:15:41.074651 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 15:15:41.075497 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 15:15:41.075497 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 15:15:41.075497 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Sep 13 15:15:41.075497 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 264/508] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 13 15:15:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:15:41.076318 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c08ffd4-d888-4b36-a15e-5f5d806b8420 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:41.148733 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:41.152629 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bccb07f-19f9-4aaa-b622-237f7eb28dbe None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:41.178997 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c08ffd4-d888-4b36-a15e-5f5d806b8420 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:41.185872 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eab1379-3bcf-408b-93cc-1ac7b07ff5e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:41.186499 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eab1379-3bcf-408b-93cc-1ac7b07ff5e7 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:41.186782 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eab1379-3bcf-408b-93cc-1ac7b07ff5e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:41.187055 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eab1379-3bcf-408b-93cc-1ac7b07ff5e7 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:41.196047 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eab1379-3bcf-408b-93cc-1ac7b07ff5e7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:41.197498 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eab1379-3bcf-408b-93cc-1ac7b07ff5e7 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:41.208575 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-9eab1379-3bcf-408b-93cc-1ac7b07ff5e7 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 13 15:15:41.208575 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:15:41.208575 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:15:41.208575 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:15:41.208575 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:15:41.208575 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:15:41.208575 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:15:41.208575 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:15:41.208575 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:15:41.208575 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:15:41.208575 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:15:41.208575 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:15:41.208575 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 15:15:41.208575 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 15:15:41.208575 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 15:15:41.208575 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 15:15:41.209473 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:15:41.209473 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:15:41.209473 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 15:15:41.209473 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 15:15:41.209473 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 15:15:41.209473 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 15:15:41.209473 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:15:41.209473 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:15:41.209473 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:15:41.209473 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:15:41.209473 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:15:41.209473 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Sep 13 15:15:41.209473 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:15:41.209473 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:15:41.209473 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:15:41.209473 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:15:41.209473 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:15:41.209473 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:15:41.211080 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:15:41.211080 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:15:41.211080 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 15:15:41.211080 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 15:15:41.211080 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 15:15:41.211080 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 15:15:41.211080 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 15:15:41.211080 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 15:15:41.211080 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 13 15:15:41.211080 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Sep 13 15:15:41.211080 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 245/509] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Sep 13 15:15:41 2022] GET /identity/v3/users/glance => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:15:41.211655 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eab1379-3bcf-408b-93cc-1ac7b07ff5e7 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:41.216677 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0acfd4-7233-48f6-9a37-470bdf6424d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:41.217287 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0acfd4-7233-48f6-9a37-470bdf6424d5 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:41.217566 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0acfd4-7233-48f6-9a37-470bdf6424d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:41.217879 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0acfd4-7233-48f6-9a37-470bdf6424d5 None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:41.218518 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0acfd4-7233-48f6-9a37-470bdf6424d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:15:41.218822 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0acfd4-7233-48f6-9a37-470bdf6424d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:41.220178 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0acfd4-7233-48f6-9a37-470bdf6424d5 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:41.237112 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 265/510] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Sep 13 15:15:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:15:41.237927 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0acfd4-7233-48f6-9a37-470bdf6424d5 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:41.254733 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:41.313461 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eab1379-3bcf-408b-93cc-1ac7b07ff5e7 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:41.337467 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0acfd4-7233-48f6-9a37-470bdf6424d5 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:41.347665 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e21b273-d2f4-4d40-bd2d-f9ca2eda63d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:41.348279 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e21b273-d2f4-4d40-bd2d-f9ca2eda63d3 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:41.348558 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e21b273-d2f4-4d40-bd2d-f9ca2eda63d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:41.348830 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e21b273-d2f4-4d40-bd2d-f9ca2eda63d3 None admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:41.349468 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e21b273-d2f4-4d40-bd2d-f9ca2eda63d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:15:41.349807 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e21b273-d2f4-4d40-bd2d-f9ca2eda63d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:41.351312 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e21b273-d2f4-4d40-bd2d-f9ca2eda63d3 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:41.362620 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 246/511] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Sep 13 15:15:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:15:41.363396 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e21b273-d2f4-4d40-bd2d-f9ca2eda63d3 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:41.371736 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44004d0b-5bab-4d00-a5db-d258aec14f66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:41.372347 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44004d0b-5bab-4d00-a5db-d258aec14f66 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:41.372628 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44004d0b-5bab-4d00-a5db-d258aec14f66 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:41.372900 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44004d0b-5bab-4d00-a5db-d258aec14f66 None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:41.373543 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44004d0b-5bab-4d00-a5db-d258aec14f66 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:15:41.373892 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44004d0b-5bab-4d00-a5db-d258aec14f66 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:41.375278 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44004d0b-5bab-4d00-a5db-d258aec14f66 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:41.385410 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:41.387767 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 266/512] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Sep 13 15:15:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:15:41.388666 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44004d0b-5bab-4d00-a5db-d258aec14f66 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:41.468753 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e21b273-d2f4-4d40-bd2d-f9ca2eda63d3 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:41.468926 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:41.492836 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44004d0b-5bab-4d00-a5db-d258aec14f66 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:41.503843 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b5ca1a-cd20-4623-8de7-fcd3e1dad657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:41.504468 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b5ca1a-cd20-4623-8de7-fcd3e1dad657 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:41.504752 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b5ca1a-cd20-4623-8de7-fcd3e1dad657 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:41.505032 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b5ca1a-cd20-4623-8de7-fcd3e1dad657 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:41.515174 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b5ca1a-cd20-4623-8de7-fcd3e1dad657 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:41.516618 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b5ca1a-cd20-4623-8de7-fcd3e1dad657 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:41.524956 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4218cc-9790-4f05-b9d0-3c30e8b49997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:41.525554 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4218cc-9790-4f05-b9d0-3c30e8b49997 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:41.525867 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4218cc-9790-4f05-b9d0-3c30e8b49997 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:41.526144 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4218cc-9790-4f05-b9d0-3c30e8b49997 None admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:41.526856 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4218cc-9790-4f05-b9d0-3c30e8b49997 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:15:41.527162 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4218cc-9790-4f05-b9d0-3c30e8b49997 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:41.528566 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4218cc-9790-4f05-b9d0-3c30e8b49997 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:41.531815 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-76b5ca1a-cd20-4623-8de7-fcd3e1dad657 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 15:15:41.531815 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:15:41.531815 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:15:41.531815 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:15:41.531815 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:15:41.531815 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:15:41.531815 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:15:41.531815 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:15:41.531815 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:15:41.531815 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:15:41.531815 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:15:41.531815 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:15:41.531815 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 15:15:41.531815 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 15:15:41.531815 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 15:15:41.531815 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 15:15:41.532754 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:15:41.532754 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:15:41.532754 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:15:41.532754 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:15:41.532754 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:15:41.532754 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:15:41.532754 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:15:41.532754 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Sep 13 15:15:41.532754 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:15:41.532754 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:15:41.532754 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:15:41.532754 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:15:41.532754 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:15:41.532754 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:15:41.532754 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:15:41.532754 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:15:41.532754 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 15:15:41.533578 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 15:15:41.533578 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 15:15:41.533578 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Sep 13 15:15:41.533578 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 247/513] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 13 15:15:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:15:41.533845 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b5ca1a-cd20-4623-8de7-fcd3e1dad657 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:41.546367 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 267/514] 10.222.0.27 () {56 vars in 1137 bytes} [Tue Sep 13 15:15:41 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:15:41.547178 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4218cc-9790-4f05-b9d0-3c30e8b49997 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:41.608844 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:41.640598 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b5ca1a-cd20-4623-8de7-fcd3e1dad657 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:41.642998 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4218cc-9790-4f05-b9d0-3c30e8b49997 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:41.674890 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c476e1-2d93-4d6c-88c9-a47a957ea51c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:41.675514 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c476e1-2d93-4d6c-88c9-a47a957ea51c None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:41.675796 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c476e1-2d93-4d6c-88c9-a47a957ea51c None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:41.676069 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c476e1-2d93-4d6c-88c9-a47a957ea51c None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:41.678038 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02d3881-50f4-4c76-bc59-fe2c803911a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:41.678730 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02d3881-50f4-4c76-bc59-fe2c803911a7 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:41.679064 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02d3881-50f4-4c76-bc59-fe2c803911a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:41.679291 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02d3881-50f4-4c76-bc59-fe2c803911a7 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:41.681175 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:41.683740 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c476e1-2d93-4d6c-88c9-a47a957ea51c None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:41.685192 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c476e1-2d93-4d6c-88c9-a47a957ea51c None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:41.686829 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02d3881-50f4-4c76-bc59-fe2c803911a7 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:41.688601 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02d3881-50f4-4c76-bc59-fe2c803911a7 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:41.697262 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-24c476e1-2d93-4d6c-88c9-a47a957ea51c None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 13 15:15:41.697262 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:15:41.697262 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:15:41.697262 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:15:41.697262 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:15:41.697262 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:15:41.697262 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:15:41.697262 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:15:41.697262 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:15:41.697262 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:15:41.697262 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:15:41.697262 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:15:41.697262 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 15:15:41.697262 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 15:15:41.697262 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 15:15:41.697262 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 15:15:41.698162 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:15:41.698162 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:15:41.698162 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 15:15:41.698162 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 15:15:41.698162 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 15:15:41.698162 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 15:15:41.698162 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:15:41.698162 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:15:41.698162 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:15:41.698162 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:15:41.698162 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:15:41.698162 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Sep 13 15:15:41.698162 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:15:41.698162 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:15:41.698162 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:15:41.698162 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:15:41.698162 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:15:41.698162 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:15:41.699066 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:15:41.699066 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:15:41.699066 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 15:15:41.699066 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 15:15:41.699066 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 15:15:41.699066 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 15:15:41.699066 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 15:15:41.699066 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 15:15:41.699066 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 13 15:15:41.699066 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Sep 13 15:15:41.699066 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 248/515] 10.222.0.27 () {56 vars in 1102 bytes} [Tue Sep 13 15:15:41 2022] GET /identity/v3/users/neutron => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:15:41.699608 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c476e1-2d93-4d6c-88c9-a47a957ea51c None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:41.701789 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-b02d3881-50f4-4c76-bc59-fe2c803911a7 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 13 15:15:41.701789 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:15:41.701789 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:15:41.701789 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:15:41.701789 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:15:41.701789 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:15:41.701789 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:15:41.701789 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:15:41.701789 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:15:41.701789 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:15:41.701789 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:15:41.701789 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:15:41.701789 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 15:15:41.701789 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 15:15:41.701789 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 15:15:41.701789 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 15:15:41.702818 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:15:41.702818 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:15:41.702818 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 15:15:41.702818 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 15:15:41.702818 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 15:15:41.702818 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 15:15:41.702818 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:15:41.702818 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:15:41.702818 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:15:41.702818 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:15:41.702818 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:15:41.702818 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Sep 13 15:15:41.702818 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:15:41.702818 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:15:41.702818 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:15:41.702818 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:15:41.702818 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:15:41.702818 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:15:41.708316 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:15:41.708316 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:15:41.708316 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 15:15:41.708316 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 15:15:41.708316 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 15:15:41.708316 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 15:15:41.708316 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 15:15:41.708316 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 15:15:41.708316 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 13 15:15:41.708316 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Sep 13 15:15:41.708316 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 268/516] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Sep 13 15:15:41 2022] GET /identity/v3/users/cinder => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:15:41.708316 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02d3881-50f4-4c76-bc59-fe2c803911a7 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:41.802814 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02d3881-50f4-4c76-bc59-fe2c803911a7 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:41.806644 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c476e1-2d93-4d6c-88c9-a47a957ea51c None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:41.835548 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:41.836316 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc1c0c3-ed0f-4cef-9e20-e4399e317b81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:41.836923 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc1c0c3-ed0f-4cef-9e20-e4399e317b81 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:41.837255 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc1c0c3-ed0f-4cef-9e20-e4399e317b81 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:41.837515 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc1c0c3-ed0f-4cef-9e20-e4399e317b81 None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:41.838287 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc1c0c3-ed0f-4cef-9e20-e4399e317b81 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:15:41.838747 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc1c0c3-ed0f-4cef-9e20-e4399e317b81 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:41.840305 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc1c0c3-ed0f-4cef-9e20-e4399e317b81 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:41.842235 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d927b088-e5bb-4d0a-80e0-df678c1ed3dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:41.842858 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d927b088-e5bb-4d0a-80e0-df678c1ed3dc None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:41.843138 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d927b088-e5bb-4d0a-80e0-df678c1ed3dc None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:41.843414 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d927b088-e5bb-4d0a-80e0-df678c1ed3dc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:41.850169 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d927b088-e5bb-4d0a-80e0-df678c1ed3dc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:41.852229 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d927b088-e5bb-4d0a-80e0-df678c1ed3dc None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:41.852530 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 269/517] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Sep 13 15:15:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:15:41.853314 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc1c0c3-ed0f-4cef-9e20-e4399e317b81 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:41.864700 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-d927b088-e5bb-4d0a-80e0-df678c1ed3dc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 15:15:41.864700 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:15:41.864700 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:15:41.864700 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:15:41.864700 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:15:41.864700 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:15:41.864700 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:15:41.864700 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:15:41.864700 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:15:41.864700 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:15:41.864700 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:15:41.864700 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:15:41.864700 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 15:15:41.864700 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 15:15:41.864700 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 15:15:41.865792 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 15:15:41.865792 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:15:41.865792 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:15:41.865792 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:15:41.865792 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:15:41.865792 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:15:41.865792 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:15:41.865792 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:15:41.865792 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Sep 13 15:15:41.865792 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:15:41.865792 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:15:41.865792 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:15:41.865792 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:15:41.865792 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:15:41.865792 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:15:41.865792 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:15:41.865792 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:15:41.866862 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 15:15:41.866862 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 15:15:41.866862 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 15:15:41.866862 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 15:15:41.866862 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 15:15:41.866862 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 15:15:41.866862 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 15:15:41.866862 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Sep 13 15:15:41.866862 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 249/518] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Sep 13 15:15:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:15:41.866862 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d927b088-e5bb-4d0a-80e0-df678c1ed3dc None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:41.914563 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:41.966867 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc1c0c3-ed0f-4cef-9e20-e4399e317b81 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:41.967303 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d927b088-e5bb-4d0a-80e0-df678c1ed3dc None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:41.999673 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fefc7a0-5ed3-427a-8cf1-27c9c8a34b4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:41.999855 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b35366-136d-4eaf-ab04-2ea5a638e90c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:42.000201 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fefc7a0-5ed3-427a-8cf1-27c9c8a34b4a None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:42.000336 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b35366-136d-4eaf-ab04-2ea5a638e90c None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:42.000485 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fefc7a0-5ed3-427a-8cf1-27c9c8a34b4a None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:42.000614 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b35366-136d-4eaf-ab04-2ea5a638e90c None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:42.000762 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fefc7a0-5ed3-427a-8cf1-27c9c8a34b4a None admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:42.000885 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b35366-136d-4eaf-ab04-2ea5a638e90c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:42.001481 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fefc7a0-5ed3-427a-8cf1-27c9c8a34b4a None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:15:42.001819 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fefc7a0-5ed3-427a-8cf1-27c9c8a34b4a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:42.003260 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fefc7a0-5ed3-427a-8cf1-27c9c8a34b4a None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:42.040517 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 250/519] 10.222.0.27 () {56 vars in 1139 bytes} [Tue Sep 13 15:15:41 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:15:42.041144 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fefc7a0-5ed3-427a-8cf1-27c9c8a34b4a None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:42.066352 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b35366-136d-4eaf-ab04-2ea5a638e90c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:42.067819 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b35366-136d-4eaf-ab04-2ea5a638e90c None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:42.091278 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:42.127027 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:42.144993 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fefc7a0-5ed3-427a-8cf1-27c9c8a34b4a None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:42.171996 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 270/520] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Sep 13 15:15:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 15:15:42.172798 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b35366-136d-4eaf-ab04-2ea5a638e90c None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:42.178082 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c165e4f8-4ba4-4eca-add8-2c69b3391868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:42.179316 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c165e4f8-4ba4-4eca-add8-2c69b3391868 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:42.179812 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c165e4f8-4ba4-4eca-add8-2c69b3391868 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:42.180092 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c165e4f8-4ba4-4eca-add8-2c69b3391868 None admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:42.180821 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c165e4f8-4ba4-4eca-add8-2c69b3391868 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:15:42.181125 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c165e4f8-4ba4-4eca-add8-2c69b3391868 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:42.182582 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c165e4f8-4ba4-4eca-add8-2c69b3391868 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:42.200691 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 251/521] 10.222.0.27 () {56 vars in 1137 bytes} [Tue Sep 13 15:15:42 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:15:42.201469 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c165e4f8-4ba4-4eca-add8-2c69b3391868 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:42.273762 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b35366-136d-4eaf-ab04-2ea5a638e90c None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:42.299118 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c165e4f8-4ba4-4eca-add8-2c69b3391868 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:42.306484 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ef988c-6606-4ec9-b204-749ede23404a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:42.307054 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:42.307170 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ef988c-6606-4ec9-b204-749ede23404a None admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:42.307352 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ef988c-6606-4ec9-b204-749ede23404a None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:42.307618 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ef988c-6606-4ec9-b204-749ede23404a None admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:42.308259 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ef988c-6606-4ec9-b204-749ede23404a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:42.309812 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ef988c-6606-4ec9-b204-749ede23404a None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:42.332283 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 271/522] 10.222.0.27 () {60 vars in 1132 bytes} [Tue Sep 13 15:15:42 2022] POST /identity/v3/users => generated 247 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:15:42.333097 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ef988c-6606-4ec9-b204-749ede23404a None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:42.335741 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a6d973-b11a-4f00-a1df-599f1d0c1272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:42.336388 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a6d973-b11a-4f00-a1df-599f1d0c1272 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:42.336644 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a6d973-b11a-4f00-a1df-599f1d0c1272 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:42.336909 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a6d973-b11a-4f00-a1df-599f1d0c1272 None admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:42.337612 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a6d973-b11a-4f00-a1df-599f1d0c1272 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:15:42.337956 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a6d973-b11a-4f00-a1df-599f1d0c1272 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:42.339415 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a6d973-b11a-4f00-a1df-599f1d0c1272 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:42.346229 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:42.367607 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 252/523] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Sep 13 15:15:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:15:42.367607 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a6d973-b11a-4f00-a1df-599f1d0c1272 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:42.452695 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ef988c-6606-4ec9-b204-749ede23404a None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:42.492426 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4b4a4d-0336-4a39-851f-75ce19b6910d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:42.493133 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4b4a4d-0336-4a39-851f-75ce19b6910d None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:42.493377 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4b4a4d-0336-4a39-851f-75ce19b6910d None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:42.493903 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4b4a4d-0336-4a39-851f-75ce19b6910d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:42.497540 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a6d973-b11a-4f00-a1df-599f1d0c1272 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:42.538216 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fbf2d6-7791-4257-8478-4c9e3e3b0377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:42.538777 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fbf2d6-7791-4257-8478-4c9e3e3b0377 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:42.539065 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fbf2d6-7791-4257-8478-4c9e3e3b0377 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:42.539348 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fbf2d6-7791-4257-8478-4c9e3e3b0377 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:42.553029 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fbf2d6-7791-4257-8478-4c9e3e3b0377 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:42.554587 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fbf2d6-7791-4257-8478-4c9e3e3b0377 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:42.571739 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-68fbf2d6-7791-4257-8478-4c9e3e3b0377 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 15:15:42.571739 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:15:42.571739 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:15:42.571739 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:15:42.571739 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:15:42.571739 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:15:42.571739 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:15:42.571739 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:15:42.571739 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:15:42.571739 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:15:42.571739 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:15:42.571739 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:15:42.571739 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 15:15:42.571739 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 15:15:42.571739 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 15:15:42.571739 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 15:15:42.572690 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:15:42.572690 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:15:42.572690 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:15:42.572690 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:15:42.572690 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:15:42.572690 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:15:42.572690 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:15:42.572690 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Sep 13 15:15:42.572690 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:15:42.572690 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:15:42.572690 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:15:42.572690 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:15:42.572690 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:15:42.572690 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:15:42.572690 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:15:42.572690 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:15:42.572690 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 15:15:42.573594 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 15:15:42.573594 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 15:15:42.573594 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Sep 13 15:15:42.573594 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 253/524] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 13 15:15:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:15:42.574566 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fbf2d6-7791-4257-8478-4c9e3e3b0377 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:42.580882 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4b4a4d-0336-4a39-851f-75ce19b6910d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:42.582561 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4b4a4d-0336-4a39-851f-75ce19b6910d None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:42.594542 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:42.597477 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:42.679501 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fbf2d6-7791-4257-8478-4c9e3e3b0377 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:42.691994 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 272/525] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Sep 13 15:15:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 15:15:42.692837 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4b4a4d-0336-4a39-851f-75ce19b6910d None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:42.728150 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783b5430-9eb3-40be-aeba-43752665d44c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:42.728970 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783b5430-9eb3-40be-aeba-43752665d44c None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:42.729158 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783b5430-9eb3-40be-aeba-43752665d44c None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:42.729535 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783b5430-9eb3-40be-aeba-43752665d44c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:42.799087 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4b4a4d-0336-4a39-851f-75ce19b6910d None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:42.806786 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783b5430-9eb3-40be-aeba-43752665d44c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:42.808397 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783b5430-9eb3-40be-aeba-43752665d44c None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:42.811054 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:42.828530 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:42.840189 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6acc403-8c76-438c-8ae5-32da4561fbcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:42.840859 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6acc403-8c76-438c-8ae5-32da4561fbcd None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:42.841145 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6acc403-8c76-438c-8ae5-32da4561fbcd None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:42.841417 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6acc403-8c76-438c-8ae5-32da4561fbcd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:42.842182 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6acc403-8c76-438c-8ae5-32da4561fbcd None admin] RBAC: Adding query filter params (role.id=470736c596a14fa5ac78200239aa1104, scope.project.id=3d6e00339cfa47d2a6fa8724c587035f, user.id=62aad71c6c1a4469805762bba330bf0e) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:15:42.842493 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6acc403-8c76-438c-8ae5-32da4561fbcd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:42.843928 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6acc403-8c76-438c-8ae5-32da4561fbcd None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:42.854082 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 273/526] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Sep 13 15:15:42 2022] GET /identity/v3/role_assignments?user.id=62aad71c6c1a4469805762bba330bf0e&scope.project.id=3d6e00339cfa47d2a6fa8724c587035f&role.id=470736c596a14fa5ac78200239aa1104 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:15:42.855455 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6acc403-8c76-438c-8ae5-32da4561fbcd None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:42.933655 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 254/527] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Sep 13 15:15:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 15:15:42.935003 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783b5430-9eb3-40be-aeba-43752665d44c None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:43.004138 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6acc403-8c76-438c-8ae5-32da4561fbcd None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:43.052378 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1020e0c9-95e9-4d50-9ad6-62c33da27904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:43.052378 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1020e0c9-95e9-4d50-9ad6-62c33da27904 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:43.052378 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1020e0c9-95e9-4d50-9ad6-62c33da27904 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:43.052378 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1020e0c9-95e9-4d50-9ad6-62c33da27904 None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:43.052749 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1020e0c9-95e9-4d50-9ad6-62c33da27904 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:15:43.052749 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1020e0c9-95e9-4d50-9ad6-62c33da27904 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:43.052749 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1020e0c9-95e9-4d50-9ad6-62c33da27904 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:43.053137 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783b5430-9eb3-40be-aeba-43752665d44c None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:43.066288 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 274/528] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Sep 13 15:15:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:15:43.067215 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1020e0c9-95e9-4d50-9ad6-62c33da27904 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:43.076356 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:43.099943 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078ccfbe-1952-4c5a-a774-e27a1a294466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:43.101645 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078ccfbe-1952-4c5a-a774-e27a1a294466 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:43.101950 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078ccfbe-1952-4c5a-a774-e27a1a294466 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:43.102226 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078ccfbe-1952-4c5a-a774-e27a1a294466 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:43.108539 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:43.117479 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078ccfbe-1952-4c5a-a774-e27a1a294466 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:43.119452 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078ccfbe-1952-4c5a-a774-e27a1a294466 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:43.139623 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-078ccfbe-1952-4c5a-a774-e27a1a294466 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 15:15:43.139623 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:15:43.139623 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:15:43.139623 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:15:43.139623 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:15:43.139623 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:15:43.139623 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:15:43.139623 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:15:43.139623 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:15:43.139623 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:15:43.139623 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:15:43.139623 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:15:43.139623 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 15:15:43.139623 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 15:15:43.139623 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 15:15:43.139623 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 15:15:43.140787 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:15:43.140787 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:15:43.140787 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:15:43.140787 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:15:43.140787 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:15:43.140787 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:15:43.140787 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:15:43.140787 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Sep 13 15:15:43.140787 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:15:43.140787 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:15:43.140787 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:15:43.140787 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:15:43.140787 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:15:43.140787 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:15:43.140787 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:15:43.140787 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:15:43.140787 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 15:15:43.141879 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 15:15:43.141879 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 15:15:43.141879 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Sep 13 15:15:43.148610 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 255/529] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 13 15:15:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:15:43.148610 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078ccfbe-1952-4c5a-a774-e27a1a294466 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:43.193094 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1020e0c9-95e9-4d50-9ad6-62c33da27904 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:43.231627 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28948256-8e8c-4f4d-adc2-0be05c90c58e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:43.232605 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28948256-8e8c-4f4d-adc2-0be05c90c58e None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:43.232924 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28948256-8e8c-4f4d-adc2-0be05c90c58e None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:43.233312 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28948256-8e8c-4f4d-adc2-0be05c90c58e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:43.244865 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28948256-8e8c-4f4d-adc2-0be05c90c58e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:43.246446 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28948256-8e8c-4f4d-adc2-0be05c90c58e None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:43.263482 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-28948256-8e8c-4f4d-adc2-0be05c90c58e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 15:15:43.263482 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:15:43.263482 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:15:43.263482 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:15:43.263482 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:15:43.263482 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:15:43.263482 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:15:43.263482 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:15:43.263482 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:15:43.263482 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:15:43.263482 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:15:43.263482 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:15:43.263482 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 15:15:43.263482 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 15:15:43.263482 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 15:15:43.263482 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 15:15:43.264645 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:15:43.264645 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:15:43.264645 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:15:43.264645 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:15:43.264645 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:15:43.264645 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:15:43.264645 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:15:43.264645 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Sep 13 15:15:43.264645 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:15:43.264645 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:15:43.264645 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:15:43.264645 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:15:43.264645 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:15:43.264645 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:15:43.264645 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:15:43.264645 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:15:43.264645 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 15:15:43.265678 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 15:15:43.265678 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 15:15:43.265678 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Sep 13 15:15:43.267289 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 275/530] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 13 15:15:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:15:43.268267 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28948256-8e8c-4f4d-adc2-0be05c90c58e None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:43.287348 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078ccfbe-1952-4c5a-a774-e27a1a294466 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:43.338742 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06630869-ea7e-4daa-a9fc-b15118bafce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:43.340685 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06630869-ea7e-4daa-a9fc-b15118bafce2 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:43.341120 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06630869-ea7e-4daa-a9fc-b15118bafce2 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:43.341540 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06630869-ea7e-4daa-a9fc-b15118bafce2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:43.351161 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06630869-ea7e-4daa-a9fc-b15118bafce2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:43.352832 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06630869-ea7e-4daa-a9fc-b15118bafce2 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:43.365620 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:43.367107 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-06630869-ea7e-4daa-a9fc-b15118bafce2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 15:15:43.367107 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:15:43.367107 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:15:43.367107 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:15:43.367107 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:15:43.367107 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:15:43.367107 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:15:43.367107 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:15:43.367107 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:15:43.367107 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:15:43.367107 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:15:43.367107 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:15:43.367107 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 15:15:43.367107 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 15:15:43.367107 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 15:15:43.368104 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 15:15:43.368104 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:15:43.368104 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:15:43.368104 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:15:43.368104 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:15:43.368104 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:15:43.368104 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:15:43.368104 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:15:43.368104 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Sep 13 15:15:43.368104 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:15:43.368104 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:15:43.368104 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:15:43.368104 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:15:43.368104 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:15:43.368104 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:15:43.368104 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:15:43.368104 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:15:43.369154 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 15:15:43.369154 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 15:15:43.369154 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 15:15:43.369154 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 15:15:43.369154 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 15:15:43.369154 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 15:15:43.369154 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 15:15:43.369154 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Sep 13 15:15:43.370704 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 256/531] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Sep 13 15:15:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:15:43.371830 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06630869-ea7e-4daa-a9fc-b15118bafce2 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:43.389550 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28948256-8e8c-4f4d-adc2-0be05c90c58e None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:43.404599 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:43.433822 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32df4f6f-dbe4-4868-9c02-7cb4526ed3ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:43.434806 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32df4f6f-dbe4-4868-9c02-7cb4526ed3ee None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:43.436171 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32df4f6f-dbe4-4868-9c02-7cb4526ed3ee None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:43.436544 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32df4f6f-dbe4-4868-9c02-7cb4526ed3ee None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:43.438009 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32df4f6f-dbe4-4868-9c02-7cb4526ed3ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:15:43.439014 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32df4f6f-dbe4-4868-9c02-7cb4526ed3ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:43.440639 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32df4f6f-dbe4-4868-9c02-7cb4526ed3ee None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:43.463755 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 276/532] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Sep 13 15:15:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:15:43.463755 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32df4f6f-dbe4-4868-9c02-7cb4526ed3ee None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:43.499527 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06630869-ea7e-4daa-a9fc-b15118bafce2 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:43.546059 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d345ea2b-26a1-4d0d-b49a-62e8d9face85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:43.546934 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d345ea2b-26a1-4d0d-b49a-62e8d9face85 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:43.547821 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d345ea2b-26a1-4d0d-b49a-62e8d9face85 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:43.548248 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d345ea2b-26a1-4d0d-b49a-62e8d9face85 None admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:43.549471 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d345ea2b-26a1-4d0d-b49a-62e8d9face85 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:15:43.550243 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d345ea2b-26a1-4d0d-b49a-62e8d9face85 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:43.552049 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d345ea2b-26a1-4d0d-b49a-62e8d9face85 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:43.570941 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 257/533] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Sep 13 15:15:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:15:43.572358 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d345ea2b-26a1-4d0d-b49a-62e8d9face85 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:43.577748 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32df4f6f-dbe4-4868-9c02-7cb4526ed3ee None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:43.615107 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa30fc7-8177-4c28-ba9d-4e73e741909e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:43.615640 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa30fc7-8177-4c28-ba9d-4e73e741909e None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:43.616505 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa30fc7-8177-4c28-ba9d-4e73e741909e None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:43.616908 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa30fc7-8177-4c28-ba9d-4e73e741909e None admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:43.617991 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa30fc7-8177-4c28-ba9d-4e73e741909e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:15:43.618299 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa30fc7-8177-4c28-ba9d-4e73e741909e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:43.619738 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa30fc7-8177-4c28-ba9d-4e73e741909e None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:43.644404 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 277/534] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Sep 13 15:15:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:15:43.644404 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa30fc7-8177-4c28-ba9d-4e73e741909e None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:43.649910 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:43.706234 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:43.724856 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d345ea2b-26a1-4d0d-b49a-62e8d9face85 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:43.764825 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa30fc7-8177-4c28-ba9d-4e73e741909e None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:43.769411 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0674c70-e7cc-4447-ae8f-0b4450b9af22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:43.770195 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0674c70-e7cc-4447-ae8f-0b4450b9af22 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:43.770542 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0674c70-e7cc-4447-ae8f-0b4450b9af22 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:43.770888 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0674c70-e7cc-4447-ae8f-0b4450b9af22 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:43.782060 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0674c70-e7cc-4447-ae8f-0b4450b9af22 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:43.784109 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0674c70-e7cc-4447-ae8f-0b4450b9af22 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:43.800197 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-c0674c70-e7cc-4447-ae8f-0b4450b9af22 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 15:15:43.800197 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:15:43.800197 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:15:43.800197 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:15:43.800197 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:15:43.800197 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:15:43.800197 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:15:43.800197 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:15:43.800197 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:15:43.800197 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:15:43.800197 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:15:43.800197 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:15:43.800197 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 15:15:43.800197 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 15:15:43.800197 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 15:15:43.801067 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 15:15:43.801067 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:15:43.801067 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:15:43.801067 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:15:43.801067 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:15:43.801067 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:15:43.801067 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:15:43.801067 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:15:43.801067 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Sep 13 15:15:43.801067 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:15:43.801067 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:15:43.801067 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:15:43.801067 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:15:43.801067 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:15:43.801067 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:15:43.801067 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:15:43.801067 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:15:43.801945 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 15:15:43.801945 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 15:15:43.801945 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 15:15:43.801945 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 15:15:43.801945 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 15:15:43.801945 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 15:15:43.801945 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 15:15:43.801945 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Sep 13 15:15:43.805783 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 258/535] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Sep 13 15:15:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:15:43.806816 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0674c70-e7cc-4447-ae8f-0b4450b9af22 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:43.809628 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a575ad-b0e9-40ec-97cb-9f776790018c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:43.810528 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a575ad-b0e9-40ec-97cb-9f776790018c None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:43.811006 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a575ad-b0e9-40ec-97cb-9f776790018c None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:43.811496 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a575ad-b0e9-40ec-97cb-9f776790018c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:43.818585 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a575ad-b0e9-40ec-97cb-9f776790018c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:43.820594 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a575ad-b0e9-40ec-97cb-9f776790018c None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:43.832865 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-e9a575ad-b0e9-40ec-97cb-9f776790018c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 15:15:43.832865 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:15:43.832865 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:15:43.832865 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:15:43.832865 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:15:43.832865 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:15:43.832865 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:15:43.832865 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:15:43.832865 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:15:43.832865 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:15:43.832865 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:15:43.832865 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:15:43.832865 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 15:15:43.832865 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 15:15:43.832865 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 15:15:43.833804 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 15:15:43.833804 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:15:43.833804 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:15:43.833804 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:15:43.833804 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:15:43.833804 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:15:43.833804 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:15:43.833804 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:15:43.833804 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Sep 13 15:15:43.833804 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:15:43.833804 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:15:43.833804 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:15:43.833804 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:15:43.833804 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:15:43.833804 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:15:43.833804 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:15:43.833804 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:15:43.835373 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 15:15:43.835373 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 15:15:43.835373 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 15:15:43.835373 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 15:15:43.835373 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 15:15:43.835373 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 15:15:43.835373 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 15:15:43.835373 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Sep 13 15:15:43.841829 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 278/536] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Sep 13 15:15:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:15:43.842833 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a575ad-b0e9-40ec-97cb-9f776790018c None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:43.909439 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:43.935346 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0674c70-e7cc-4447-ae8f-0b4450b9af22 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:43.947308 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a575ad-b0e9-40ec-97cb-9f776790018c None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:43.986615 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5451cf37-dced-41e9-875d-4047d82bad53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:43.987421 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5451cf37-dced-41e9-875d-4047d82bad53 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:43.987862 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5451cf37-dced-41e9-875d-4047d82bad53 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:43.988212 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5451cf37-dced-41e9-875d-4047d82bad53 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:43.989108 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5451cf37-dced-41e9-875d-4047d82bad53 None admin] RBAC: Adding query filter params (role.id=470736c596a14fa5ac78200239aa1104, scope.project.id=3d6e00339cfa47d2a6fa8724c587035f, user.id=8ef26a5203094c83b52f10b930dfc453) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:15:43.989488 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5451cf37-dced-41e9-875d-4047d82bad53 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:43.989723 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebd40e7-1476-4652-807f-f2a888a0635d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:43.990521 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebd40e7-1476-4652-807f-f2a888a0635d None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:43.991103 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebd40e7-1476-4652-807f-f2a888a0635d None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:43.991273 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5451cf37-dced-41e9-875d-4047d82bad53 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:43.991718 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebd40e7-1476-4652-807f-f2a888a0635d None admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:43.992582 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebd40e7-1476-4652-807f-f2a888a0635d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:15:43.993069 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebd40e7-1476-4652-807f-f2a888a0635d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:43.994741 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebd40e7-1476-4652-807f-f2a888a0635d None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:43.998118 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 259/537] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Sep 13 15:15:43 2022] GET /identity/v3/role_assignments?user.id=8ef26a5203094c83b52f10b930dfc453&scope.project.id=3d6e00339cfa47d2a6fa8724c587035f&role.id=470736c596a14fa5ac78200239aa1104 => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:15:43.999046 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5451cf37-dced-41e9-875d-4047d82bad53 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:44.009368 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 279/538] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Sep 13 15:15:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:15:44.026045 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:44.027377 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebd40e7-1476-4652-807f-f2a888a0635d None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:44.131440 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5451cf37-dced-41e9-875d-4047d82bad53 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:44.172859 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ce7d27-054f-4dfc-848b-6059f91810c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:44.173436 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ce7d27-054f-4dfc-848b-6059f91810c7 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:44.173741 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ce7d27-054f-4dfc-848b-6059f91810c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:44.174022 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ce7d27-054f-4dfc-848b-6059f91810c7 None admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:44.174725 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ce7d27-054f-4dfc-848b-6059f91810c7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:15:44.175030 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ce7d27-054f-4dfc-848b-6059f91810c7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:44.176543 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ce7d27-054f-4dfc-848b-6059f91810c7 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:44.192516 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 260/539] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Sep 13 15:15:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:15:44.201138 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ce7d27-054f-4dfc-848b-6059f91810c7 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:44.298066 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:44.304870 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebd40e7-1476-4652-807f-f2a888a0635d None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:44.326771 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ce7d27-054f-4dfc-848b-6059f91810c7 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:44.366071 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf762475-0f7f-409b-a57b-773c07ef471a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:44.366827 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf762475-0f7f-409b-a57b-773c07ef471a None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:44.367076 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf762475-0f7f-409b-a57b-773c07ef471a None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:44.367265 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf762475-0f7f-409b-a57b-773c07ef471a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:44.367996 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf762475-0f7f-409b-a57b-773c07ef471a None admin] RBAC: Adding query filter params (role.id=470736c596a14fa5ac78200239aa1104, scope.project.id=3d6e00339cfa47d2a6fa8724c587035f, user.id=97acd23097d54bf7805c3cef60626ce7) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:15:44.368305 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf762475-0f7f-409b-a57b-773c07ef471a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:44.369745 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf762475-0f7f-409b-a57b-773c07ef471a None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:44.376628 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 261/540] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Sep 13 15:15:44 2022] GET /identity/v3/role_assignments?user.id=97acd23097d54bf7805c3cef60626ce7&scope.project.id=3d6e00339cfa47d2a6fa8724c587035f&role.id=470736c596a14fa5ac78200239aa1104 => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:15:44.392455 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:44.419618 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24df4c9-681a-418e-a153-0189f963c9f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:44.420492 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24df4c9-681a-418e-a153-0189f963c9f6 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:44.420920 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24df4c9-681a-418e-a153-0189f963c9f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:44.421368 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24df4c9-681a-418e-a153-0189f963c9f6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:44.422347 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24df4c9-681a-418e-a153-0189f963c9f6 None admin] RBAC: Adding query filter params (role.id=470736c596a14fa5ac78200239aa1104, scope.project.id=3d6e00339cfa47d2a6fa8724c587035f, user.id=41675154bbba47388040966f75d84c3c) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:15:44.422803 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24df4c9-681a-418e-a153-0189f963c9f6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:44.424434 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24df4c9-681a-418e-a153-0189f963c9f6 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:44.434673 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 280/541] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Sep 13 15:15:44 2022] GET /identity/v3/role_assignments?user.id=41675154bbba47388040966f75d84c3c&scope.project.id=3d6e00339cfa47d2a6fa8724c587035f&role.id=470736c596a14fa5ac78200239aa1104 => generated 259 bytes in 408 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:15:44.697653 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17b3b5a-31ca-4759-b9f4-11730cc868ab None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:44.697985 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17b3b5a-31ca-4759-b9f4-11730cc868ab None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:44.698165 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17b3b5a-31ca-4759-b9f4-11730cc868ab None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:44.699758 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 262/542] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:15:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:15:44.705464 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6523e6-6ca2-46a3-9f44-9e552dc034a5 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:44.705944 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6523e6-6ca2-46a3-9f44-9e552dc034a5 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:44.706125 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6523e6-6ca2-46a3-9f44-9e552dc034a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:44.731324 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-2f6523e6-6ca2-46a3-9f44-9e552dc034a5 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:15:44.732552 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-2f6523e6-6ca2-46a3-9f44-9e552dc034a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:15:44.809616 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 281/543] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:15:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 15:15:45.122113 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17b3b5a-31ca-4759-b9f4-11730cc868ab None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:45.197472 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bff3a1b-2bac-4d58-8cfc-90bbf5a03d16 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:45.197816 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bff3a1b-2bac-4d58-8cfc-90bbf5a03d16 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:45.198053 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bff3a1b-2bac-4d58-8cfc-90bbf5a03d16 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:45.199652 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 282/544] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:15:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:15:45.204589 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be87ddf-a7d4-43f8-b291-12748850d247 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:45.204873 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be87ddf-a7d4-43f8-b291-12748850d247 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:45.205147 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be87ddf-a7d4-43f8-b291-12748850d247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:45.240475 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17b3b5a-31ca-4759-b9f4-11730cc868ab None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:45.242686 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-6be87ddf-a7d4-43f8-b291-12748850d247 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:15:45.243878 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-6be87ddf-a7d4-43f8-b291-12748850d247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:15:45.279808 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb78c883-f2a4-45dd-a349-5df703ee9fad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:45.280615 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb78c883-f2a4-45dd-a349-5df703ee9fad None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:45.280891 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb78c883-f2a4-45dd-a349-5df703ee9fad None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:45.281171 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb78c883-f2a4-45dd-a349-5df703ee9fad None admin] PATH_INFO: `/v3/roles/service` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:45.288769 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:45.295398 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb78c883-f2a4-45dd-a349-5df703ee9fad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 15:15:45.300788 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-fb78c883-f2a4-45dd-a349-5df703ee9fad None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 15:15:45.300788 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:15:45.300788 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:15:45.300788 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:15:45.300788 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:15:45.300788 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:15:45.300788 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:15:45.300788 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:15:45.300788 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:15:45.300788 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:15:45.300788 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:15:45.300788 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:15:45.300788 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 15:15:45.300788 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 15:15:45.300788 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 15:15:45.300788 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 15:15:45.301671 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 15:15:45.301671 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 15:15:45.301671 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 15:15:45.301671 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 15:15:45.301671 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:15:45.301671 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:15:45.301671 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:15:45.301671 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:15:45.301671 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:15:45.301671 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:15:45.301671 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:15:45.301671 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Sep 13 15:15:45.301671 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:15:45.301671 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:15:45.301671 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:15:45.301671 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:15:45.302484 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:15:45.302484 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:15:45.302484 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:15:45.302484 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:15:45.302484 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 15:15:45.302484 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 15:15:45.302484 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 15:15:45.302484 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 15:15:45.302484 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 15:15:45.302484 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 15:15:45.302484 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 15:15:45.302484 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Sep 13 15:15:45.302484 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 263/545] 10.222.0.27 () {56 vars in 1102 bytes} [Tue Sep 13 15:15:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:15:45.308391 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb78c883-f2a4-45dd-a349-5df703ee9fad None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:45.422295 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb78c883-f2a4-45dd-a349-5df703ee9fad None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:45.459323 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 283/546] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:15:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 15:15:45.462036 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189e3578-6571-48a7-9011-85b59be4b660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:45.462744 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189e3578-6571-48a7-9011-85b59be4b660 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:45.463103 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189e3578-6571-48a7-9011-85b59be4b660 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:45.463448 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189e3578-6571-48a7-9011-85b59be4b660 None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:45.464346 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189e3578-6571-48a7-9011-85b59be4b660 None admin] RBAC: Adding query filter params (name=service) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:15:45.464724 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189e3578-6571-48a7-9011-85b59be4b660 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:45.466508 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189e3578-6571-48a7-9011-85b59be4b660 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:45.475777 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 264/547] 10.222.0.27 () {56 vars in 1103 bytes} [Tue Sep 13 15:15:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:15:45.481000 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be87ddf-a7d4-43f8-b291-12748850d247 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:45.564256 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:45.638204 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be87ddf-a7d4-43f8-b291-12748850d247 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:45.691627 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c317ebdf-454e-4035-b473-ae07dc8d64c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:45.692175 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c317ebdf-454e-4035-b473-ae07dc8d64c5 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:45.692456 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c317ebdf-454e-4035-b473-ae07dc8d64c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:45.692731 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c317ebdf-454e-4035-b473-ae07dc8d64c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:45.712193 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c317ebdf-454e-4035-b473-ae07dc8d64c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:45.713691 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c317ebdf-454e-4035-b473-ae07dc8d64c5 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:45.734272 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-c317ebdf-454e-4035-b473-ae07dc8d64c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 15:15:45.734272 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:15:45.734272 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:15:45.734272 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:15:45.734272 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:15:45.734272 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:15:45.734272 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:15:45.734272 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:15:45.734272 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:15:45.734272 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:15:45.734272 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:15:45.734272 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:15:45.734272 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 15:15:45.734272 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 15:15:45.734272 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 15:15:45.734272 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 15:15:45.735153 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:15:45.735153 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:15:45.735153 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:15:45.735153 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:15:45.735153 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:15:45.735153 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:15:45.735153 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:15:45.735153 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Sep 13 15:15:45.735153 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:15:45.735153 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:15:45.735153 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:15:45.735153 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:15:45.735153 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:15:45.735153 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:15:45.735153 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:15:45.735153 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:15:45.735153 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 15:15:45.735974 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 15:15:45.735974 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 15:15:45.735974 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Sep 13 15:15:45.735974 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 284/548] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 13 15:15:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:15:45.741250 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189e3578-6571-48a7-9011-85b59be4b660 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:45.820895 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:45.825920 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c317ebdf-454e-4035-b473-ae07dc8d64c5 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:45.901598 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189e3578-6571-48a7-9011-85b59be4b660 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:45.947129 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c001c78-0456-4867-bbd9-05c551741d4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:45.947665 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c001c78-0456-4867-bbd9-05c551741d4f None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:45.947950 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c001c78-0456-4867-bbd9-05c551741d4f None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:45.948227 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c001c78-0456-4867-bbd9-05c551741d4f None admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:45.948877 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c001c78-0456-4867-bbd9-05c551741d4f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:15:45.949185 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c001c78-0456-4867-bbd9-05c551741d4f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:45.950580 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c001c78-0456-4867-bbd9-05c551741d4f None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:45.965277 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c317ebdf-454e-4035-b473-ae07dc8d64c5 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:45.967067 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:45.979955 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 265/549] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Sep 13 15:15:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:15:45.986953 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c001c78-0456-4867-bbd9-05c551741d4f None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:46.036456 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17f6525-0615-400c-b9ec-3c3641b3c4cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:46.037090 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17f6525-0615-400c-b9ec-3c3641b3c4cb None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:46.037375 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17f6525-0615-400c-b9ec-3c3641b3c4cb None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:46.037778 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17f6525-0615-400c-b9ec-3c3641b3c4cb None admin] PATH_INFO: `/v3/roles/service` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:46.061094 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17f6525-0615-400c-b9ec-3c3641b3c4cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 15:15:46.066545 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-d17f6525-0615-400c-b9ec-3c3641b3c4cb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 15:15:46.066545 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:15:46.066545 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:15:46.066545 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:15:46.066545 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:15:46.066545 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:15:46.066545 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:15:46.066545 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:15:46.066545 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:15:46.066545 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:15:46.066545 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:15:46.066545 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:15:46.066545 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 15:15:46.066545 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 15:15:46.066545 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 15:15:46.066545 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 15:15:46.068025 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 15:15:46.068025 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 15:15:46.068025 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 15:15:46.068025 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 15:15:46.068025 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:15:46.068025 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:15:46.068025 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:15:46.068025 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:15:46.068025 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:15:46.068025 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:15:46.068025 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:15:46.068025 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Sep 13 15:15:46.068025 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:15:46.068025 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:15:46.068025 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:15:46.068025 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:15:46.069169 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:15:46.069169 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:15:46.069169 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:15:46.069169 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:15:46.069169 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 15:15:46.069169 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 15:15:46.069169 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 15:15:46.069169 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 15:15:46.069169 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 15:15:46.069169 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 15:15:46.069169 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 15:15:46.069169 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Sep 13 15:15:46.069169 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 285/550] 10.222.0.27 () {56 vars in 1102 bytes} [Tue Sep 13 15:15:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 15:15:46.074407 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17f6525-0615-400c-b9ec-3c3641b3c4cb None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:46.152361 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c001c78-0456-4867-bbd9-05c551741d4f None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:46.178117 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:46.187920 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b7d397-59ca-4556-a550-b2858ed29589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:46.188560 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b7d397-59ca-4556-a550-b2858ed29589 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:46.188846 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b7d397-59ca-4556-a550-b2858ed29589 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:46.189125 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b7d397-59ca-4556-a550-b2858ed29589 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:46.196792 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b7d397-59ca-4556-a550-b2858ed29589 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:46.198438 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b7d397-59ca-4556-a550-b2858ed29589 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:46.210952 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-60b7d397-59ca-4556-a550-b2858ed29589 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 13 15:15:46.210952 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:15:46.210952 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:15:46.210952 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:15:46.210952 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:15:46.210952 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:15:46.210952 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:15:46.210952 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:15:46.210952 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:15:46.210952 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:15:46.210952 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:15:46.210952 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:15:46.210952 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 15:15:46.210952 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 15:15:46.210952 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 15:15:46.210952 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 15:15:46.211867 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:15:46.211867 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:15:46.211867 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 15:15:46.211867 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 15:15:46.211867 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 15:15:46.211867 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 15:15:46.211867 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:15:46.211867 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:15:46.211867 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:15:46.211867 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:15:46.211867 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:15:46.211867 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Sep 13 15:15:46.211867 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:15:46.211867 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:15:46.211867 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:15:46.211867 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:15:46.211867 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:15:46.211867 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:15:46.212948 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:15:46.212948 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:15:46.212948 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 15:15:46.212948 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 15:15:46.212948 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 15:15:46.212948 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 15:15:46.212948 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 15:15:46.212948 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 15:15:46.212948 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 13 15:15:46.212948 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Sep 13 15:15:46.221754 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 266/551] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Sep 13 15:15:45 2022] GET /identity/v3/users/swift => generated 83 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:15:46.221754 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b7d397-59ca-4556-a550-b2858ed29589 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:46.277085 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17f6525-0615-400c-b9ec-3c3641b3c4cb None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:46.320730 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b7d397-59ca-4556-a550-b2858ed29589 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:46.355257 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c550549c-34b4-48ca-9cf2-2fe65767bb77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:46.355893 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c550549c-34b4-48ca-9cf2-2fe65767bb77 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:46.356244 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c550549c-34b4-48ca-9cf2-2fe65767bb77 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:46.356522 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c550549c-34b4-48ca-9cf2-2fe65767bb77 None admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:46.357345 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c550549c-34b4-48ca-9cf2-2fe65767bb77 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:15:46.357657 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c550549c-34b4-48ca-9cf2-2fe65767bb77 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:46.358430 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6a7388-a0ba-4941-ad37-3dfdb9bdcf55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:46.359116 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c550549c-34b4-48ca-9cf2-2fe65767bb77 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:46.359486 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6a7388-a0ba-4941-ad37-3dfdb9bdcf55 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:46.359962 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6a7388-a0ba-4941-ad37-3dfdb9bdcf55 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:46.360429 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6a7388-a0ba-4941-ad37-3dfdb9bdcf55 None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:46.361305 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6a7388-a0ba-4941-ad37-3dfdb9bdcf55 None admin] RBAC: Adding query filter params (name=service) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:15:46.361866 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6a7388-a0ba-4941-ad37-3dfdb9bdcf55 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:46.363413 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6a7388-a0ba-4941-ad37-3dfdb9bdcf55 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:46.381967 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 267/552] 10.222.0.27 () {56 vars in 1135 bytes} [Tue Sep 13 15:15:46 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:15:46.383200 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c550549c-34b4-48ca-9cf2-2fe65767bb77 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:46.385447 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 286/553] 10.222.0.27 () {56 vars in 1103 bytes} [Tue Sep 13 15:15:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 15:15:46.390794 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6a7388-a0ba-4941-ad37-3dfdb9bdcf55 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:46.427567 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:46.446709 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:46.497812 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c550549c-34b4-48ca-9cf2-2fe65767bb77 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:46.569681 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6a7388-a0ba-4941-ad37-3dfdb9bdcf55 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:46.586986 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc74d033-f874-4800-bbd3-6c714c8202a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:46.587617 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc74d033-f874-4800-bbd3-6c714c8202a2 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:46.587901 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc74d033-f874-4800-bbd3-6c714c8202a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:46.588172 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc74d033-f874-4800-bbd3-6c714c8202a2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:46.622548 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c8a0cb-a6bd-495e-b93e-73d149707f79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:46.624738 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c8a0cb-a6bd-495e-b93e-73d149707f79 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:46.625195 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c8a0cb-a6bd-495e-b93e-73d149707f79 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:46.626611 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c8a0cb-a6bd-495e-b93e-73d149707f79 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:46.645191 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c8a0cb-a6bd-495e-b93e-73d149707f79 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:46.655047 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c8a0cb-a6bd-495e-b93e-73d149707f79 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:46.679035 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-06c8a0cb-a6bd-495e-b93e-73d149707f79 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 15:15:46.679035 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:15:46.679035 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:15:46.679035 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:15:46.679035 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:15:46.679035 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:15:46.679035 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:15:46.679035 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:15:46.679035 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:15:46.679035 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:15:46.679035 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:15:46.679035 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:15:46.679035 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 15:15:46.679035 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 15:15:46.679035 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 15:15:46.679035 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 15:15:46.680277 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:15:46.680277 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:15:46.680277 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:15:46.680277 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:15:46.680277 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:15:46.680277 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:15:46.680277 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:15:46.680277 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Sep 13 15:15:46.680277 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:15:46.680277 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:15:46.680277 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:15:46.680277 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:15:46.680277 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:15:46.680277 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:15:46.680277 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:15:46.680277 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:15:46.680277 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 15:15:46.681545 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 15:15:46.681545 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 15:15:46.681545 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Sep 13 15:15:46.681545 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 287/554] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 13 15:15:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 15:15:46.685689 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c8a0cb-a6bd-495e-b93e-73d149707f79 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:46.699017 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc74d033-f874-4800-bbd3-6c714c8202a2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:46.700953 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc74d033-f874-4800-bbd3-6c714c8202a2 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:46.746611 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:46.815966 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:46.822501 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 268/555] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Sep 13 15:15:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 15:15:46.824102 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6985a56f-f971-4acd-b996-741ad3014ff1 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:46.824558 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6985a56f-f971-4acd-b996-741ad3014ff1 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:46.824982 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6985a56f-f971-4acd-b996-741ad3014ff1 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:46.829637 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 269/556] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:15:46 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:15:46.830729 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6985a56f-f971-4acd-b996-741ad3014ff1 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:46.845669 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c8a0cb-a6bd-495e-b93e-73d149707f79 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:46.881128 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb36b0f3-3882-459c-b44e-1c6a5f9fda93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:46.882137 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb36b0f3-3882-459c-b44e-1c6a5f9fda93 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:46.882250 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb36b0f3-3882-459c-b44e-1c6a5f9fda93 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:46.882501 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb36b0f3-3882-459c-b44e-1c6a5f9fda93 None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:46.883147 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb36b0f3-3882-459c-b44e-1c6a5f9fda93 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:15:46.883453 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb36b0f3-3882-459c-b44e-1c6a5f9fda93 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:46.884893 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb36b0f3-3882-459c-b44e-1c6a5f9fda93 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:46.898744 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 288/557] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Sep 13 15:15:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:15:46.899977 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929b8572-7361-42d4-86a7-4f99e90f83da None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:46.900262 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929b8572-7361-42d4-86a7-4f99e90f83da None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:46.900536 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929b8572-7361-42d4-86a7-4f99e90f83da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:46.918934 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-929b8572-7361-42d4-86a7-4f99e90f83da None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:15:46.920174 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-929b8572-7361-42d4-86a7-4f99e90f83da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:15:46.953779 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6985a56f-f971-4acd-b996-741ad3014ff1 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:46.995873 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c77893-6623-4ef8-a7e6-97c4049b5355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:46.996502 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c77893-6623-4ef8-a7e6-97c4049b5355 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:46.996985 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c77893-6623-4ef8-a7e6-97c4049b5355 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:46.997137 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c77893-6623-4ef8-a7e6-97c4049b5355 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:47.005868 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:47.017730 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 289/558] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:15:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 15:15:47.017730 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929b8572-7361-42d4-86a7-4f99e90f83da None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:47.018879 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c77893-6623-4ef8-a7e6-97c4049b5355 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:47.020400 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c77893-6623-4ef8-a7e6-97c4049b5355 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:47.048909 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-38c77893-6623-4ef8-a7e6-97c4049b5355 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 15:15:47.048909 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:15:47.048909 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:15:47.048909 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:15:47.048909 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:15:47.048909 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:15:47.048909 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:15:47.048909 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:15:47.048909 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:15:47.048909 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:15:47.048909 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:15:47.048909 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:15:47.048909 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 15:15:47.048909 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 15:15:47.048909 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 15:15:47.048909 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 15:15:47.049951 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:15:47.049951 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:15:47.049951 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:15:47.049951 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:15:47.049951 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:15:47.049951 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:15:47.049951 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:15:47.049951 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Sep 13 15:15:47.049951 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:15:47.049951 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:15:47.049951 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:15:47.049951 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:15:47.049951 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:15:47.049951 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:15:47.049951 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:15:47.049951 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:15:47.049951 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 15:15:47.051221 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 15:15:47.051221 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 15:15:47.051221 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Sep 13 15:15:47.051221 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 270/559] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 13 15:15:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:15:47.051996 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9161bf7-deaf-4593-b6b4-1bc742d62638 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:47.052282 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9161bf7-deaf-4593-b6b4-1bc742d62638 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:47.052558 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9161bf7-deaf-4593-b6b4-1bc742d62638 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:47.054262 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 271/560] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:15:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:15:47.059050 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9161bf7-deaf-4593-b6b4-1bc742d62638 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:47.106819 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:47.150121 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929b8572-7361-42d4-86a7-4f99e90f83da None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:47.193557 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506dbabf-78b5-49b9-a940-65695500b738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:47.194407 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506dbabf-78b5-49b9-a940-65695500b738 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:47.194690 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506dbabf-78b5-49b9-a940-65695500b738 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:47.195230 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506dbabf-78b5-49b9-a940-65695500b738 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:47.196030 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9161bf7-deaf-4593-b6b4-1bc742d62638 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:47.202919 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506dbabf-78b5-49b9-a940-65695500b738 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:47.204623 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506dbabf-78b5-49b9-a940-65695500b738 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:47.217434 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-506dbabf-78b5-49b9-a940-65695500b738 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 13 15:15:47.217434 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:15:47.217434 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:15:47.217434 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:15:47.217434 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:15:47.217434 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:15:47.217434 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:15:47.217434 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:15:47.217434 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:15:47.217434 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:15:47.217434 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:15:47.217434 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:15:47.217434 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 15:15:47.217434 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 15:15:47.217434 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 15:15:47.217434 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 15:15:47.218443 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:15:47.218443 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:15:47.218443 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 15:15:47.218443 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 15:15:47.218443 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 15:15:47.218443 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 15:15:47.218443 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:15:47.218443 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:15:47.218443 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:15:47.218443 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:15:47.218443 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:15:47.218443 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Sep 13 15:15:47.218443 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:15:47.218443 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:15:47.218443 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:15:47.218443 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:15:47.218443 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:15:47.218443 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:15:47.219410 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:15:47.219410 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:15:47.219410 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 15:15:47.219410 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 15:15:47.219410 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 15:15:47.219410 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 15:15:47.219410 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 15:15:47.219410 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 15:15:47.219410 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 13 15:15:47.219410 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Sep 13 15:15:47.222221 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 290/561] 10.222.0.27 () {56 vars in 1093 bytes} [Tue Sep 13 15:15:47 2022] GET /identity/v3/users/nova => generated 82 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:15:47.223166 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6187e212-396d-4442-8cd9-4fe8903085cf None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:47.223460 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6187e212-396d-4442-8cd9-4fe8903085cf None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:47.223742 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6187e212-396d-4442-8cd9-4fe8903085cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:47.238612 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b7dd67-620b-4986-8514-87b51a5e8e12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:47.239225 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b7dd67-620b-4986-8514-87b51a5e8e12 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:47.239507 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b7dd67-620b-4986-8514-87b51a5e8e12 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:47.239784 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b7dd67-620b-4986-8514-87b51a5e8e12 None admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:47.240427 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b7dd67-620b-4986-8514-87b51a5e8e12 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:15:47.241510 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b7dd67-620b-4986-8514-87b51a5e8e12 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:47.242723 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-6187e212-396d-4442-8cd9-4fe8903085cf None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:15:47.242926 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b7dd67-620b-4986-8514-87b51a5e8e12 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:47.243907 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-6187e212-396d-4442-8cd9-4fe8903085cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:15:47.255066 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 272/562] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Sep 13 15:15:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:15:47.256076 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a0de4b-c86c-4ab6-8f81-a24529b6b176 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:47.256393 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a0de4b-c86c-4ab6-8f81-a24529b6b176 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:47.256668 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a0de4b-c86c-4ab6-8f81-a24529b6b176 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:47.262135 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 273/563] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:15:47 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:15:47.262135 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a0de4b-c86c-4ab6-8f81-a24529b6b176 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:47.314840 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:47.321748 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 291/564] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:15:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 15:15:47.321748 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6187e212-396d-4442-8cd9-4fe8903085cf None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:47.378479 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a0de4b-c86c-4ab6-8f81-a24529b6b176 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:47.382306 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:47.417496 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126727f9-b842-4735-bd6b-0158b1dca9f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:47.418359 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126727f9-b842-4735-bd6b-0158b1dca9f4 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:47.418805 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126727f9-b842-4735-bd6b-0158b1dca9f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:47.419077 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126727f9-b842-4735-bd6b-0158b1dca9f4 None admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:47.419807 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126727f9-b842-4735-bd6b-0158b1dca9f4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:15:47.420114 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126727f9-b842-4735-bd6b-0158b1dca9f4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:47.421541 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126727f9-b842-4735-bd6b-0158b1dca9f4 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:47.428837 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6187e212-396d-4442-8cd9-4fe8903085cf None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:47.444254 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 274/565] 10.222.0.27 () {56 vars in 1133 bytes} [Tue Sep 13 15:15:47 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:15:47.445823 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff41cc9-7c7a-45d4-ba9f-53c073154ac5 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:47.446117 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff41cc9-7c7a-45d4-ba9f-53c073154ac5 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:47.446417 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff41cc9-7c7a-45d4-ba9f-53c073154ac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:47.464325 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd431b7c-f182-4eb0-a8dd-ce7d0c38af09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:47.464961 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd431b7c-f182-4eb0-a8dd-ce7d0c38af09 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:47.465224 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-aff41cc9-7c7a-45d4-ba9f-53c073154ac5 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:15:47.465330 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd431b7c-f182-4eb0-a8dd-ce7d0c38af09 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:47.465578 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd431b7c-f182-4eb0-a8dd-ce7d0c38af09 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:47.466686 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-aff41cc9-7c7a-45d4-ba9f-53c073154ac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:15:47.472181 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd431b7c-f182-4eb0-a8dd-ce7d0c38af09 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:47.473633 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd431b7c-f182-4eb0-a8dd-ce7d0c38af09 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:47.485262 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-cd431b7c-f182-4eb0-a8dd-ce7d0c38af09 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 15:15:47.485262 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:15:47.485262 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:15:47.485262 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:15:47.485262 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:15:47.485262 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:15:47.485262 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:15:47.485262 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:15:47.485262 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:15:47.485262 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:15:47.485262 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:15:47.485262 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:15:47.485262 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 15:15:47.485262 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 15:15:47.485262 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 15:15:47.486167 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 15:15:47.486167 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:15:47.486167 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:15:47.486167 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:15:47.486167 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:15:47.486167 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:15:47.486167 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:15:47.486167 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:15:47.486167 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Sep 13 15:15:47.486167 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:15:47.486167 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:15:47.486167 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:15:47.486167 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:15:47.486167 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:15:47.486167 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:15:47.486167 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:15:47.486167 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:15:47.487084 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 15:15:47.487084 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 15:15:47.487084 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 15:15:47.487084 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 15:15:47.487084 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 15:15:47.487084 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 15:15:47.487084 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 15:15:47.487084 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Sep 13 15:15:47.487084 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 292/566] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Sep 13 15:15:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:15:47.487565 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd431b7c-f182-4eb0-a8dd-ce7d0c38af09 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:47.541023 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 275/567] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:15:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 15:15:47.542149 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff41cc9-7c7a-45d4-ba9f-53c073154ac5 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:47.593063 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:47.616122 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd431b7c-f182-4eb0-a8dd-ce7d0c38af09 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:47.633800 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:47.653645 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8b84d8-ff69-4626-a1cb-850466e1e5af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:47.654414 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8b84d8-ff69-4626-a1cb-850466e1e5af None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:47.654702 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8b84d8-ff69-4626-a1cb-850466e1e5af None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:47.654982 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8b84d8-ff69-4626-a1cb-850466e1e5af None admin] PATH_INFO: `/v3/roles/service` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:47.660899 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff41cc9-7c7a-45d4-ba9f-53c073154ac5 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:47.667700 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8b84d8-ff69-4626-a1cb-850466e1e5af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 15:15:47.675077 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-5a8b84d8-ff69-4626-a1cb-850466e1e5af None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 15:15:47.675077 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:15:47.675077 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:15:47.675077 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:15:47.675077 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:15:47.675077 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:15:47.675077 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:15:47.675077 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:15:47.675077 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:15:47.675077 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:15:47.675077 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:15:47.675077 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:15:47.675077 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 15:15:47.675077 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 15:15:47.675077 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 15:15:47.675077 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 15:15:47.675990 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 15:15:47.675990 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 15:15:47.675990 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 15:15:47.675990 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 15:15:47.675990 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:15:47.675990 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:15:47.675990 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:15:47.675990 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:15:47.675990 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:15:47.675990 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:15:47.675990 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:15:47.675990 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Sep 13 15:15:47.675990 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:15:47.675990 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:15:47.675990 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:15:47.675990 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:15:47.676813 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:15:47.676813 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:15:47.676813 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:15:47.676813 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:15:47.676813 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 15:15:47.676813 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 15:15:47.676813 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 15:15:47.676813 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 15:15:47.676813 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 15:15:47.676813 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 15:15:47.676813 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 15:15:47.676813 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Sep 13 15:15:47.677466 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 293/568] 10.222.0.27 () {56 vars in 1102 bytes} [Tue Sep 13 15:15:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:15:47.681814 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8b84d8-ff69-4626-a1cb-850466e1e5af None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:47.697372 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e26345-6ddf-4eff-aa00-59acf95cffc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:47.698031 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e26345-6ddf-4eff-aa00-59acf95cffc8 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:47.698312 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e26345-6ddf-4eff-aa00-59acf95cffc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:47.698588 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e26345-6ddf-4eff-aa00-59acf95cffc8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:47.709314 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e26345-6ddf-4eff-aa00-59acf95cffc8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:47.710896 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e26345-6ddf-4eff-aa00-59acf95cffc8 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:47.731515 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-e1e26345-6ddf-4eff-aa00-59acf95cffc8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 15:15:47.731515 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:15:47.731515 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:15:47.731515 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:15:47.731515 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:15:47.731515 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:15:47.731515 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:15:47.731515 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:15:47.731515 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:15:47.731515 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:15:47.731515 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:15:47.731515 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:15:47.731515 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 15:15:47.731515 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 15:15:47.731515 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 15:15:47.731515 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 15:15:47.732473 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:15:47.732473 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:15:47.732473 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:15:47.732473 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:15:47.732473 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:15:47.732473 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:15:47.732473 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:15:47.732473 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Sep 13 15:15:47.732473 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:15:47.732473 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:15:47.732473 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:15:47.732473 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:15:47.732473 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:15:47.732473 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:15:47.732473 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:15:47.732473 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:15:47.732473 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 15:15:47.738241 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 15:15:47.738241 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 15:15:47.738241 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Sep 13 15:15:47.738241 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 276/569] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 13 15:15:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:15:47.738241 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e26345-6ddf-4eff-aa00-59acf95cffc8 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:47.789367 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8b84d8-ff69-4626-a1cb-850466e1e5af None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:47.822529 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2ac318-e9d1-46f1-8c70-430a29225686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:47.823209 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2ac318-e9d1-46f1-8c70-430a29225686 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:47.823413 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2ac318-e9d1-46f1-8c70-430a29225686 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:47.823692 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2ac318-e9d1-46f1-8c70-430a29225686 None admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:47.824394 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2ac318-e9d1-46f1-8c70-430a29225686 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:15:47.824710 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2ac318-e9d1-46f1-8c70-430a29225686 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:47.826451 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2ac318-e9d1-46f1-8c70-430a29225686 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:47.839019 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 294/570] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Sep 13 15:15:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:15:47.839187 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:47.839647 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2ac318-e9d1-46f1-8c70-430a29225686 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:47.849644 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e26345-6ddf-4eff-aa00-59acf95cffc8 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:47.873229 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:47.884116 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebf02e4-47ef-4381-b939-212302d5af9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:47.884679 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebf02e4-47ef-4381-b939-212302d5af9e None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:47.884963 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebf02e4-47ef-4381-b939-212302d5af9e None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:47.885242 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebf02e4-47ef-4381-b939-212302d5af9e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:47.895598 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebf02e4-47ef-4381-b939-212302d5af9e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 15:15:47.901644 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-cebf02e4-47ef-4381-b939-212302d5af9e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 15:15:47.901644 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:15:47.901644 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:15:47.901644 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:15:47.901644 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:15:47.901644 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:15:47.901644 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:15:47.901644 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:15:47.901644 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:15:47.901644 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:15:47.901644 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:15:47.901644 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:15:47.901644 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 15:15:47.901644 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 15:15:47.901644 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 15:15:47.901644 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 15:15:47.902655 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 15:15:47.902655 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 15:15:47.902655 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 15:15:47.902655 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 15:15:47.902655 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:15:47.902655 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:15:47.902655 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:15:47.902655 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:15:47.902655 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:15:47.902655 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:15:47.902655 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:15:47.902655 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Sep 13 15:15:47.902655 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:15:47.902655 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:15:47.902655 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:15:47.902655 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:15:47.903504 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:15:47.903504 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:15:47.903504 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:15:47.903504 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:15:47.903504 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 15:15:47.903504 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 15:15:47.903504 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 15:15:47.903504 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 15:15:47.903504 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 15:15:47.903504 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 15:15:47.903504 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 15:15:47.903504 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Sep 13 15:15:47.903504 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 277/571] 10.222.0.27 () {56 vars in 1102 bytes} [Tue Sep 13 15:15:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:15:47.904196 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebf02e4-47ef-4381-b939-212302d5af9e None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:47.944695 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2ac318-e9d1-46f1-8c70-430a29225686 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:47.979181 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac93e556-03e2-4356-937b-56aa74a59f57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:47.979791 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac93e556-03e2-4356-937b-56aa74a59f57 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:47.980139 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac93e556-03e2-4356-937b-56aa74a59f57 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:47.980421 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac93e556-03e2-4356-937b-56aa74a59f57 None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:47.981086 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac93e556-03e2-4356-937b-56aa74a59f57 None admin] RBAC: Adding query filter params (name=service) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:15:47.981393 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac93e556-03e2-4356-937b-56aa74a59f57 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:47.982793 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac93e556-03e2-4356-937b-56aa74a59f57 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:47.990811 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 295/572] 10.222.0.27 () {56 vars in 1103 bytes} [Tue Sep 13 15:15:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:15:47.991305 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac93e556-03e2-4356-937b-56aa74a59f57 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:48.007316 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebf02e4-47ef-4381-b939-212302d5af9e None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:48.040834 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f44571-3067-450b-b296-02dc3fef9aa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:48.041433 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f44571-3067-450b-b296-02dc3fef9aa8 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:48.041729 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f44571-3067-450b-b296-02dc3fef9aa8 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:48.042011 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f44571-3067-450b-b296-02dc3fef9aa8 None admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:48.042648 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f44571-3067-450b-b296-02dc3fef9aa8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:15:48.042948 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f44571-3067-450b-b296-02dc3fef9aa8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:48.044293 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f44571-3067-450b-b296-02dc3fef9aa8 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:48.057205 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 278/573] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Sep 13 15:15:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:15:48.058014 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f44571-3067-450b-b296-02dc3fef9aa8 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:48.071563 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:48.090485 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:48.094322 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac93e556-03e2-4356-937b-56aa74a59f57 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:48.129957 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafe3e0f-cf27-4dc8-b2b1-589f0ee250c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:48.130582 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafe3e0f-cf27-4dc8-b2b1-589f0ee250c2 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:48.130888 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafe3e0f-cf27-4dc8-b2b1-589f0ee250c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:48.131213 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafe3e0f-cf27-4dc8-b2b1-589f0ee250c2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:48.141251 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafe3e0f-cf27-4dc8-b2b1-589f0ee250c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 15:15:48.146528 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-eafe3e0f-cf27-4dc8-b2b1-589f0ee250c2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 15:15:48.146528 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:15:48.146528 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:15:48.146528 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:15:48.146528 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:15:48.146528 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:15:48.146528 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:15:48.146528 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:15:48.146528 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:15:48.146528 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:15:48.146528 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:15:48.146528 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:15:48.146528 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 15:15:48.146528 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 15:15:48.146528 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 15:15:48.146528 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 15:15:48.148313 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 15:15:48.148313 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 15:15:48.148313 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 15:15:48.148313 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 15:15:48.148313 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:15:48.148313 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:15:48.148313 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:15:48.148313 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:15:48.148313 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:15:48.148313 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:15:48.148313 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:15:48.148313 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Sep 13 15:15:48.148313 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:15:48.148313 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:15:48.148313 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:15:48.148313 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:15:48.150085 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:15:48.150085 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:15:48.150085 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:15:48.150085 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:15:48.150085 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 15:15:48.150085 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 15:15:48.150085 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 15:15:48.150085 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 15:15:48.150085 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 15:15:48.150085 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 15:15:48.150085 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 15:15:48.150085 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Sep 13 15:15:48.150085 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 296/574] 10.222.0.27 () {56 vars in 1102 bytes} [Tue Sep 13 15:15:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:15:48.150085 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafe3e0f-cf27-4dc8-b2b1-589f0ee250c2 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:48.171728 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f44571-3067-450b-b296-02dc3fef9aa8 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:48.206095 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eacc7c0-dd21-4fd0-bf5a-9b765cae4c4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:48.206694 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eacc7c0-dd21-4fd0-bf5a-9b765cae4c4e None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:48.206969 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eacc7c0-dd21-4fd0-bf5a-9b765cae4c4e None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:48.207245 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eacc7c0-dd21-4fd0-bf5a-9b765cae4c4e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:48.208209 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eacc7c0-dd21-4fd0-bf5a-9b765cae4c4e None admin] RBAC: Adding query filter params (role.id=470736c596a14fa5ac78200239aa1104, scope.project.id=3d6e00339cfa47d2a6fa8724c587035f, user.id=dc735644be394e0abe73e709373e2003) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:15:48.208523 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eacc7c0-dd21-4fd0-bf5a-9b765cae4c4e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:48.210936 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eacc7c0-dd21-4fd0-bf5a-9b765cae4c4e None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:48.216099 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 279/575] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Sep 13 15:15:48 2022] GET /identity/v3/role_assignments?user.id=dc735644be394e0abe73e709373e2003&scope.project.id=3d6e00339cfa47d2a6fa8724c587035f&role.id=470736c596a14fa5ac78200239aa1104 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:15:48.216861 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eacc7c0-dd21-4fd0-bf5a-9b765cae4c4e None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:48.264516 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafe3e0f-cf27-4dc8-b2b1-589f0ee250c2 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:48.301079 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80166fe-aa82-461d-ba5c-571fe1d6dd14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:48.301734 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80166fe-aa82-461d-ba5c-571fe1d6dd14 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:48.302003 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80166fe-aa82-461d-ba5c-571fe1d6dd14 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:48.302281 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80166fe-aa82-461d-ba5c-571fe1d6dd14 None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:48.303695 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80166fe-aa82-461d-ba5c-571fe1d6dd14 None admin] RBAC: Adding query filter params (name=service) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:15:48.304009 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80166fe-aa82-461d-ba5c-571fe1d6dd14 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:48.305430 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80166fe-aa82-461d-ba5c-571fe1d6dd14 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:48.314081 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:48.320264 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 297/576] 10.222.0.27 () {56 vars in 1103 bytes} [Tue Sep 13 15:15:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:15:48.321321 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80166fe-aa82-461d-ba5c-571fe1d6dd14 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:48.345575 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eacc7c0-dd21-4fd0-bf5a-9b765cae4c4e None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:48.346267 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:48.389511 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c5e41c-fe92-466d-a507-f0867b8c98eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:48.390202 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c5e41c-fe92-466d-a507-f0867b8c98eb None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:48.390486 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c5e41c-fe92-466d-a507-f0867b8c98eb None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:48.390761 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c5e41c-fe92-466d-a507-f0867b8c98eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:48.405031 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c5e41c-fe92-466d-a507-f0867b8c98eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:48.406551 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c5e41c-fe92-466d-a507-f0867b8c98eb None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:48.422425 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-e7c5e41c-fe92-466d-a507-f0867b8c98eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 15:15:48.422425 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:15:48.422425 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:15:48.422425 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:15:48.422425 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:15:48.422425 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:15:48.422425 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:15:48.422425 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:15:48.422425 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:15:48.422425 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:15:48.422425 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:15:48.422425 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:15:48.422425 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 15:15:48.422425 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 15:15:48.422425 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 15:15:48.422425 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 15:15:48.423424 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:15:48.423424 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:15:48.423424 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:15:48.423424 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:15:48.423424 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:15:48.423424 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:15:48.423424 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:15:48.423424 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Sep 13 15:15:48.423424 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:15:48.423424 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:15:48.423424 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:15:48.423424 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:15:48.423424 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:15:48.423424 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:15:48.423424 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:15:48.423424 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:15:48.423424 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 15:15:48.424318 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 15:15:48.424318 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 15:15:48.424318 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Sep 13 15:15:48.424318 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 280/577] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 13 15:15:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:15:48.424318 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c5e41c-fe92-466d-a507-f0867b8c98eb None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:48.446088 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80166fe-aa82-461d-ba5c-571fe1d6dd14 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:48.483384 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364869d8-a06b-4736-9816-e4ecfa4474eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:48.484056 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364869d8-a06b-4736-9816-e4ecfa4474eb None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:48.484337 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364869d8-a06b-4736-9816-e4ecfa4474eb None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:48.484619 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364869d8-a06b-4736-9816-e4ecfa4474eb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:48.492051 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364869d8-a06b-4736-9816-e4ecfa4474eb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:48.493509 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364869d8-a06b-4736-9816-e4ecfa4474eb None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:48.504864 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-364869d8-a06b-4736-9816-e4ecfa4474eb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 15:15:48.504864 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:15:48.504864 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:15:48.504864 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:15:48.504864 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:15:48.504864 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:15:48.504864 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:15:48.504864 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:15:48.504864 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:15:48.504864 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:15:48.504864 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:15:48.504864 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:15:48.504864 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 15:15:48.504864 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 15:15:48.504864 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 15:15:48.505867 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 15:15:48.505867 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:15:48.505867 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:15:48.505867 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:15:48.505867 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:15:48.505867 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:15:48.505867 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:15:48.505867 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:15:48.505867 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Sep 13 15:15:48.505867 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:15:48.505867 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:15:48.505867 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:15:48.505867 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:15:48.505867 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:15:48.505867 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:15:48.505867 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:15:48.505867 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:15:48.507314 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 15:15:48.507314 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 15:15:48.507314 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 15:15:48.507314 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 15:15:48.507314 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 15:15:48.507314 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 15:15:48.507314 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 15:15:48.507314 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Sep 13 15:15:48.507314 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 298/578] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Sep 13 15:15:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:15:48.507314 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364869d8-a06b-4736-9816-e4ecfa4474eb None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:48.540904 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c5e41c-fe92-466d-a507-f0867b8c98eb None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:48.571468 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:48.581968 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855b4dbb-7a68-4f7e-8e69-bf87ed1f1d62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:48.582698 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855b4dbb-7a68-4f7e-8e69-bf87ed1f1d62 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:48.582978 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855b4dbb-7a68-4f7e-8e69-bf87ed1f1d62 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:48.583298 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855b4dbb-7a68-4f7e-8e69-bf87ed1f1d62 None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:48.583969 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855b4dbb-7a68-4f7e-8e69-bf87ed1f1d62 None admin] RBAC: Adding query filter params (name=service) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:15:48.584370 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855b4dbb-7a68-4f7e-8e69-bf87ed1f1d62 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:48.586042 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855b4dbb-7a68-4f7e-8e69-bf87ed1f1d62 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:48.592706 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:48.602009 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 281/579] 10.222.0.27 () {56 vars in 1103 bytes} [Tue Sep 13 15:15:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:15:48.602718 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855b4dbb-7a68-4f7e-8e69-bf87ed1f1d62 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:48.616742 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364869d8-a06b-4736-9816-e4ecfa4474eb None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:48.650612 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ce8fae-1a85-40f0-a4e6-d0f300128dce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:48.651245 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ce8fae-1a85-40f0-a4e6-d0f300128dce None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:48.651531 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ce8fae-1a85-40f0-a4e6-d0f300128dce None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:48.651818 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ce8fae-1a85-40f0-a4e6-d0f300128dce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:48.663583 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ce8fae-1a85-40f0-a4e6-d0f300128dce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:48.665066 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ce8fae-1a85-40f0-a4e6-d0f300128dce None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:48.680352 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-89ce8fae-1a85-40f0-a4e6-d0f300128dce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 15:15:48.680352 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:15:48.680352 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:15:48.680352 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:15:48.680352 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:15:48.680352 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:15:48.680352 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:15:48.680352 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:15:48.680352 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:15:48.680352 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:15:48.680352 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:15:48.680352 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:15:48.680352 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 15:15:48.680352 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 15:15:48.680352 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 15:15:48.680352 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 15:15:48.681352 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:15:48.681352 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:15:48.681352 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:15:48.681352 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:15:48.681352 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:15:48.681352 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:15:48.681352 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:15:48.681352 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Sep 13 15:15:48.681352 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:15:48.681352 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:15:48.681352 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:15:48.681352 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:15:48.681352 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:15:48.681352 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:15:48.681352 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:15:48.681352 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:15:48.681352 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 15:15:48.682273 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 15:15:48.682273 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 15:15:48.682273 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Sep 13 15:15:48.682273 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 299/580] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 13 15:15:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:15:48.682515 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ce8fae-1a85-40f0-a4e6-d0f300128dce None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:48.727958 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855b4dbb-7a68-4f7e-8e69-bf87ed1f1d62 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:48.775220 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c91fbd-29ac-4f34-8714-926a803a0ad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:48.775885 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c91fbd-29ac-4f34-8714-926a803a0ad5 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:48.776170 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c91fbd-29ac-4f34-8714-926a803a0ad5 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:48.776444 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c91fbd-29ac-4f34-8714-926a803a0ad5 None admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:48.777082 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c91fbd-29ac-4f34-8714-926a803a0ad5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:15:48.777384 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c91fbd-29ac-4f34-8714-926a803a0ad5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:48.778776 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c91fbd-29ac-4f34-8714-926a803a0ad5 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:48.795775 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 282/581] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Sep 13 15:15:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:15:48.795775 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c91fbd-29ac-4f34-8714-926a803a0ad5 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:48.807035 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ce8fae-1a85-40f0-a4e6-d0f300128dce None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:48.836412 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:48.843083 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a584f80-3cbc-4346-a884-817bc4170e72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:48.843701 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a584f80-3cbc-4346-a884-817bc4170e72 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:48.843987 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a584f80-3cbc-4346-a884-817bc4170e72 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:48.844269 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a584f80-3cbc-4346-a884-817bc4170e72 None admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:48.844964 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a584f80-3cbc-4346-a884-817bc4170e72 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:15:48.845275 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a584f80-3cbc-4346-a884-817bc4170e72 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:48.845928 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:48.846744 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a584f80-3cbc-4346-a884-817bc4170e72 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:48.859958 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 300/582] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Sep 13 15:15:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:15:48.860884 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a584f80-3cbc-4346-a884-817bc4170e72 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:48.906648 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c91fbd-29ac-4f34-8714-926a803a0ad5 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:48.943429 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5b17dc-8084-4659-b159-d1fe6f01c0a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:48.944047 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5b17dc-8084-4659-b159-d1fe6f01c0a8 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:48.944314 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5b17dc-8084-4659-b159-d1fe6f01c0a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:48.944651 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5b17dc-8084-4659-b159-d1fe6f01c0a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:48.956065 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5b17dc-8084-4659-b159-d1fe6f01c0a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:48.957349 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5b17dc-8084-4659-b159-d1fe6f01c0a8 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:48.972739 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-fa5b17dc-8084-4659-b159-d1fe6f01c0a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 15:15:48.972739 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:15:48.972739 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:15:48.972739 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:15:48.972739 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:15:48.972739 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:15:48.972739 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:15:48.972739 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:15:48.972739 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:15:48.972739 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:15:48.972739 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:15:48.972739 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:15:48.972739 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 15:15:48.972739 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 15:15:48.972739 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 15:15:48.972739 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 15:15:48.973728 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:15:48.973728 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:15:48.973728 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:15:48.973728 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:15:48.973728 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:15:48.973728 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:15:48.973728 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:15:48.973728 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Sep 13 15:15:48.973728 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:15:48.973728 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:15:48.973728 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:15:48.973728 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:15:48.973728 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:15:48.973728 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:15:48.973728 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:15:48.973728 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:15:48.973728 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 15:15:48.974649 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 15:15:48.974649 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 15:15:48.974649 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Sep 13 15:15:48.974897 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a584f80-3cbc-4346-a884-817bc4170e72 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:48.978530 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 283/583] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 13 15:15:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:15:48.979390 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5b17dc-8084-4659-b159-d1fe6f01c0a8 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:49.011892 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aafda7-b81c-48b1-9bfa-2154dc9e95e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:49.012505 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aafda7-b81c-48b1-9bfa-2154dc9e95e8 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:49.012789 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aafda7-b81c-48b1-9bfa-2154dc9e95e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:49.013064 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aafda7-b81c-48b1-9bfa-2154dc9e95e8 None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:49.013724 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91aafda7-b81c-48b1-9bfa-2154dc9e95e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:15:49.014036 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91aafda7-b81c-48b1-9bfa-2154dc9e95e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:49.015405 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91aafda7-b81c-48b1-9bfa-2154dc9e95e8 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:49.032896 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 301/584] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Sep 13 15:15:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:15:49.032896 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aafda7-b81c-48b1-9bfa-2154dc9e95e8 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:49.087113 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:49.090239 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5b17dc-8084-4659-b159-d1fe6f01c0a8 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:49.091111 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:49.130036 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ecfee4-755b-4213-99d8-06125a006c1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:49.130667 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ecfee4-755b-4213-99d8-06125a006c1b None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:49.130949 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ecfee4-755b-4213-99d8-06125a006c1b None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:49.131249 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ecfee4-755b-4213-99d8-06125a006c1b None admin] PATH_INFO: `/v3/users/glance` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:49.140115 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ecfee4-755b-4213-99d8-06125a006c1b None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:49.141535 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ecfee4-755b-4213-99d8-06125a006c1b None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:49.144325 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aafda7-b81c-48b1-9bfa-2154dc9e95e8 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:49.153550 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-d4ecfee4-755b-4213-99d8-06125a006c1b None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 13 15:15:49.153550 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:15:49.153550 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:15:49.153550 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:15:49.153550 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:15:49.153550 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:15:49.153550 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:15:49.153550 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:15:49.153550 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:15:49.153550 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:15:49.153550 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:15:49.153550 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:15:49.153550 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 15:15:49.153550 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 15:15:49.153550 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 15:15:49.153550 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 15:15:49.154752 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:15:49.154752 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:15:49.154752 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 15:15:49.154752 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 15:15:49.154752 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 15:15:49.154752 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 15:15:49.154752 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:15:49.154752 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:15:49.154752 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:15:49.154752 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:15:49.154752 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:15:49.154752 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Sep 13 15:15:49.154752 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:15:49.154752 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:15:49.154752 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:15:49.154752 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:15:49.154752 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:15:49.154752 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:15:49.155696 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:15:49.155696 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:15:49.155696 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 15:15:49.155696 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 15:15:49.155696 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 15:15:49.155696 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 15:15:49.155696 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 15:15:49.155696 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 15:15:49.155696 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 13 15:15:49.155696 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Sep 13 15:15:49.155696 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 284/585] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Sep 13 15:15:48 2022] GET /identity/v3/users/glance => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:15:49.155696 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ecfee4-755b-4213-99d8-06125a006c1b None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:49.185176 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714a9123-393a-401d-87d3-c1e098b52c0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:49.185994 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714a9123-393a-401d-87d3-c1e098b52c0a None admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:49.186398 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714a9123-393a-401d-87d3-c1e098b52c0a None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:49.186686 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714a9123-393a-401d-87d3-c1e098b52c0a None admin] PATH_INFO: `/v3/projects/3d6e00339cfa47d2a6fa8724c587035f/users/62aad71c6c1a4469805762bba330bf0e/roles/470736c596a14fa5ac78200239aa1104` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:49.201589 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714a9123-393a-401d-87d3-c1e098b52c0a None admin] RBAC: Authorizing `identity:create_grant(project_id=3d6e00339cfa47d2a6fa8724c587035f, user_id=62aad71c6c1a4469805762bba330bf0e, role_id=470736c596a14fa5ac78200239aa1104)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:49.203052 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714a9123-393a-401d-87d3-c1e098b52c0a None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:49.216406 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 302/586] 10.222.0.27 () {58 vars in 1439 bytes} [Tue Sep 13 15:15:49 2022] PUT /identity/v3/projects/3d6e00339cfa47d2a6fa8724c587035f/users/62aad71c6c1a4469805762bba330bf0e/roles/470736c596a14fa5ac78200239aa1104 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:15:49.217328 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714a9123-393a-401d-87d3-c1e098b52c0a None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:49.286397 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ecfee4-755b-4213-99d8-06125a006c1b None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:49.332042 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01ab88e-3c64-4fd8-aa6e-4a11295e350d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:49.332776 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01ab88e-3c64-4fd8-aa6e-4a11295e350d None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:49.333126 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01ab88e-3c64-4fd8-aa6e-4a11295e350d None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:49.333683 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01ab88e-3c64-4fd8-aa6e-4a11295e350d None admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:49.335218 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01ab88e-3c64-4fd8-aa6e-4a11295e350d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:15:49.336431 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01ab88e-3c64-4fd8-aa6e-4a11295e350d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:49.337969 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01ab88e-3c64-4fd8-aa6e-4a11295e350d None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:49.359584 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 285/587] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Sep 13 15:15:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:15:49.359584 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01ab88e-3c64-4fd8-aa6e-4a11295e350d None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:49.370267 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714a9123-393a-401d-87d3-c1e098b52c0a None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:49.372223 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:49.394392 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:49.425668 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3e0dab-59be-46ae-8e08-985b7c0d3868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:49.427520 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3e0dab-59be-46ae-8e08-985b7c0d3868 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:49.429033 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3e0dab-59be-46ae-8e08-985b7c0d3868 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:49.429550 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3e0dab-59be-46ae-8e08-985b7c0d3868 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:49.437397 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3e0dab-59be-46ae-8e08-985b7c0d3868 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:49.438915 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3e0dab-59be-46ae-8e08-985b7c0d3868 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:49.455774 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-4c3e0dab-59be-46ae-8e08-985b7c0d3868 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 13 15:15:49.455774 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:15:49.455774 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:15:49.455774 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:15:49.455774 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:15:49.455774 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:15:49.455774 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:15:49.455774 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:15:49.455774 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:15:49.455774 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:15:49.455774 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:15:49.455774 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:15:49.455774 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 15:15:49.455774 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 15:15:49.455774 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 15:15:49.455774 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 15:15:49.456749 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:15:49.456749 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:15:49.456749 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 15:15:49.456749 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 15:15:49.456749 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 15:15:49.456749 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 15:15:49.456749 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:15:49.456749 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:15:49.456749 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:15:49.456749 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:15:49.456749 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:15:49.456749 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Sep 13 15:15:49.456749 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:15:49.456749 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:15:49.456749 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:15:49.456749 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:15:49.456749 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:15:49.456749 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:15:49.457682 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:15:49.457682 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:15:49.457682 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 15:15:49.457682 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 15:15:49.457682 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 15:15:49.457682 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 15:15:49.457682 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 15:15:49.457682 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 15:15:49.457682 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 13 15:15:49.457682 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Sep 13 15:15:49.457682 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 303/588] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Sep 13 15:15:49 2022] GET /identity/v3/users/cinder => generated 84 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:15:49.458352 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3e0dab-59be-46ae-8e08-985b7c0d3868 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:49.492162 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01ab88e-3c64-4fd8-aa6e-4a11295e350d None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:49.529522 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ec446a-e368-423c-8d55-1b6c4b001816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:49.530533 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ec446a-e368-423c-8d55-1b6c4b001816 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:49.531043 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ec446a-e368-423c-8d55-1b6c4b001816 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:49.531535 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ec446a-e368-423c-8d55-1b6c4b001816 None admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:49.532466 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ec446a-e368-423c-8d55-1b6c4b001816 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:15:49.532985 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ec446a-e368-423c-8d55-1b6c4b001816 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:49.534731 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ec446a-e368-423c-8d55-1b6c4b001816 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:49.553060 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 286/589] 10.222.0.27 () {56 vars in 1137 bytes} [Tue Sep 13 15:15:49 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:15:49.558956 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ec446a-e368-423c-8d55-1b6c4b001816 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:49.565992 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3e0dab-59be-46ae-8e08-985b7c0d3868 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:49.604131 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef01024-eb2f-4a40-a8d1-3ef3c0199c36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:49.604881 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef01024-eb2f-4a40-a8d1-3ef3c0199c36 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:49.605409 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef01024-eb2f-4a40-a8d1-3ef3c0199c36 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:49.605567 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef01024-eb2f-4a40-a8d1-3ef3c0199c36 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:49.613805 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef01024-eb2f-4a40-a8d1-3ef3c0199c36 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:49.615576 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef01024-eb2f-4a40-a8d1-3ef3c0199c36 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:49.628259 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-0ef01024-eb2f-4a40-a8d1-3ef3c0199c36 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 13 15:15:49.628259 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:15:49.628259 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:15:49.628259 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:15:49.628259 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:15:49.628259 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:15:49.628259 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:15:49.628259 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:15:49.628259 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:15:49.628259 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:15:49.628259 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:15:49.628259 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:15:49.628259 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 15:15:49.628259 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 15:15:49.628259 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 15:15:49.628259 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 15:15:49.629342 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:15:49.629342 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:15:49.629342 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 15:15:49.629342 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 15:15:49.629342 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 15:15:49.629342 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 15:15:49.629342 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:15:49.629342 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:15:49.629342 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:15:49.629342 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:15:49.629342 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:15:49.629342 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Sep 13 15:15:49.629342 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:15:49.629342 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:15:49.629342 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:15:49.629342 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:15:49.629342 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:15:49.629342 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:15:49.630481 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:15:49.630481 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:15:49.630481 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 15:15:49.630481 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 15:15:49.630481 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 15:15:49.630481 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 15:15:49.630481 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 15:15:49.630481 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 15:15:49.630481 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 13 15:15:49.630481 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Sep 13 15:15:49.630481 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 304/590] 10.222.0.27 () {56 vars in 1102 bytes} [Tue Sep 13 15:15:49 2022] GET /identity/v3/users/neutron => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:15:49.632214 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef01024-eb2f-4a40-a8d1-3ef3c0199c36 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:49.648614 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:49.659070 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:49.670596 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ec446a-e368-423c-8d55-1b6c4b001816 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:49.707615 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e422f114-a437-4eb4-ad34-b1389f745067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:49.708142 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e422f114-a437-4eb4-ad34-b1389f745067 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:49.708424 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e422f114-a437-4eb4-ad34-b1389f745067 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:49.708703 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e422f114-a437-4eb4-ad34-b1389f745067 None admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:49.712927 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e422f114-a437-4eb4-ad34-b1389f745067 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:15:49.713245 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e422f114-a437-4eb4-ad34-b1389f745067 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:49.714715 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e422f114-a437-4eb4-ad34-b1389f745067 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:49.745884 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef01024-eb2f-4a40-a8d1-3ef3c0199c36 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:49.746099 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 287/591] 10.222.0.27 () {56 vars in 1137 bytes} [Tue Sep 13 15:15:49 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:15:49.746933 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e422f114-a437-4eb4-ad34-b1389f745067 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:49.786356 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5708e22f-06c5-4a8f-9160-ceb0dacbadef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:49.787139 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5708e22f-06c5-4a8f-9160-ceb0dacbadef None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:49.787730 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5708e22f-06c5-4a8f-9160-ceb0dacbadef None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:49.788309 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5708e22f-06c5-4a8f-9160-ceb0dacbadef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:49.802248 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5708e22f-06c5-4a8f-9160-ceb0dacbadef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:49.804961 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5708e22f-06c5-4a8f-9160-ceb0dacbadef None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:49.828489 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-5708e22f-06c5-4a8f-9160-ceb0dacbadef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 15:15:49.828489 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:15:49.828489 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:15:49.828489 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:15:49.828489 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:15:49.828489 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:15:49.828489 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:15:49.828489 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:15:49.828489 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:15:49.828489 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:15:49.828489 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:15:49.828489 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:15:49.828489 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 15:15:49.828489 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 15:15:49.828489 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 15:15:49.828489 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 15:15:49.829649 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:15:49.829649 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:15:49.829649 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:15:49.829649 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:15:49.829649 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:15:49.829649 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:15:49.829649 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:15:49.829649 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Sep 13 15:15:49.829649 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:15:49.829649 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:15:49.829649 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:15:49.829649 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:15:49.829649 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:15:49.829649 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:15:49.829649 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:15:49.829649 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:15:49.829649 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 15:15:49.830755 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 15:15:49.830755 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 15:15:49.830755 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Sep 13 15:15:49.832649 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 305/592] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 13 15:15:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:15:49.833657 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5708e22f-06c5-4a8f-9160-ceb0dacbadef None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:49.875761 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e422f114-a437-4eb4-ad34-b1389f745067 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:49.914612 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f77c73-d4cc-4a60-a151-a4006de83c61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:49.915468 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f77c73-d4cc-4a60-a151-a4006de83c61 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:49.915929 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f77c73-d4cc-4a60-a151-a4006de83c61 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:49.916349 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f77c73-d4cc-4a60-a151-a4006de83c61 None admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:49.917237 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f77c73-d4cc-4a60-a151-a4006de83c61 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:15:49.917691 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f77c73-d4cc-4a60-a151-a4006de83c61 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:49.919360 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f77c73-d4cc-4a60-a151-a4006de83c61 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:49.923246 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:49.938225 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:49.940825 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 288/593] 10.222.0.27 () {56 vars in 1139 bytes} [Tue Sep 13 15:15:49 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:15:49.941996 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f77c73-d4cc-4a60-a151-a4006de83c61 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:49.974532 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5708e22f-06c5-4a8f-9160-ceb0dacbadef None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:50.023396 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb11cb0-76b0-4256-bb50-e76102f0dd7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:50.024188 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb11cb0-76b0-4256-bb50-e76102f0dd7c None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:50.024569 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb11cb0-76b0-4256-bb50-e76102f0dd7c None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:50.024960 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb11cb0-76b0-4256-bb50-e76102f0dd7c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:50.038566 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb11cb0-76b0-4256-bb50-e76102f0dd7c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:50.040350 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb11cb0-76b0-4256-bb50-e76102f0dd7c None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:50.055960 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-bcb11cb0-76b0-4256-bb50-e76102f0dd7c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 15:15:50.055960 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:15:50.055960 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:15:50.055960 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:15:50.055960 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:15:50.055960 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:15:50.055960 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:15:50.055960 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:15:50.055960 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:15:50.055960 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:15:50.055960 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:15:50.055960 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:15:50.055960 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 15:15:50.055960 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 15:15:50.055960 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 15:15:50.055960 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 15:15:50.057085 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:15:50.057085 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:15:50.057085 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:15:50.057085 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:15:50.057085 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:15:50.057085 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:15:50.057085 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:15:50.057085 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Sep 13 15:15:50.057085 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:15:50.057085 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:15:50.057085 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:15:50.057085 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:15:50.057085 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:15:50.057085 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:15:50.057085 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:15:50.057085 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:15:50.057085 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 15:15:50.058174 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 15:15:50.058174 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 15:15:50.058174 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Sep 13 15:15:50.059937 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 306/594] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 13 15:15:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:15:50.060314 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f77c73-d4cc-4a60-a151-a4006de83c61 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:50.061113 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb11cb0-76b0-4256-bb50-e76102f0dd7c None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:50.099098 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcb6f90-e058-4af0-afd8-e76e05dc71eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:50.100643 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcb6f90-e058-4af0-afd8-e76e05dc71eb None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:50.101161 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcb6f90-e058-4af0-afd8-e76e05dc71eb None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:50.101842 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcb6f90-e058-4af0-afd8-e76e05dc71eb None admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:50.102496 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcb6f90-e058-4af0-afd8-e76e05dc71eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:15:50.102882 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcb6f90-e058-4af0-afd8-e76e05dc71eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:50.104317 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcb6f90-e058-4af0-afd8-e76e05dc71eb None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:50.117380 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 289/595] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Sep 13 15:15:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:15:50.118424 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcb6f90-e058-4af0-afd8-e76e05dc71eb None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:50.184372 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb11cb0-76b0-4256-bb50-e76102f0dd7c None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:50.189484 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:50.213323 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:50.222264 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba300f3-7951-496d-8649-bf1460cbd022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:50.222883 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba300f3-7951-496d-8649-bf1460cbd022 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:50.223517 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba300f3-7951-496d-8649-bf1460cbd022 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:50.224124 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba300f3-7951-496d-8649-bf1460cbd022 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:50.236046 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba300f3-7951-496d-8649-bf1460cbd022 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:50.237623 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba300f3-7951-496d-8649-bf1460cbd022 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:50.248187 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcb6f90-e058-4af0-afd8-e76e05dc71eb None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:50.254254 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-5ba300f3-7951-496d-8649-bf1460cbd022 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 15:15:50.254254 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:15:50.254254 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:15:50.254254 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:15:50.254254 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:15:50.254254 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:15:50.254254 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:15:50.254254 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:15:50.254254 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:15:50.254254 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:15:50.254254 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:15:50.254254 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:15:50.254254 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 15:15:50.254254 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 15:15:50.254254 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 15:15:50.254254 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 15:15:50.255398 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:15:50.255398 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:15:50.255398 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:15:50.255398 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:15:50.255398 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:15:50.255398 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:15:50.255398 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:15:50.255398 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Sep 13 15:15:50.255398 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:15:50.255398 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:15:50.255398 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:15:50.255398 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:15:50.255398 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:15:50.255398 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:15:50.255398 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:15:50.255398 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:15:50.255398 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 15:15:50.257016 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 15:15:50.257016 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 15:15:50.257016 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Sep 13 15:15:50.258019 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 307/596] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 13 15:15:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:15:50.258927 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba300f3-7951-496d-8649-bf1460cbd022 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:50.292365 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185e23f3-2c5b-463f-8e61-87aa127a2597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:50.293402 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185e23f3-2c5b-463f-8e61-87aa127a2597 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:50.293894 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185e23f3-2c5b-463f-8e61-87aa127a2597 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:50.294318 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185e23f3-2c5b-463f-8e61-87aa127a2597 None admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:50.295291 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185e23f3-2c5b-463f-8e61-87aa127a2597 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:15:50.295752 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185e23f3-2c5b-463f-8e61-87aa127a2597 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:50.297460 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185e23f3-2c5b-463f-8e61-87aa127a2597 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:50.313885 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 290/597] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Sep 13 15:15:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:15:50.315109 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185e23f3-2c5b-463f-8e61-87aa127a2597 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:50.374967 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba300f3-7951-496d-8649-bf1460cbd022 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:50.412501 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abc34a6-c4a6-41f8-b4fa-702336409544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:50.412817 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abc34a6-c4a6-41f8-b4fa-702336409544 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:50.413203 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abc34a6-c4a6-41f8-b4fa-702336409544 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:50.413586 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abc34a6-c4a6-41f8-b4fa-702336409544 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:50.420988 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abc34a6-c4a6-41f8-b4fa-702336409544 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:50.422696 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abc34a6-c4a6-41f8-b4fa-702336409544 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:50.435068 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-5abc34a6-c4a6-41f8-b4fa-702336409544 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 15:15:50.435068 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:15:50.435068 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:15:50.435068 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:15:50.435068 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:15:50.435068 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:15:50.435068 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:15:50.435068 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:15:50.435068 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:15:50.435068 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:15:50.435068 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:15:50.435068 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:15:50.435068 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 15:15:50.435068 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 15:15:50.435068 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 15:15:50.436234 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 15:15:50.436234 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:15:50.436234 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:15:50.436234 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:15:50.436234 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:15:50.436234 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:15:50.436234 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:15:50.436234 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:15:50.436234 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Sep 13 15:15:50.436234 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:15:50.436234 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:15:50.436234 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:15:50.436234 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:15:50.436234 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:15:50.436234 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:15:50.436234 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:15:50.436234 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:15:50.437335 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 15:15:50.437335 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 15:15:50.437335 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 15:15:50.437335 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 15:15:50.437335 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 15:15:50.437335 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 15:15:50.437335 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 15:15:50.437335 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Sep 13 15:15:50.442032 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 308/598] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Sep 13 15:15:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:15:50.442858 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abc34a6-c4a6-41f8-b4fa-702336409544 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:50.444422 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185e23f3-2c5b-463f-8e61-87aa127a2597 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:50.460521 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:50.483481 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d97003-2de5-4ecd-bc9e-3a27bcb6b0bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:50.484085 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d97003-2de5-4ecd-bc9e-3a27bcb6b0bd None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:50.484364 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d97003-2de5-4ecd-bc9e-3a27bcb6b0bd None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:50.484884 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:50.485060 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d97003-2de5-4ecd-bc9e-3a27bcb6b0bd None admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:50.485722 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d97003-2de5-4ecd-bc9e-3a27bcb6b0bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:15:50.486030 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d97003-2de5-4ecd-bc9e-3a27bcb6b0bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:50.487820 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d97003-2de5-4ecd-bc9e-3a27bcb6b0bd None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:50.501048 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 291/599] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Sep 13 15:15:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:15:50.503936 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445c6fd6-ce8f-4a8f-8fed-3c6d7d342dfc None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:50.504666 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445c6fd6-ce8f-4a8f-8fed-3c6d7d342dfc None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:50.505194 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445c6fd6-ce8f-4a8f-8fed-3c6d7d342dfc None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:50.507589 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 292/600] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:15:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:15:50.508308 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445c6fd6-ce8f-4a8f-8fed-3c6d7d342dfc None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:50.555569 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abc34a6-c4a6-41f8-b4fa-702336409544 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:50.589428 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5cdc83-b6d5-4207-8af3-7e619895bfee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:50.590563 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5cdc83-b6d5-4207-8af3-7e619895bfee None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:50.590563 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5cdc83-b6d5-4207-8af3-7e619895bfee None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:50.590762 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5cdc83-b6d5-4207-8af3-7e619895bfee None admin] PATH_INFO: `/v3/projects/service` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:50.597245 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5cdc83-b6d5-4207-8af3-7e619895bfee None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:50.598698 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5cdc83-b6d5-4207-8af3-7e619895bfee None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:50.610169 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-8c5cdc83-b6d5-4207-8af3-7e619895bfee None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 15:15:50.610169 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:15:50.610169 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:15:50.610169 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:15:50.610169 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:15:50.610169 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:15:50.610169 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:15:50.610169 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:15:50.610169 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:15:50.610169 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:15:50.610169 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:15:50.610169 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:15:50.610169 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 15:15:50.610169 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 15:15:50.610169 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 15:15:50.611092 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 15:15:50.611092 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:15:50.611092 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:15:50.611092 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:15:50.611092 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:15:50.611092 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:15:50.611092 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:15:50.611092 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:15:50.611092 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Sep 13 15:15:50.611092 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:15:50.611092 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:15:50.611092 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:15:50.611092 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:15:50.611092 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:15:50.611092 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:15:50.611092 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:15:50.611092 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:15:50.611988 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 15:15:50.611988 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 15:15:50.611988 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 15:15:50.611988 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 15:15:50.611988 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 15:15:50.611988 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 15:15:50.611988 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 15:15:50.611988 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Sep 13 15:15:50.611988 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 309/601] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Sep 13 15:15:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:15:50.611988 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5cdc83-b6d5-4207-8af3-7e619895bfee None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:50.629850 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445c6fd6-ce8f-4a8f-8fed-3c6d7d342dfc None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:50.665813 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6dc300-4ecf-424a-9279-7ca1cc89ad39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:50.666429 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6dc300-4ecf-424a-9279-7ca1cc89ad39 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:50.666716 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6dc300-4ecf-424a-9279-7ca1cc89ad39 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:50.666994 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6dc300-4ecf-424a-9279-7ca1cc89ad39 None admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:50.667682 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6dc300-4ecf-424a-9279-7ca1cc89ad39 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:15:50.667993 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6dc300-4ecf-424a-9279-7ca1cc89ad39 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:50.669791 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6dc300-4ecf-424a-9279-7ca1cc89ad39 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:50.683772 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 293/602] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Sep 13 15:15:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:15:50.685439 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3739189-953d-47b5-935f-a350d1c9bf5e None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:50.685747 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3739189-953d-47b5-935f-a350d1c9bf5e None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:50.686299 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3739189-953d-47b5-935f-a350d1c9bf5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:50.704966 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-b3739189-953d-47b5-935f-a350d1c9bf5e None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:15:50.706203 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-b3739189-953d-47b5-935f-a350d1c9bf5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:15:50.723810 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:50.728355 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5cdc83-b6d5-4207-8af3-7e619895bfee None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:50.743349 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:50.763855 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97cbc3c-4f58-4159-a0f7-9e61b694ec91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:50.764486 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97cbc3c-4f58-4159-a0f7-9e61b694ec91 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:50.764776 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97cbc3c-4f58-4159-a0f7-9e61b694ec91 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:50.765043 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97cbc3c-4f58-4159-a0f7-9e61b694ec91 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:50.771800 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97cbc3c-4f58-4159-a0f7-9e61b694ec91 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:50.773252 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97cbc3c-4f58-4159-a0f7-9e61b694ec91 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:50.784491 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-d97cbc3c-4f58-4159-a0f7-9e61b694ec91 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 15:15:50.784491 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:15:50.784491 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:15:50.784491 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:15:50.784491 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:15:50.784491 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:15:50.784491 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:15:50.784491 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:15:50.784491 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:15:50.784491 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:15:50.784491 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:15:50.784491 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:15:50.784491 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 15:15:50.784491 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 15:15:50.784491 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 15:15:50.785540 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 15:15:50.785540 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:15:50.785540 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:15:50.785540 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:15:50.785540 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:15:50.785540 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:15:50.785540 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:15:50.785540 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:15:50.785540 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Sep 13 15:15:50.785540 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:15:50.785540 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:15:50.785540 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:15:50.785540 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:15:50.785540 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:15:50.785540 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:15:50.785540 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:15:50.785540 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:15:50.786478 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 15:15:50.786478 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 15:15:50.786478 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 15:15:50.786478 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 15:15:50.786478 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 15:15:50.786478 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 15:15:50.786478 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 15:15:50.786478 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Sep 13 15:15:50.786478 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 310/603] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Sep 13 15:15:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:15:50.786962 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97cbc3c-4f58-4159-a0f7-9e61b694ec91 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:50.796742 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 294/604] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:15:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 15:15:50.797769 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3739189-953d-47b5-935f-a350d1c9bf5e None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:50.902438 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97cbc3c-4f58-4159-a0f7-9e61b694ec91 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:50.939191 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac6b4d7-0610-4c53-bfce-b9b86dc807ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:50.939886 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac6b4d7-0610-4c53-bfce-b9b86dc807ff None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:50.940090 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac6b4d7-0610-4c53-bfce-b9b86dc807ff None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:50.940367 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac6b4d7-0610-4c53-bfce-b9b86dc807ff None admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:50.941055 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac6b4d7-0610-4c53-bfce-b9b86dc807ff None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:15:50.941364 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac6b4d7-0610-4c53-bfce-b9b86dc807ff None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:50.942360 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3739189-953d-47b5-935f-a350d1c9bf5e None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:50.942989 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac6b4d7-0610-4c53-bfce-b9b86dc807ff None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:50.961330 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 311/605] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Sep 13 15:15:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:15:50.962423 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac6b4d7-0610-4c53-bfce-b9b86dc807ff None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:50.983751 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:50.987725 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49913ea4-aad3-4009-afdc-3daf413a0b5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:50.988645 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49913ea4-aad3-4009-afdc-3daf413a0b5c None admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:50.989925 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49913ea4-aad3-4009-afdc-3daf413a0b5c None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:50.990433 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49913ea4-aad3-4009-afdc-3daf413a0b5c None admin] PATH_INFO: `/v3/projects/3d6e00339cfa47d2a6fa8724c587035f/users/8ef26a5203094c83b52f10b930dfc453/roles/470736c596a14fa5ac78200239aa1104` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:51.011251 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49913ea4-aad3-4009-afdc-3daf413a0b5c None admin] RBAC: Authorizing `identity:create_grant(project_id=3d6e00339cfa47d2a6fa8724c587035f, user_id=8ef26a5203094c83b52f10b930dfc453, role_id=470736c596a14fa5ac78200239aa1104)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:51.013630 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49913ea4-aad3-4009-afdc-3daf413a0b5c None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:51.034611 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 295/606] 10.222.0.27 () {58 vars in 1439 bytes} [Tue Sep 13 15:15:50 2022] PUT /identity/v3/projects/3d6e00339cfa47d2a6fa8724c587035f/users/8ef26a5203094c83b52f10b930dfc453/roles/470736c596a14fa5ac78200239aa1104 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:15:51.035670 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49913ea4-aad3-4009-afdc-3daf413a0b5c None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:51.056498 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:51.101425 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac6b4d7-0610-4c53-bfce-b9b86dc807ff None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:51.142112 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1134bdb-1240-4948-8497-c12196b666d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:51.142897 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1134bdb-1240-4948-8497-c12196b666d4 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:51.143275 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1134bdb-1240-4948-8497-c12196b666d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:51.143647 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1134bdb-1240-4948-8497-c12196b666d4 None admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:51.144566 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1134bdb-1240-4948-8497-c12196b666d4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:15:51.144977 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1134bdb-1240-4948-8497-c12196b666d4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:51.147397 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1134bdb-1240-4948-8497-c12196b666d4 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:51.166137 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 312/607] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Sep 13 15:15:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:15:51.167238 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1134bdb-1240-4948-8497-c12196b666d4 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:51.177006 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49913ea4-aad3-4009-afdc-3daf413a0b5c None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:51.220663 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da7df13-c87e-47a1-9fea-d782622351c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:51.221486 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da7df13-c87e-47a1-9fea-d782622351c3 None admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:51.221924 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da7df13-c87e-47a1-9fea-d782622351c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:51.222296 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da7df13-c87e-47a1-9fea-d782622351c3 None admin] PATH_INFO: `/v3/projects/3d6e00339cfa47d2a6fa8724c587035f/users/97acd23097d54bf7805c3cef60626ce7/roles/470736c596a14fa5ac78200239aa1104` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:51.245087 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da7df13-c87e-47a1-9fea-d782622351c3 None admin] RBAC: Authorizing `identity:create_grant(project_id=3d6e00339cfa47d2a6fa8724c587035f, user_id=97acd23097d54bf7805c3cef60626ce7, role_id=470736c596a14fa5ac78200239aa1104)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:51.247235 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da7df13-c87e-47a1-9fea-d782622351c3 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:51.266346 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 296/608] 10.222.0.27 () {58 vars in 1439 bytes} [Tue Sep 13 15:15:51 2022] PUT /identity/v3/projects/3d6e00339cfa47d2a6fa8724c587035f/users/97acd23097d54bf7805c3cef60626ce7/roles/470736c596a14fa5ac78200239aa1104 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:15:51.270705 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da7df13-c87e-47a1-9fea-d782622351c3 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:51.286681 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:51.318741 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1134bdb-1240-4948-8497-c12196b666d4 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:51.351524 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:51.372794 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f98f3c-d94c-4748-8b78-326b5cde09c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:51.374957 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f98f3c-d94c-4748-8b78-326b5cde09c7 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:51.375533 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f98f3c-d94c-4748-8b78-326b5cde09c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:51.376087 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f98f3c-d94c-4748-8b78-326b5cde09c7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:51.393956 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f98f3c-d94c-4748-8b78-326b5cde09c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 15:15:51.401326 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-a3f98f3c-d94c-4748-8b78-326b5cde09c7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 15:15:51.401326 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:15:51.401326 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:15:51.401326 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:15:51.401326 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:15:51.401326 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:15:51.401326 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:15:51.401326 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:15:51.401326 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:15:51.401326 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:15:51.401326 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:15:51.401326 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:15:51.401326 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 15:15:51.401326 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 15:15:51.401326 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 15:15:51.401326 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 15:15:51.402453 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 15:15:51.402453 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 15:15:51.402453 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 15:15:51.402453 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 15:15:51.402453 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:15:51.402453 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:15:51.402453 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:15:51.402453 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:15:51.402453 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:15:51.402453 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:15:51.402453 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:15:51.402453 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Sep 13 15:15:51.402453 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:15:51.402453 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:15:51.402453 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:15:51.402453 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:15:51.403345 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:15:51.403345 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:15:51.403345 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:15:51.403345 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:15:51.403345 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 15:15:51.403345 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 15:15:51.403345 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 15:15:51.403345 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 15:15:51.403345 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 15:15:51.403345 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 15:15:51.403345 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 15:15:51.403345 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Sep 13 15:15:51.406435 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 313/609] 10.222.0.27 () {56 vars in 1102 bytes} [Tue Sep 13 15:15:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:15:51.413795 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f98f3c-d94c-4748-8b78-326b5cde09c7 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:51.436999 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da7df13-c87e-47a1-9fea-d782622351c3 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:51.476473 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b1804f-869c-4cb1-af66-76868d0f3df2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:51.477148 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b1804f-869c-4cb1-af66-76868d0f3df2 None admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:51.477535 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b1804f-869c-4cb1-af66-76868d0f3df2 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:51.477872 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b1804f-869c-4cb1-af66-76868d0f3df2 None admin] PATH_INFO: `/v3/projects/3d6e00339cfa47d2a6fa8724c587035f/users/41675154bbba47388040966f75d84c3c/roles/470736c596a14fa5ac78200239aa1104` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:51.503645 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b1804f-869c-4cb1-af66-76868d0f3df2 None admin] RBAC: Authorizing `identity:create_grant(project_id=3d6e00339cfa47d2a6fa8724c587035f, user_id=41675154bbba47388040966f75d84c3c, role_id=470736c596a14fa5ac78200239aa1104)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:51.505122 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b1804f-869c-4cb1-af66-76868d0f3df2 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:51.534874 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 297/610] 10.222.0.27 () {58 vars in 1439 bytes} [Tue Sep 13 15:15:51 2022] PUT /identity/v3/projects/3d6e00339cfa47d2a6fa8724c587035f/users/41675154bbba47388040966f75d84c3c/roles/470736c596a14fa5ac78200239aa1104 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:15:51.536183 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1dc42f-6ffc-4122-8887-ae77e4a82d4f None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:51.536478 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1dc42f-6ffc-4122-8887-ae77e4a82d4f None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:51.536756 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1dc42f-6ffc-4122-8887-ae77e4a82d4f None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:51.538433 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 298/611] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:15:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:15:51.550425 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5949ecf9-3bce-44cd-8bce-201ef83e9b3d None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:51.550782 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5949ecf9-3bce-44cd-8bce-201ef83e9b3d None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:51.550984 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5949ecf9-3bce-44cd-8bce-201ef83e9b3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:51.581438 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-5949ecf9-3bce-44cd-8bce-201ef83e9b3d None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:15:51.582722 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-5949ecf9-3bce-44cd-8bce-201ef83e9b3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:15:51.586523 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f98f3c-d94c-4748-8b78-326b5cde09c7 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:51.635913 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff29c460-e642-4846-aa48-ce9c2613530f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:51.636638 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff29c460-e642-4846-aa48-ce9c2613530f None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:51.636920 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff29c460-e642-4846-aa48-ce9c2613530f None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:51.637191 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff29c460-e642-4846-aa48-ce9c2613530f None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:51.637893 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff29c460-e642-4846-aa48-ce9c2613530f None admin] RBAC: Adding query filter params (name=service) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:15:51.638199 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff29c460-e642-4846-aa48-ce9c2613530f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:51.639661 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff29c460-e642-4846-aa48-ce9c2613530f None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:51.645891 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:51.652504 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 314/612] 10.222.0.27 () {56 vars in 1103 bytes} [Tue Sep 13 15:15:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:15:51.660759 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff29c460-e642-4846-aa48-ce9c2613530f None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:51.686936 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 299/613] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:15:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 15:15:51.781416 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff29c460-e642-4846-aa48-ce9c2613530f None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:51.819522 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375164d4-8984-41c1-ab37-cc18bc19179d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:51.820473 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375164d4-8984-41c1-ab37-cc18bc19179d None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:51.820749 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375164d4-8984-41c1-ab37-cc18bc19179d None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:51.821016 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375164d4-8984-41c1-ab37-cc18bc19179d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:51.831779 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375164d4-8984-41c1-ab37-cc18bc19179d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:51.833305 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375164d4-8984-41c1-ab37-cc18bc19179d None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:51.849479 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-375164d4-8984-41c1-ab37-cc18bc19179d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 15:15:51.849479 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:15:51.849479 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:15:51.849479 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:15:51.849479 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:15:51.849479 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:15:51.849479 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:15:51.849479 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:15:51.849479 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:15:51.849479 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:15:51.849479 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:15:51.849479 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:15:51.849479 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 15:15:51.849479 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 15:15:51.849479 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 15:15:51.849479 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 15:15:51.851356 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:15:51.851356 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:15:51.851356 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:15:51.851356 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:15:51.851356 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:15:51.851356 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:15:51.851356 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:15:51.851356 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Sep 13 15:15:51.851356 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:15:51.851356 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:15:51.851356 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:15:51.851356 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:15:51.851356 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:15:51.851356 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:15:51.851356 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:15:51.851356 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:15:51.851356 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 15:15:51.852270 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 15:15:51.852270 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 15:15:51.852270 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Sep 13 15:15:51.852270 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 315/614] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 13 15:15:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:15:51.858406 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5949ecf9-3bce-44cd-8bce-201ef83e9b3d None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:51.908508 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:51.996010 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5949ecf9-3bce-44cd-8bce-201ef83e9b3d None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:52.031352 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375164d4-8984-41c1-ab37-cc18bc19179d None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:52.061114 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7603aec-a631-4203-ae8f-b7928d039498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:52.062126 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7603aec-a631-4203-ae8f-b7928d039498 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:52.062633 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7603aec-a631-4203-ae8f-b7928d039498 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:52.063104 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7603aec-a631-4203-ae8f-b7928d039498 None admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:52.064023 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7603aec-a631-4203-ae8f-b7928d039498 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:15:52.064522 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7603aec-a631-4203-ae8f-b7928d039498 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:52.066139 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7603aec-a631-4203-ae8f-b7928d039498 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:52.096281 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 300/615] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Sep 13 15:15:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 15:15:52.101732 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7603aec-a631-4203-ae8f-b7928d039498 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:52.123541 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:52.230258 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375164d4-8984-41c1-ab37-cc18bc19179d None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:52.311612 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0436a226-2691-4c0f-9bd7-ed0e49d0a04d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:52.312272 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0436a226-2691-4c0f-9bd7-ed0e49d0a04d None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:52.312557 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0436a226-2691-4c0f-9bd7-ed0e49d0a04d None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:52.312834 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0436a226-2691-4c0f-9bd7-ed0e49d0a04d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:52.316817 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7603aec-a631-4203-ae8f-b7928d039498 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:52.323221 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:52.339074 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0436a226-2691-4c0f-9bd7-ed0e49d0a04d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 15:15:52.350173 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-0436a226-2691-4c0f-9bd7-ed0e49d0a04d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 15:15:52.350173 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:15:52.350173 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:15:52.350173 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:15:52.350173 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:15:52.350173 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:15:52.350173 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:15:52.350173 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:15:52.350173 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:15:52.350173 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:15:52.350173 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:15:52.350173 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:15:52.350173 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 15:15:52.350173 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 15:15:52.350173 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 15:15:52.350173 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 15:15:52.351076 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 15:15:52.351076 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 15:15:52.351076 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 15:15:52.351076 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 15:15:52.351076 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:15:52.351076 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:15:52.351076 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:15:52.351076 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:15:52.351076 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:15:52.351076 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:15:52.351076 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:15:52.351076 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Sep 13 15:15:52.351076 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:15:52.351076 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:15:52.351076 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:15:52.351076 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:15:52.351922 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:15:52.351922 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:15:52.351922 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:15:52.351922 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:15:52.351922 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 15:15:52.351922 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 15:15:52.351922 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 15:15:52.351922 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 15:15:52.351922 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 15:15:52.351922 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 15:15:52.351922 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 15:15:52.351922 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Sep 13 15:15:52.355400 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 316/616] 10.222.0.27 () {56 vars in 1102 bytes} [Tue Sep 13 15:15:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 15:15:52.359328 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0436a226-2691-4c0f-9bd7-ed0e49d0a04d None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:52.392657 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ce5bb6-cdda-4c31-8182-b86c03590aa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:52.393305 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ce5bb6-cdda-4c31-8182-b86c03590aa9 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:52.393593 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ce5bb6-cdda-4c31-8182-b86c03590aa9 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:52.393894 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ce5bb6-cdda-4c31-8182-b86c03590aa9 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:52.411650 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ce5bb6-cdda-4c31-8182-b86c03590aa9 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:52.414034 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ce5bb6-cdda-4c31-8182-b86c03590aa9 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:52.439748 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-57ce5bb6-cdda-4c31-8182-b86c03590aa9 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 13 15:15:52.439748 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:15:52.439748 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:15:52.439748 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:15:52.439748 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:15:52.439748 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:15:52.439748 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:15:52.439748 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:15:52.439748 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:15:52.439748 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:15:52.439748 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:15:52.439748 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:15:52.439748 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 15:15:52.439748 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 15:15:52.439748 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 15:15:52.439748 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 15:15:52.440707 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:15:52.440707 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:15:52.440707 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 15:15:52.440707 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 15:15:52.440707 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 15:15:52.440707 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 15:15:52.440707 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:15:52.440707 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:15:52.440707 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:15:52.440707 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:15:52.440707 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:15:52.440707 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Sep 13 15:15:52.440707 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:15:52.440707 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:15:52.440707 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:15:52.440707 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:15:52.440707 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:15:52.440707 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:15:52.441654 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:15:52.441654 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:15:52.441654 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 15:15:52.441654 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 15:15:52.441654 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 15:15:52.441654 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 15:15:52.441654 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 15:15:52.441654 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 15:15:52.441654 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 13 15:15:52.441654 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Sep 13 15:15:52.441654 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 301/617] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Sep 13 15:15:52 2022] GET /identity/v3/users/swift => generated 83 bytes in 341 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 15:15:52.448103 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ce5bb6-cdda-4c31-8182-b86c03590aa9 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:52.559821 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ce5bb6-cdda-4c31-8182-b86c03590aa9 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:52.598657 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f576a36-5aea-46d7-9eac-ef2edbc0e6f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:52.599272 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f576a36-5aea-46d7-9eac-ef2edbc0e6f0 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:52.599587 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f576a36-5aea-46d7-9eac-ef2edbc0e6f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:52.599900 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f576a36-5aea-46d7-9eac-ef2edbc0e6f0 None admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:52.600660 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f576a36-5aea-46d7-9eac-ef2edbc0e6f0 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:15:52.600919 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f576a36-5aea-46d7-9eac-ef2edbc0e6f0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:52.603960 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0436a226-2691-4c0f-9bd7-ed0e49d0a04d None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:52.606282 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f576a36-5aea-46d7-9eac-ef2edbc0e6f0 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:52.633727 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:52.645727 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 302/618] 10.222.0.27 () {56 vars in 1135 bytes} [Tue Sep 13 15:15:52 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:15:52.652904 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f576a36-5aea-46d7-9eac-ef2edbc0e6f0 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:52.685733 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4028fd83-0fe6-4608-a777-72a9267adee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:52.685733 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4028fd83-0fe6-4608-a777-72a9267adee9 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:52.685733 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4028fd83-0fe6-4608-a777-72a9267adee9 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:52.685733 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4028fd83-0fe6-4608-a777-72a9267adee9 None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:52.686211 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4028fd83-0fe6-4608-a777-72a9267adee9 None admin] RBAC: Adding query filter params (name=service) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:15:52.686211 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4028fd83-0fe6-4608-a777-72a9267adee9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:52.686211 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4028fd83-0fe6-4608-a777-72a9267adee9 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:52.701354 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:52.708129 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 317/619] 10.222.0.27 () {56 vars in 1103 bytes} [Tue Sep 13 15:15:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:15:52.719122 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4028fd83-0fe6-4608-a777-72a9267adee9 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:52.909082 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f576a36-5aea-46d7-9eac-ef2edbc0e6f0 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:52.983657 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4028fd83-0fe6-4608-a777-72a9267adee9 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:52.987331 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77673ee1-5ac9-4913-b915-2e04dc45d524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:52.988054 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77673ee1-5ac9-4913-b915-2e04dc45d524 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:52.988409 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77673ee1-5ac9-4913-b915-2e04dc45d524 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:52.990299 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77673ee1-5ac9-4913-b915-2e04dc45d524 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:53.003261 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77673ee1-5ac9-4913-b915-2e04dc45d524 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:53.004952 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77673ee1-5ac9-4913-b915-2e04dc45d524 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:53.025076 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-77673ee1-5ac9-4913-b915-2e04dc45d524 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 15:15:53.025076 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:15:53.025076 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:15:53.025076 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:15:53.025076 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:15:53.025076 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:15:53.025076 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:15:53.025076 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:15:53.025076 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:15:53.025076 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:15:53.025076 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:15:53.025076 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:15:53.025076 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 15:15:53.025076 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 15:15:53.025076 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 15:15:53.025076 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 15:15:53.026096 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:15:53.026096 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:15:53.026096 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:15:53.026096 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:15:53.026096 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:15:53.026096 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:15:53.026096 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:15:53.026096 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Sep 13 15:15:53.026096 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:15:53.026096 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:15:53.026096 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:15:53.026096 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:15:53.026096 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:15:53.026096 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:15:53.026096 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:15:53.026096 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:15:53.026096 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 15:15:53.027015 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 15:15:53.027015 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 15:15:53.027015 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Sep 13 15:15:53.033092 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 303/620] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 13 15:15:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 374 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 15:15:53.034288 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77673ee1-5ac9-4913-b915-2e04dc45d524 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:53.094436 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6a60ae-4657-471e-abcf-adeac3069a99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:53.095092 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6a60ae-4657-471e-abcf-adeac3069a99 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:53.095517 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6a60ae-4657-471e-abcf-adeac3069a99 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:53.095799 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6a60ae-4657-471e-abcf-adeac3069a99 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:53.117364 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6a60ae-4657-471e-abcf-adeac3069a99 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:53.126950 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6a60ae-4657-471e-abcf-adeac3069a99 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:53.139012 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:53.159311 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-9c6a60ae-4657-471e-abcf-adeac3069a99 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 15:15:53.159311 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:15:53.159311 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:15:53.159311 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:15:53.159311 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:15:53.159311 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:15:53.159311 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:15:53.159311 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:15:53.159311 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:15:53.159311 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:15:53.159311 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:15:53.159311 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:15:53.159311 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 15:15:53.159311 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 15:15:53.159311 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 15:15:53.159311 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 15:15:53.160517 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:15:53.160517 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:15:53.160517 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:15:53.160517 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:15:53.160517 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:15:53.160517 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:15:53.160517 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:15:53.160517 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Sep 13 15:15:53.160517 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:15:53.160517 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:15:53.160517 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:15:53.160517 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:15:53.160517 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:15:53.160517 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:15:53.160517 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:15:53.160517 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:15:53.160517 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 15:15:53.161623 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 15:15:53.161623 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 15:15:53.161623 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Sep 13 15:15:53.165462 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 318/621] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 13 15:15:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 442 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 15:15:53.170626 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6a60ae-4657-471e-abcf-adeac3069a99 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:53.171795 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77673ee1-5ac9-4913-b915-2e04dc45d524 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:53.209995 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53159af5-5c6b-42ba-a076-efb6ca330a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:53.210860 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53159af5-5c6b-42ba-a076-efb6ca330a6a None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:53.211296 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53159af5-5c6b-42ba-a076-efb6ca330a6a None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:53.211752 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53159af5-5c6b-42ba-a076-efb6ca330a6a None admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:53.212545 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53159af5-5c6b-42ba-a076-efb6ca330a6a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:15:53.213002 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53159af5-5c6b-42ba-a076-efb6ca330a6a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:53.214554 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53159af5-5c6b-42ba-a076-efb6ca330a6a None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:53.219863 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:53.229319 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 304/622] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Sep 13 15:15:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:15:53.235989 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53159af5-5c6b-42ba-a076-efb6ca330a6a None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:53.344938 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53159af5-5c6b-42ba-a076-efb6ca330a6a None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:53.369020 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6a60ae-4657-471e-abcf-adeac3069a99 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:53.385339 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c36eeb2-eefc-4ca3-b7aa-9a0667eaa8fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:53.386384 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c36eeb2-eefc-4ca3-b7aa-9a0667eaa8fd None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:53.386877 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c36eeb2-eefc-4ca3-b7aa-9a0667eaa8fd None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:53.387375 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c36eeb2-eefc-4ca3-b7aa-9a0667eaa8fd None admin] PATH_INFO: `/v3/projects/service` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:53.389662 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:53.396948 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c36eeb2-eefc-4ca3-b7aa-9a0667eaa8fd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:53.399855 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c36eeb2-eefc-4ca3-b7aa-9a0667eaa8fd None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:53.412861 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-7c36eeb2-eefc-4ca3-b7aa-9a0667eaa8fd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 15:15:53.412861 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:15:53.412861 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:15:53.412861 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:15:53.412861 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:15:53.412861 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:15:53.412861 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:15:53.412861 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:15:53.412861 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:15:53.412861 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:15:53.412861 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:15:53.412861 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:15:53.412861 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 15:15:53.412861 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 15:15:53.412861 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 15:15:53.414087 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 15:15:53.414087 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:15:53.414087 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:15:53.414087 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:15:53.414087 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:15:53.414087 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:15:53.414087 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:15:53.414087 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:15:53.414087 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Sep 13 15:15:53.414087 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:15:53.414087 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:15:53.414087 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:15:53.414087 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:15:53.414087 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:15:53.414087 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:15:53.414087 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:15:53.414087 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:15:53.414994 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 15:15:53.414994 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 15:15:53.414994 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 15:15:53.414994 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 15:15:53.414994 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 15:15:53.414994 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 15:15:53.414994 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 15:15:53.414994 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Sep 13 15:15:53.417259 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 305/623] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Sep 13 15:15:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:15:53.423196 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c36eeb2-eefc-4ca3-b7aa-9a0667eaa8fd None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:53.454985 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd8cadc-ac95-4979-94b7-0281cbcb0740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:53.455609 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd8cadc-ac95-4979-94b7-0281cbcb0740 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:53.455894 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd8cadc-ac95-4979-94b7-0281cbcb0740 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:53.456168 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd8cadc-ac95-4979-94b7-0281cbcb0740 None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:53.456818 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd8cadc-ac95-4979-94b7-0281cbcb0740 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:15:53.457123 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd8cadc-ac95-4979-94b7-0281cbcb0740 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:53.462521 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd8cadc-ac95-4979-94b7-0281cbcb0740 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:53.483873 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 319/624] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Sep 13 15:15:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:15:53.489173 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd8cadc-ac95-4979-94b7-0281cbcb0740 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:53.600019 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c36eeb2-eefc-4ca3-b7aa-9a0667eaa8fd None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:53.637477 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:53.663671 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd8cadc-ac95-4979-94b7-0281cbcb0740 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:53.666246 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aef726e-519a-47db-bde7-300aeaf8cac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:53.666861 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aef726e-519a-47db-bde7-300aeaf8cac6 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:53.667146 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aef726e-519a-47db-bde7-300aeaf8cac6 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:53.667418 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aef726e-519a-47db-bde7-300aeaf8cac6 None admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:53.668117 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aef726e-519a-47db-bde7-300aeaf8cac6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:15:53.668428 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aef726e-519a-47db-bde7-300aeaf8cac6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:53.669878 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aef726e-519a-47db-bde7-300aeaf8cac6 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:53.698284 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 306/625] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Sep 13 15:15:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 15:15:53.703614 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aef726e-519a-47db-bde7-300aeaf8cac6 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:53.766537 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e068b333-1d0e-4ecd-aa24-fa40e6b549ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:53.767718 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e068b333-1d0e-4ecd-aa24-fa40e6b549ca None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:53.767718 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e068b333-1d0e-4ecd-aa24-fa40e6b549ca None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:53.767718 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e068b333-1d0e-4ecd-aa24-fa40e6b549ca None admin] PATH_INFO: `/v3/users/nova` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:53.785770 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:53.786607 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e068b333-1d0e-4ecd-aa24-fa40e6b549ca None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:53.789044 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e068b333-1d0e-4ecd-aa24-fa40e6b549ca None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:53.827003 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-e068b333-1d0e-4ecd-aa24-fa40e6b549ca None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 13 15:15:53.827003 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:15:53.827003 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:15:53.827003 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:15:53.827003 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:15:53.827003 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:15:53.827003 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:15:53.827003 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:15:53.827003 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:15:53.827003 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:15:53.827003 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:15:53.827003 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:15:53.827003 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 15:15:53.827003 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 15:15:53.827003 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 15:15:53.827003 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 15:15:53.828250 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:15:53.828250 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:15:53.828250 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 15:15:53.828250 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 15:15:53.828250 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 15:15:53.828250 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 15:15:53.828250 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:15:53.828250 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:15:53.828250 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:15:53.828250 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:15:53.828250 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:15:53.828250 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Sep 13 15:15:53.828250 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:15:53.828250 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:15:53.828250 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:15:53.828250 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:15:53.828250 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:15:53.828250 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:15:53.829576 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:15:53.829576 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:15:53.829576 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 15:15:53.829576 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 15:15:53.829576 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 15:15:53.829576 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 15:15:53.829576 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 15:15:53.829576 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 15:15:53.829576 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 13 15:15:53.829576 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Sep 13 15:15:53.829576 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 320/626] 10.222.0.27 () {56 vars in 1093 bytes} [Tue Sep 13 15:15:53 2022] GET /identity/v3/users/nova => generated 82 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 15:15:53.834385 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aef726e-519a-47db-bde7-300aeaf8cac6 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:53.838675 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e068b333-1d0e-4ecd-aa24-fa40e6b549ca None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:53.875296 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0539e0d-2999-499f-abc1-9a50cdff59f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:53.876145 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0539e0d-2999-499f-abc1-9a50cdff59f5 None admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:53.876431 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0539e0d-2999-499f-abc1-9a50cdff59f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:53.876708 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0539e0d-2999-499f-abc1-9a50cdff59f5 None admin] PATH_INFO: `/v3/projects/3d6e00339cfa47d2a6fa8724c587035f/users/dc735644be394e0abe73e709373e2003/roles/470736c596a14fa5ac78200239aa1104` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:53.896490 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0539e0d-2999-499f-abc1-9a50cdff59f5 None admin] RBAC: Authorizing `identity:create_grant(project_id=3d6e00339cfa47d2a6fa8724c587035f, user_id=dc735644be394e0abe73e709373e2003, role_id=470736c596a14fa5ac78200239aa1104)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:53.898725 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0539e0d-2999-499f-abc1-9a50cdff59f5 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:53.918710 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 307/627] 10.222.0.27 () {58 vars in 1439 bytes} [Tue Sep 13 15:15:53 2022] PUT /identity/v3/projects/3d6e00339cfa47d2a6fa8724c587035f/users/dc735644be394e0abe73e709373e2003/roles/470736c596a14fa5ac78200239aa1104 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:15:53.920465 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0390564-2fae-44d7-8b9c-59ecdbcb1cf0 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:53.920756 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0390564-2fae-44d7-8b9c-59ecdbcb1cf0 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:53.921083 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0390564-2fae-44d7-8b9c-59ecdbcb1cf0 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:53.926754 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 308/628] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:15:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:15:53.926754 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6b4967-414d-4396-8ed9-b969f007949e None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:53.926754 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6b4967-414d-4396-8ed9-b969f007949e None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:53.926754 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6b4967-414d-4396-8ed9-b969f007949e None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:53.927722 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 309/629] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:15:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:15:53.929587 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974fc8d3-7971-45d7-aa4b-5cb5bfa99e6f None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:53.929897 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974fc8d3-7971-45d7-aa4b-5cb5bfa99e6f None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:53.930240 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974fc8d3-7971-45d7-aa4b-5cb5bfa99e6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:53.957191 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-974fc8d3-7971-45d7-aa4b-5cb5bfa99e6f None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:15:53.959890 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-974fc8d3-7971-45d7-aa4b-5cb5bfa99e6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:15:53.978077 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e068b333-1d0e-4ecd-aa24-fa40e6b549ca None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:54.019372 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d0babe-18b9-4571-b222-bbca530f0e66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:54.020102 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d0babe-18b9-4571-b222-bbca530f0e66 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:54.020450 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d0babe-18b9-4571-b222-bbca530f0e66 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:54.020887 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d0babe-18b9-4571-b222-bbca530f0e66 None admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:54.022701 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d0babe-18b9-4571-b222-bbca530f0e66 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:15:54.023240 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d0babe-18b9-4571-b222-bbca530f0e66 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:54.024881 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d0babe-18b9-4571-b222-bbca530f0e66 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:54.050230 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 321/630] 10.222.0.27 () {56 vars in 1133 bytes} [Tue Sep 13 15:15:53 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:15:54.051884 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fa64a1-0b39-4b4f-8471-6f700fb4e20a None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:54.052249 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fa64a1-0b39-4b4f-8471-6f700fb4e20a None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:54.052759 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fa64a1-0b39-4b4f-8471-6f700fb4e20a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:54.053678 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 310/631] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:15:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 15:15:54.057856 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974fc8d3-7971-45d7-aa4b-5cb5bfa99e6f None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:54.062445 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:54.087634 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-29fa64a1-0b39-4b4f-8471-6f700fb4e20a None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:15:54.088866 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-29fa64a1-0b39-4b4f-8471-6f700fb4e20a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:15:54.116405 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:54.204422 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974fc8d3-7971-45d7-aa4b-5cb5bfa99e6f None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:54.204605 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 322/632] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:15:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 15:15:54.244619 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17b9fe0-25f8-4c2a-8752-99ecab156c3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:54.245233 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17b9fe0-25f8-4c2a-8752-99ecab156c3c None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:54.245517 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17b9fe0-25f8-4c2a-8752-99ecab156c3c None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:54.245837 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17b9fe0-25f8-4c2a-8752-99ecab156c3c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:54.340443 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17b9fe0-25f8-4c2a-8752-99ecab156c3c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:54.341918 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17b9fe0-25f8-4c2a-8752-99ecab156c3c None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:54.396163 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:54.415907 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0527b8ac-9a5d-4133-a78b-80ed90132fdc None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:54.416228 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0527b8ac-9a5d-4133-a78b-80ed90132fdc None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:54.416459 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0527b8ac-9a5d-4133-a78b-80ed90132fdc None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:54.419244 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 323/633] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:15:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:15:54.423242 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8209fa0e-5b88-4955-95b4-d4fdef48c0b5 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:54.423529 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8209fa0e-5b88-4955-95b4-d4fdef48c0b5 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:54.423808 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8209fa0e-5b88-4955-95b4-d4fdef48c0b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:54.450719 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-8209fa0e-5b88-4955-95b4-d4fdef48c0b5 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:15:54.451911 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-8209fa0e-5b88-4955-95b4-d4fdef48c0b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:15:54.492899 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 311/634] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Sep 13 15:15:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 15:15:54.498484 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17b9fe0-25f8-4c2a-8752-99ecab156c3c None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:54.530712 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 324/635] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:15:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 15:15:54.531555 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8209fa0e-5b88-4955-95b4-d4fdef48c0b5 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:54.611643 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:54.614187 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17b9fe0-25f8-4c2a-8752-99ecab156c3c None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:54.651739 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8209fa0e-5b88-4955-95b4-d4fdef48c0b5 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:54.652080 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c134a54b-e789-4e75-acad-25e61697e85b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:54.652650 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c134a54b-e789-4e75-acad-25e61697e85b None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:54.652929 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c134a54b-e789-4e75-acad-25e61697e85b None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:54.653200 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c134a54b-e789-4e75-acad-25e61697e85b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:54.664879 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c134a54b-e789-4e75-acad-25e61697e85b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 15:15:54.670025 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-c134a54b-e789-4e75-acad-25e61697e85b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 15:15:54.670025 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:15:54.670025 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:15:54.670025 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:15:54.670025 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:15:54.670025 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:15:54.670025 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:15:54.670025 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:15:54.670025 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:15:54.670025 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:15:54.670025 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:15:54.670025 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:15:54.670025 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 15:15:54.670025 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 15:15:54.670025 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 15:15:54.670025 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 15:15:54.670955 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 15:15:54.670955 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 15:15:54.670955 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 15:15:54.670955 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 15:15:54.670955 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:15:54.670955 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:15:54.670955 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:15:54.670955 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:15:54.670955 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:15:54.670955 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:15:54.670955 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:15:54.670955 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Sep 13 15:15:54.670955 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:15:54.670955 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:15:54.670955 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:15:54.670955 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:15:54.671802 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:15:54.671802 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:15:54.671802 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:15:54.671802 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:15:54.671802 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 15:15:54.671802 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 15:15:54.671802 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 15:15:54.671802 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 15:15:54.671802 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 15:15:54.671802 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 15:15:54.671802 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 15:15:54.671802 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Sep 13 15:15:54.671802 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 312/636] 10.222.0.27 () {56 vars in 1102 bytes} [Tue Sep 13 15:15:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:15:54.672523 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c134a54b-e789-4e75-acad-25e61697e85b None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:54.673978 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:54.695321 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9dbd4f-022c-4a89-a917-0e28118fd476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:54.695961 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9dbd4f-022c-4a89-a917-0e28118fd476 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:54.696257 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9dbd4f-022c-4a89-a917-0e28118fd476 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:54.696538 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9dbd4f-022c-4a89-a917-0e28118fd476 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:54.711650 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9dbd4f-022c-4a89-a917-0e28118fd476 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:54.713236 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9dbd4f-022c-4a89-a917-0e28118fd476 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:54.732649 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-7f9dbd4f-022c-4a89-a917-0e28118fd476 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 15:15:54.732649 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:15:54.732649 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:15:54.732649 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:15:54.732649 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:15:54.732649 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:15:54.732649 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:15:54.732649 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:15:54.732649 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:15:54.732649 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:15:54.732649 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:15:54.732649 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:15:54.732649 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 15:15:54.732649 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 15:15:54.732649 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 15:15:54.732649 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 15:15:54.733637 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:15:54.733637 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:15:54.733637 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:15:54.733637 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:15:54.733637 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:15:54.733637 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:15:54.733637 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:15:54.733637 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Sep 13 15:15:54.733637 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:15:54.733637 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:15:54.733637 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:15:54.733637 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:15:54.733637 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:15:54.733637 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:15:54.733637 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:15:54.733637 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:15:54.733637 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 15:15:54.734565 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 15:15:54.734565 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 15:15:54.734565 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Sep 13 15:15:54.734565 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 325/637] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 13 15:15:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:15:54.735312 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9dbd4f-022c-4a89-a917-0e28118fd476 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:54.814548 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c134a54b-e789-4e75-acad-25e61697e85b None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:54.859407 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bdd864-8f8b-4613-8213-7f06e23a0d60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:54.860045 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bdd864-8f8b-4613-8213-7f06e23a0d60 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:54.860344 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bdd864-8f8b-4613-8213-7f06e23a0d60 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:54.860669 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bdd864-8f8b-4613-8213-7f06e23a0d60 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:54.863997 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9dbd4f-022c-4a89-a917-0e28118fd476 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:54.871547 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bdd864-8f8b-4613-8213-7f06e23a0d60 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 15:15:54.876276 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-40bdd864-8f8b-4613-8213-7f06e23a0d60 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 15:15:54.876276 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:15:54.876276 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:15:54.876276 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:15:54.876276 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:15:54.876276 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:15:54.876276 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:15:54.876276 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:15:54.876276 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:15:54.876276 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:15:54.876276 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:15:54.876276 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:15:54.876276 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 15:15:54.876276 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 15:15:54.876276 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 15:15:54.876276 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 15:15:54.877234 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 15:15:54.877234 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 15:15:54.877234 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 15:15:54.877234 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 15:15:54.877234 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:15:54.877234 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:15:54.877234 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:15:54.877234 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:15:54.877234 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:15:54.877234 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:15:54.877234 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:15:54.877234 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Sep 13 15:15:54.877234 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:15:54.877234 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:15:54.877234 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:15:54.877234 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:15:54.882860 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:15:54.882860 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:15:54.882860 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:15:54.882860 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:15:54.882860 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 15:15:54.882860 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 15:15:54.882860 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 15:15:54.882860 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 15:15:54.882860 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 15:15:54.882860 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 15:15:54.882860 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 15:15:54.882860 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Sep 13 15:15:54.882860 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 313/638] 10.222.0.27 () {56 vars in 1102 bytes} [Tue Sep 13 15:15:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:15:54.882860 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bdd864-8f8b-4613-8213-7f06e23a0d60 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:54.883655 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:54.903181 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397edfa7-9f76-43fe-aaab-4ad2046f5cdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:54.903789 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397edfa7-9f76-43fe-aaab-4ad2046f5cdd None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:54.904077 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397edfa7-9f76-43fe-aaab-4ad2046f5cdd None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:54.904353 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397edfa7-9f76-43fe-aaab-4ad2046f5cdd None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:54.905007 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397edfa7-9f76-43fe-aaab-4ad2046f5cdd None admin] RBAC: Adding query filter params (name=service) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:15:54.905317 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397edfa7-9f76-43fe-aaab-4ad2046f5cdd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:54.906728 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397edfa7-9f76-43fe-aaab-4ad2046f5cdd None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:54.915967 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 326/639] 10.222.0.27 () {56 vars in 1103 bytes} [Tue Sep 13 15:15:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:15:54.916996 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397edfa7-9f76-43fe-aaab-4ad2046f5cdd None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:54.947864 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:55.006970 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bdd864-8f8b-4613-8213-7f06e23a0d60 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:55.025476 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397edfa7-9f76-43fe-aaab-4ad2046f5cdd None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:55.046101 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187cf8da-f968-4c2c-aedb-26e9fc5e7866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:55.046711 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187cf8da-f968-4c2c-aedb-26e9fc5e7866 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:55.046996 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187cf8da-f968-4c2c-aedb-26e9fc5e7866 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:55.047272 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187cf8da-f968-4c2c-aedb-26e9fc5e7866 None admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:55.047918 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187cf8da-f968-4c2c-aedb-26e9fc5e7866 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:15:55.048223 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187cf8da-f968-4c2c-aedb-26e9fc5e7866 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:55.049605 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187cf8da-f968-4c2c-aedb-26e9fc5e7866 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:55.061073 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2412b178-0a1f-414b-abd8-f1e43e776814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:55.065938 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 314/640] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Sep 13 15:15:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:15:55.066063 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2412b178-0a1f-414b-abd8-f1e43e776814 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:55.066063 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2412b178-0a1f-414b-abd8-f1e43e776814 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:55.066224 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187cf8da-f968-4c2c-aedb-26e9fc5e7866 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:55.066322 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2412b178-0a1f-414b-abd8-f1e43e776814 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:55.077567 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2412b178-0a1f-414b-abd8-f1e43e776814 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 15:15:55.083440 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-2412b178-0a1f-414b-abd8-f1e43e776814 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 15:15:55.083440 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:15:55.083440 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:15:55.083440 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:15:55.083440 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:15:55.083440 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:15:55.083440 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:15:55.083440 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:15:55.083440 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:15:55.083440 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:15:55.083440 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:15:55.083440 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:15:55.083440 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 15:15:55.083440 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 15:15:55.083440 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 15:15:55.083440 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 15:15:55.084892 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 15:15:55.084892 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 15:15:55.084892 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 15:15:55.084892 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 15:15:55.084892 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:15:55.084892 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:15:55.084892 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:15:55.084892 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:15:55.084892 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:15:55.084892 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:15:55.084892 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:15:55.084892 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Sep 13 15:15:55.084892 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:15:55.084892 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:15:55.084892 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:15:55.084892 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:15:55.085763 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:15:55.085763 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:15:55.085763 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:15:55.085763 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:15:55.085763 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 15:15:55.085763 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 15:15:55.085763 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 15:15:55.085763 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 15:15:55.085763 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 15:15:55.085763 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 15:15:55.085763 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 15:15:55.085763 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Sep 13 15:15:55.085763 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 327/641] 10.222.0.27 () {56 vars in 1102 bytes} [Tue Sep 13 15:15:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:15:55.087022 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2412b178-0a1f-414b-abd8-f1e43e776814 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:55.127736 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:55.172276 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187cf8da-f968-4c2c-aedb-26e9fc5e7866 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:55.186545 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:55.196876 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2412b178-0a1f-414b-abd8-f1e43e776814 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:55.210515 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ac146a-da74-4656-ae76-9cec13a5a873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:55.211135 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ac146a-da74-4656-ae76-9cec13a5a873 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:55.211419 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ac146a-da74-4656-ae76-9cec13a5a873 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:55.211699 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ac146a-da74-4656-ae76-9cec13a5a873 None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:55.212369 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ac146a-da74-4656-ae76-9cec13a5a873 None admin] RBAC: Adding query filter params (name=service) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:15:55.212678 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ac146a-da74-4656-ae76-9cec13a5a873 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:55.214118 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ac146a-da74-4656-ae76-9cec13a5a873 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:55.222417 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 315/642] 10.222.0.27 () {56 vars in 1103 bytes} [Tue Sep 13 15:15:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:15:55.223266 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ac146a-da74-4656-ae76-9cec13a5a873 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:55.237482 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fe46db-4593-4914-9d37-5bd60a69c863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:55.238152 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fe46db-4593-4914-9d37-5bd60a69c863 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:55.238439 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fe46db-4593-4914-9d37-5bd60a69c863 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:55.238718 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fe46db-4593-4914-9d37-5bd60a69c863 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:55.250364 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fe46db-4593-4914-9d37-5bd60a69c863 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:55.251839 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fe46db-4593-4914-9d37-5bd60a69c863 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:55.268432 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-15fe46db-4593-4914-9d37-5bd60a69c863 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 15:15:55.268432 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:15:55.268432 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:15:55.268432 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:15:55.268432 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:15:55.268432 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:15:55.268432 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:15:55.268432 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:15:55.268432 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:15:55.268432 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:15:55.268432 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:15:55.268432 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:15:55.268432 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 15:15:55.268432 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 15:15:55.268432 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 15:15:55.268432 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 15:15:55.269486 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:15:55.269486 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:15:55.269486 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:15:55.269486 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:15:55.269486 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:15:55.269486 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:15:55.269486 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:15:55.269486 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Sep 13 15:15:55.269486 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:15:55.269486 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:15:55.269486 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:15:55.269486 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:15:55.269486 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:15:55.269486 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:15:55.269486 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:15:55.269486 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:15:55.269486 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 15:15:55.270417 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 15:15:55.270417 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 15:15:55.270417 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Sep 13 15:15:55.270911 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 328/643] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 13 15:15:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:15:55.272462 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fe46db-4593-4914-9d37-5bd60a69c863 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:55.345810 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ac146a-da74-4656-ae76-9cec13a5a873 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:55.367613 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:55.378336 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fe46db-4593-4914-9d37-5bd60a69c863 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:55.387347 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f460be4f-903d-4a5c-a51a-bb72c66be28b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:55.388352 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f460be4f-903d-4a5c-a51a-bb72c66be28b None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:55.388644 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f460be4f-903d-4a5c-a51a-bb72c66be28b None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:55.388928 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f460be4f-903d-4a5c-a51a-bb72c66be28b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:55.397170 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f460be4f-903d-4a5c-a51a-bb72c66be28b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:55.398647 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f460be4f-903d-4a5c-a51a-bb72c66be28b None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:55.410129 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-f460be4f-903d-4a5c-a51a-bb72c66be28b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 15:15:55.410129 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:15:55.410129 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:15:55.410129 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:15:55.410129 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:15:55.410129 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:15:55.410129 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:15:55.410129 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:15:55.410129 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:15:55.410129 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:15:55.410129 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:15:55.410129 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:15:55.410129 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 15:15:55.410129 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 15:15:55.410129 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 15:15:55.411036 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 15:15:55.411036 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:15:55.411036 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:15:55.411036 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:15:55.411036 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:15:55.411036 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:15:55.411036 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:15:55.411036 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:15:55.411036 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Sep 13 15:15:55.411036 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:15:55.411036 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:15:55.411036 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:15:55.411036 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:15:55.411036 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:15:55.411036 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:15:55.411036 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:15:55.411036 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:15:55.412133 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 15:15:55.412133 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 15:15:55.412133 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 15:15:55.412133 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 15:15:55.412133 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 15:15:55.412133 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 15:15:55.412133 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 15:15:55.412133 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Sep 13 15:15:55.412133 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 316/644] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Sep 13 15:15:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:15:55.412133 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f460be4f-903d-4a5c-a51a-bb72c66be28b None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:55.418563 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6255839-0d12-4f1d-a9ff-d33db9e0a02d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:55.419173 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6255839-0d12-4f1d-a9ff-d33db9e0a02d None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:55.419449 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6255839-0d12-4f1d-a9ff-d33db9e0a02d None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:55.419720 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6255839-0d12-4f1d-a9ff-d33db9e0a02d None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:55.420381 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6255839-0d12-4f1d-a9ff-d33db9e0a02d None admin] RBAC: Adding query filter params (name=service) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:15:55.420683 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6255839-0d12-4f1d-a9ff-d33db9e0a02d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:55.422088 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6255839-0d12-4f1d-a9ff-d33db9e0a02d None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:55.436322 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 329/645] 10.222.0.27 () {56 vars in 1103 bytes} [Tue Sep 13 15:15:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:15:55.436322 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6255839-0d12-4f1d-a9ff-d33db9e0a02d None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:55.455860 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:55.527485 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f460be4f-903d-4a5c-a51a-bb72c66be28b None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:55.536489 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6255839-0d12-4f1d-a9ff-d33db9e0a02d None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:55.562488 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e290c2-6ae3-4bbf-997e-7b94ad4a9857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:55.563111 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e290c2-6ae3-4bbf-997e-7b94ad4a9857 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:55.563393 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e290c2-6ae3-4bbf-997e-7b94ad4a9857 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:55.563668 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e290c2-6ae3-4bbf-997e-7b94ad4a9857 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:55.570819 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caabbeb-8be0-431a-9014-97311ddf03be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:55.571426 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caabbeb-8be0-431a-9014-97311ddf03be None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:55.571705 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caabbeb-8be0-431a-9014-97311ddf03be None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:55.571974 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caabbeb-8be0-431a-9014-97311ddf03be None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:55.572604 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caabbeb-8be0-431a-9014-97311ddf03be None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:15:55.572907 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caabbeb-8be0-431a-9014-97311ddf03be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:55.574320 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caabbeb-8be0-431a-9014-97311ddf03be None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:55.575453 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e290c2-6ae3-4bbf-997e-7b94ad4a9857 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:55.576885 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e290c2-6ae3-4bbf-997e-7b94ad4a9857 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:55.591311 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 330/646] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Sep 13 15:15:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:15:55.591311 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caabbeb-8be0-431a-9014-97311ddf03be None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:55.597387 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-89e290c2-6ae3-4bbf-997e-7b94ad4a9857 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 15:15:55.597387 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:15:55.597387 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:15:55.597387 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:15:55.597387 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:15:55.597387 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:15:55.597387 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:15:55.597387 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:15:55.597387 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:15:55.597387 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:15:55.597387 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:15:55.597387 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:15:55.597387 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 15:15:55.597387 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 15:15:55.597387 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 15:15:55.597387 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 15:15:55.598528 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:15:55.598528 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:15:55.598528 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:15:55.598528 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:15:55.598528 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:15:55.598528 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:15:55.598528 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:15:55.598528 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Sep 13 15:15:55.598528 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:15:55.598528 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:15:55.598528 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:15:55.598528 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:15:55.598528 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:15:55.598528 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:15:55.598528 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:15:55.598528 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:15:55.598528 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 15:15:55.600089 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 15:15:55.600089 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 15:15:55.600089 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Sep 13 15:15:55.600089 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 317/647] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 13 15:15:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:15:55.600089 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e290c2-6ae3-4bbf-997e-7b94ad4a9857 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:55.609808 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:55.695656 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:55.698588 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caabbeb-8be0-431a-9014-97311ddf03be None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:55.711416 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e290c2-6ae3-4bbf-997e-7b94ad4a9857 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:55.735425 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db307549-1bd1-48ff-ad7e-759e5a8533a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:55.736041 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db307549-1bd1-48ff-ad7e-759e5a8533a2 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:55.736327 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db307549-1bd1-48ff-ad7e-759e5a8533a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:55.736606 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db307549-1bd1-48ff-ad7e-759e5a8533a2 None admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:55.737300 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db307549-1bd1-48ff-ad7e-759e5a8533a2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:15:55.737892 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db307549-1bd1-48ff-ad7e-759e5a8533a2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:55.739079 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db307549-1bd1-48ff-ad7e-759e5a8533a2 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:55.756369 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 331/648] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Sep 13 15:15:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:15:55.756369 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db307549-1bd1-48ff-ad7e-759e5a8533a2 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:55.758962 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92993cd1-0854-490a-b793-ac827cad4693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:55.759761 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92993cd1-0854-490a-b793-ac827cad4693 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:55.760889 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92993cd1-0854-490a-b793-ac827cad4693 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:55.761173 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92993cd1-0854-490a-b793-ac827cad4693 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:55.774093 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92993cd1-0854-490a-b793-ac827cad4693 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:55.775534 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92993cd1-0854-490a-b793-ac827cad4693 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:55.790794 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-92993cd1-0854-490a-b793-ac827cad4693 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 15:15:55.790794 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:15:55.790794 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:15:55.790794 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:15:55.790794 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:15:55.790794 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:15:55.790794 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:15:55.790794 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:15:55.790794 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:15:55.790794 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:15:55.790794 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:15:55.790794 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:15:55.790794 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 15:15:55.790794 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 15:15:55.790794 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 15:15:55.790794 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 15:15:55.791765 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:15:55.791765 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:15:55.791765 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:15:55.791765 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:15:55.791765 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:15:55.791765 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:15:55.791765 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:15:55.791765 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Sep 13 15:15:55.791765 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:15:55.791765 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:15:55.791765 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:15:55.791765 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:15:55.791765 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:15:55.791765 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:15:55.791765 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:15:55.791765 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:15:55.791765 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 15:15:55.793220 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 15:15:55.793220 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 15:15:55.793220 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Sep 13 15:15:55.793220 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 318/649] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 13 15:15:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:15:55.793220 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92993cd1-0854-490a-b793-ac827cad4693 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:55.835223 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:55.867181 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db307549-1bd1-48ff-ad7e-759e5a8533a2 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:55.904280 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92993cd1-0854-490a-b793-ac827cad4693 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:55.904963 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b97ee9-1176-4d21-88de-2deda7babf9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:55.905511 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b97ee9-1176-4d21-88de-2deda7babf9d None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:55.905924 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b97ee9-1176-4d21-88de-2deda7babf9d None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:55.906197 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b97ee9-1176-4d21-88de-2deda7babf9d None admin] PATH_INFO: `/v3/users/glance` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:55.914851 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b97ee9-1176-4d21-88de-2deda7babf9d None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:55.916288 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b97ee9-1176-4d21-88de-2deda7babf9d None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:55.929271 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-98b97ee9-1176-4d21-88de-2deda7babf9d None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 13 15:15:55.929271 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:15:55.929271 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:15:55.929271 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:15:55.929271 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:15:55.929271 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:15:55.929271 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:15:55.929271 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:15:55.929271 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:15:55.929271 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:15:55.929271 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:15:55.929271 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:15:55.929271 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 15:15:55.929271 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 15:15:55.929271 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 15:15:55.929271 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 15:15:55.930277 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:15:55.930277 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:15:55.930277 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 15:15:55.930277 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 15:15:55.930277 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 15:15:55.930277 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 15:15:55.930277 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:15:55.930277 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:15:55.930277 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:15:55.930277 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:15:55.930277 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:15:55.930277 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Sep 13 15:15:55.930277 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:15:55.930277 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:15:55.930277 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:15:55.930277 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:15:55.930277 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:15:55.930277 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:15:55.931216 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:15:55.931216 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:15:55.931216 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 15:15:55.931216 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 15:15:55.931216 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 15:15:55.931216 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 15:15:55.931216 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 15:15:55.931216 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 15:15:55.931216 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 13 15:15:55.931216 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Sep 13 15:15:55.931216 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 332/650] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Sep 13 15:15:55 2022] GET /identity/v3/users/glance => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:15:55.931814 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b97ee9-1176-4d21-88de-2deda7babf9d None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:55.943437 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d2e9e3-446f-4174-a31a-02a0605484f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:55.944050 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d2e9e3-446f-4174-a31a-02a0605484f3 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:55.944328 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d2e9e3-446f-4174-a31a-02a0605484f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:55.944868 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d2e9e3-446f-4174-a31a-02a0605484f3 None admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:55.945512 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d2e9e3-446f-4174-a31a-02a0605484f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:15:55.945848 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d2e9e3-446f-4174-a31a-02a0605484f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:55.947218 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d2e9e3-446f-4174-a31a-02a0605484f3 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:55.956297 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:55.965240 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 319/651] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Sep 13 15:15:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:15:55.966112 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d2e9e3-446f-4174-a31a-02a0605484f3 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:56.039814 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b97ee9-1176-4d21-88de-2deda7babf9d None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:56.071736 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:56.075503 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d2e9e3-446f-4174-a31a-02a0605484f3 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:56.077262 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fd6a5d-8cce-4b69-9371-8d81c2d515a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:56.077906 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fd6a5d-8cce-4b69-9371-8d81c2d515a4 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:56.078310 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fd6a5d-8cce-4b69-9371-8d81c2d515a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:56.078642 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fd6a5d-8cce-4b69-9371-8d81c2d515a4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:56.079679 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fd6a5d-8cce-4b69-9371-8d81c2d515a4 None admin] RBAC: Adding query filter params (role.id=470736c596a14fa5ac78200239aa1104, scope.project.id=3d6e00339cfa47d2a6fa8724c587035f, user.id=62aad71c6c1a4469805762bba330bf0e) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:15:56.079986 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fd6a5d-8cce-4b69-9371-8d81c2d515a4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:56.081427 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fd6a5d-8cce-4b69-9371-8d81c2d515a4 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:56.097727 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 333/652] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Sep 13 15:15:55 2022] GET /identity/v3/role_assignments?user.id=62aad71c6c1a4469805762bba330bf0e&scope.project.id=3d6e00339cfa47d2a6fa8724c587035f&role.id=470736c596a14fa5ac78200239aa1104 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:15:56.097727 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fd6a5d-8cce-4b69-9371-8d81c2d515a4 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:56.135053 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5f80ea-fc4f-42de-8e6e-0ebc495b040c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:56.135942 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5f80ea-fc4f-42de-8e6e-0ebc495b040c None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:56.136226 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5f80ea-fc4f-42de-8e6e-0ebc495b040c None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:56.136502 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5f80ea-fc4f-42de-8e6e-0ebc495b040c None admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:56.137380 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5f80ea-fc4f-42de-8e6e-0ebc495b040c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:15:56.137728 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5f80ea-fc4f-42de-8e6e-0ebc495b040c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:56.141095 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5f80ea-fc4f-42de-8e6e-0ebc495b040c None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:56.160408 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 320/653] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Sep 13 15:15:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:15:56.161335 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5f80ea-fc4f-42de-8e6e-0ebc495b040c None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:56.224131 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fd6a5d-8cce-4b69-9371-8d81c2d515a4 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:56.250995 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:56.263375 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b781c262-cf05-4671-9cfd-f8a77dac2701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:56.264068 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b781c262-cf05-4671-9cfd-f8a77dac2701 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:56.264285 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b781c262-cf05-4671-9cfd-f8a77dac2701 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:56.264568 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b781c262-cf05-4671-9cfd-f8a77dac2701 None admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:56.265312 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b781c262-cf05-4671-9cfd-f8a77dac2701 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:15:56.265687 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b781c262-cf05-4671-9cfd-f8a77dac2701 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:56.267223 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b781c262-cf05-4671-9cfd-f8a77dac2701 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:56.286229 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 334/654] 10.222.0.27 () {56 vars in 1137 bytes} [Tue Sep 13 15:15:56 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:15:56.291106 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b781c262-cf05-4671-9cfd-f8a77dac2701 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:56.307817 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5f80ea-fc4f-42de-8e6e-0ebc495b040c None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:56.349664 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ce6b9f-445f-4dd0-ba4b-a8da78793385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:56.350361 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ce6b9f-445f-4dd0-ba4b-a8da78793385 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:56.350655 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ce6b9f-445f-4dd0-ba4b-a8da78793385 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:56.351208 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ce6b9f-445f-4dd0-ba4b-a8da78793385 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:56.360102 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:56.360626 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ce6b9f-445f-4dd0-ba4b-a8da78793385 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:56.362334 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ce6b9f-445f-4dd0-ba4b-a8da78793385 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:56.376216 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-20ce6b9f-445f-4dd0-ba4b-a8da78793385 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 13 15:15:56.376216 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:15:56.376216 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:15:56.376216 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:15:56.376216 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:15:56.376216 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:15:56.376216 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:15:56.376216 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:15:56.376216 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:15:56.376216 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:15:56.376216 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:15:56.376216 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:15:56.376216 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 15:15:56.376216 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 15:15:56.376216 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 15:15:56.376216 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 15:15:56.377239 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:15:56.377239 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:15:56.377239 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 15:15:56.377239 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 15:15:56.377239 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 15:15:56.377239 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 15:15:56.377239 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:15:56.377239 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:15:56.377239 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:15:56.377239 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:15:56.377239 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:15:56.377239 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Sep 13 15:15:56.377239 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:15:56.377239 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:15:56.377239 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:15:56.377239 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:15:56.377239 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:15:56.377239 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:15:56.378306 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:15:56.378306 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:15:56.378306 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 15:15:56.378306 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 15:15:56.378306 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 15:15:56.378306 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 15:15:56.378306 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 15:15:56.378306 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 15:15:56.378306 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 13 15:15:56.378306 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Sep 13 15:15:56.378306 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 321/655] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Sep 13 15:15:56 2022] GET /identity/v3/users/cinder => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:15:56.378937 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfe9893-cbb3-491b-83da-758a1a104cd5 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:56.378937 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfe9893-cbb3-491b-83da-758a1a104cd5 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:56.379731 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfe9893-cbb3-491b-83da-758a1a104cd5 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:56.380606 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 322/656] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:15:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:15:56.381250 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfe9893-cbb3-491b-83da-758a1a104cd5 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:56.423384 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b781c262-cf05-4671-9cfd-f8a77dac2701 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:56.460434 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd06b9b-4290-4ee7-83c1-a7266b457ab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:56.461169 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd06b9b-4290-4ee7-83c1-a7266b457ab8 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:56.461516 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd06b9b-4290-4ee7-83c1-a7266b457ab8 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:56.461896 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd06b9b-4290-4ee7-83c1-a7266b457ab8 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:56.469527 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd06b9b-4290-4ee7-83c1-a7266b457ab8 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:56.471173 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd06b9b-4290-4ee7-83c1-a7266b457ab8 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:56.484471 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-7cd06b9b-4290-4ee7-83c1-a7266b457ab8 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 13 15:15:56.484471 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:15:56.484471 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:15:56.484471 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:15:56.484471 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:15:56.484471 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:15:56.484471 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:15:56.484471 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:15:56.484471 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:15:56.484471 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:15:56.484471 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:15:56.484471 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:15:56.484471 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 15:15:56.484471 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 15:15:56.484471 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 15:15:56.484471 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 15:15:56.485656 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:15:56.485656 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:15:56.485656 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 15:15:56.485656 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 15:15:56.485656 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 15:15:56.485656 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 15:15:56.485656 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:15:56.485656 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:15:56.485656 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:15:56.485656 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:15:56.485656 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:15:56.485656 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Sep 13 15:15:56.485656 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:15:56.485656 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:15:56.485656 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:15:56.485656 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:15:56.485656 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:15:56.485656 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:15:56.486935 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:15:56.486935 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:15:56.486935 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 15:15:56.486935 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 15:15:56.486935 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 15:15:56.486935 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 15:15:56.486935 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 15:15:56.486935 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 15:15:56.486935 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 13 15:15:56.486935 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Sep 13 15:15:56.490404 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 335/657] 10.222.0.27 () {56 vars in 1102 bytes} [Tue Sep 13 15:15:56 2022] GET /identity/v3/users/neutron => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:15:56.491781 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d2fa4a-7a3f-4213-90ff-6099ef6f1198 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:56.492056 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d2fa4a-7a3f-4213-90ff-6099ef6f1198 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:56.492332 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d2fa4a-7a3f-4213-90ff-6099ef6f1198 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:56.494529 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfe9893-cbb3-491b-83da-758a1a104cd5 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:56.511372 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-c8d2fa4a-7a3f-4213-90ff-6099ef6f1198 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:15:56.512683 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-c8d2fa4a-7a3f-4213-90ff-6099ef6f1198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:15:56.514694 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:56.530164 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1e7f61-e1cf-45dc-8c13-cc25c9992321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:56.530776 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1e7f61-e1cf-45dc-8c13-cc25c9992321 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:56.531058 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1e7f61-e1cf-45dc-8c13-cc25c9992321 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:56.531330 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1e7f61-e1cf-45dc-8c13-cc25c9992321 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:56.593862 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 336/658] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:15:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 15:15:56.593862 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d2fa4a-7a3f-4213-90ff-6099ef6f1198 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:56.611548 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1e7f61-e1cf-45dc-8c13-cc25c9992321 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:56.613229 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1e7f61-e1cf-45dc-8c13-cc25c9992321 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:56.644979 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:56.732417 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d2fa4a-7a3f-4213-90ff-6099ef6f1198 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:56.733059 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 323/659] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Sep 13 15:15:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 15:15:56.734182 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1e7f61-e1cf-45dc-8c13-cc25c9992321 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:56.762221 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:56.777261 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda0d663-95e0-4cd7-8c63-dbee0718aa6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:56.778751 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda0d663-95e0-4cd7-8c63-dbee0718aa6f None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:56.779036 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda0d663-95e0-4cd7-8c63-dbee0718aa6f None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:56.779316 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda0d663-95e0-4cd7-8c63-dbee0718aa6f None admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:56.780053 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda0d663-95e0-4cd7-8c63-dbee0718aa6f None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:15:56.780363 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda0d663-95e0-4cd7-8c63-dbee0718aa6f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:56.781894 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda0d663-95e0-4cd7-8c63-dbee0718aa6f None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:56.804392 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 337/660] 10.222.0.27 () {56 vars in 1137 bytes} [Tue Sep 13 15:15:56 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:15:56.805485 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda0d663-95e0-4cd7-8c63-dbee0718aa6f None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:56.853459 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1e7f61-e1cf-45dc-8c13-cc25c9992321 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:56.896105 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f791ee4d-0cbd-492c-af32-626492a363c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:56.896900 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f791ee4d-0cbd-492c-af32-626492a363c6 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:56.897329 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f791ee4d-0cbd-492c-af32-626492a363c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:56.897604 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f791ee4d-0cbd-492c-af32-626492a363c6 None admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:56.898375 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f791ee4d-0cbd-492c-af32-626492a363c6 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:15:56.898683 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f791ee4d-0cbd-492c-af32-626492a363c6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:56.900108 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f791ee4d-0cbd-492c-af32-626492a363c6 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:56.918587 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 324/661] 10.222.0.27 () {56 vars in 1139 bytes} [Tue Sep 13 15:15:56 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:15:56.919513 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f791ee4d-0cbd-492c-af32-626492a363c6 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:56.936419 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda0d663-95e0-4cd7-8c63-dbee0718aa6f None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:56.938221 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:56.977963 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c624705-925e-45c9-9a34-dd63ac6f9d08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:56.978513 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c624705-925e-45c9-9a34-dd63ac6f9d08 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:56.978795 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c624705-925e-45c9-9a34-dd63ac6f9d08 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:56.979075 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c624705-925e-45c9-9a34-dd63ac6f9d08 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:56.989624 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c624705-925e-45c9-9a34-dd63ac6f9d08 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:56.991668 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c624705-925e-45c9-9a34-dd63ac6f9d08 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:57.003119 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:57.009048 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-9c624705-925e-45c9-9a34-dd63ac6f9d08 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 15:15:57.009048 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:15:57.009048 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:15:57.009048 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:15:57.009048 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:15:57.009048 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:15:57.009048 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:15:57.009048 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:15:57.009048 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:15:57.009048 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:15:57.009048 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:15:57.009048 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:15:57.009048 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 15:15:57.009048 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 15:15:57.009048 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 15:15:57.009048 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 15:15:57.010082 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:15:57.010082 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:15:57.010082 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:15:57.010082 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:15:57.010082 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:15:57.010082 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:15:57.010082 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:15:57.010082 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Sep 13 15:15:57.010082 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:15:57.010082 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:15:57.010082 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:15:57.010082 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:15:57.010082 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:15:57.010082 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:15:57.010082 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:15:57.010082 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:15:57.010082 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 15:15:57.010992 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 15:15:57.010992 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 15:15:57.010992 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Sep 13 15:15:57.010992 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 338/662] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 13 15:15:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:15:57.010992 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c624705-925e-45c9-9a34-dd63ac6f9d08 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:57.032467 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f791ee4d-0cbd-492c-af32-626492a363c6 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:57.069813 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0a346a-57c3-42c3-bf21-e20d1e354b22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:57.070345 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0a346a-57c3-42c3-bf21-e20d1e354b22 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:57.070631 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0a346a-57c3-42c3-bf21-e20d1e354b22 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:57.070902 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0a346a-57c3-42c3-bf21-e20d1e354b22 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:57.118599 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c624705-925e-45c9-9a34-dd63ac6f9d08 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:57.143936 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0a346a-57c3-42c3-bf21-e20d1e354b22 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:57.145395 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0a346a-57c3-42c3-bf21-e20d1e354b22 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:57.152365 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab17767-f232-4ae0-a745-a806aec0347b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:57.152997 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab17767-f232-4ae0-a745-a806aec0347b None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:57.153281 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab17767-f232-4ae0-a745-a806aec0347b None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:57.153558 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab17767-f232-4ae0-a745-a806aec0347b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:57.164507 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab17767-f232-4ae0-a745-a806aec0347b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 15:15:57.169881 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-5ab17767-f232-4ae0-a745-a806aec0347b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 15:15:57.169881 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:15:57.169881 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:15:57.169881 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:15:57.169881 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:15:57.169881 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:15:57.169881 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:15:57.169881 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:15:57.169881 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:15:57.169881 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:15:57.169881 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:15:57.169881 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:15:57.169881 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 15:15:57.169881 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 15:15:57.169881 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 15:15:57.169881 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 15:15:57.170960 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 15:15:57.170960 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 15:15:57.170960 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 15:15:57.170960 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 15:15:57.170960 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:15:57.170960 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:15:57.170960 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:15:57.170960 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:15:57.170960 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:15:57.170960 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:15:57.170960 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:15:57.170960 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Sep 13 15:15:57.170960 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:15:57.170960 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:15:57.170960 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:15:57.170960 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:15:57.171820 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:15:57.171820 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:15:57.171820 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:15:57.171820 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:15:57.171820 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 15:15:57.171820 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 15:15:57.171820 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 15:15:57.171820 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 15:15:57.171820 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 15:15:57.171820 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 15:15:57.171820 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 15:15:57.171820 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Sep 13 15:15:57.171820 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 339/663] 10.222.0.27 () {56 vars in 1102 bytes} [Tue Sep 13 15:15:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:15:57.172542 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab17767-f232-4ae0-a745-a806aec0347b None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:57.191232 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:57.234065 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:57.257566 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 325/664] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Sep 13 15:15:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 15:15:57.258422 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0a346a-57c3-42c3-bf21-e20d1e354b22 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:57.290377 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab17767-f232-4ae0-a745-a806aec0347b None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:57.329654 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a992b121-66a4-419e-a598-edfb7f427b23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:57.330536 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a992b121-66a4-419e-a598-edfb7f427b23 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:57.331014 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a992b121-66a4-419e-a598-edfb7f427b23 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:57.331295 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a992b121-66a4-419e-a598-edfb7f427b23 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:57.362788 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0a346a-57c3-42c3-bf21-e20d1e354b22 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:57.401267 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4eebbbd-2840-4928-83e3-26fd0d5c5a65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:57.401944 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eebbbd-2840-4928-83e3-26fd0d5c5a65 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:57.402227 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eebbbd-2840-4928-83e3-26fd0d5c5a65 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:57.402406 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a992b121-66a4-419e-a598-edfb7f427b23 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:57.402585 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eebbbd-2840-4928-83e3-26fd0d5c5a65 None admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:57.403199 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4eebbbd-2840-4928-83e3-26fd0d5c5a65 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:15:57.403504 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4eebbbd-2840-4928-83e3-26fd0d5c5a65 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:57.403848 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a992b121-66a4-419e-a598-edfb7f427b23 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:57.404856 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4eebbbd-2840-4928-83e3-26fd0d5c5a65 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:57.420611 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 326/665] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Sep 13 15:15:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:15:57.420611 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4eebbbd-2840-4928-83e3-26fd0d5c5a65 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:57.423030 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:57.461231 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:57.525847 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 340/666] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Sep 13 15:15:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 15:15:57.527016 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a992b121-66a4-419e-a598-edfb7f427b23 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:57.527418 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4eebbbd-2840-4928-83e3-26fd0d5c5a65 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:57.565206 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1420fa13-b4a6-494b-a6e0-b435de1f43e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:57.565849 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1420fa13-b4a6-494b-a6e0-b435de1f43e4 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:57.566136 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1420fa13-b4a6-494b-a6e0-b435de1f43e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:57.566411 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1420fa13-b4a6-494b-a6e0-b435de1f43e4 None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:57.567134 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1420fa13-b4a6-494b-a6e0-b435de1f43e4 None admin] RBAC: Adding query filter params (name=service) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:15:57.567532 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1420fa13-b4a6-494b-a6e0-b435de1f43e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:57.569467 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1420fa13-b4a6-494b-a6e0-b435de1f43e4 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:57.578088 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 327/667] 10.222.0.27 () {56 vars in 1103 bytes} [Tue Sep 13 15:15:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:15:57.582936 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1420fa13-b4a6-494b-a6e0-b435de1f43e4 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:57.637730 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a992b121-66a4-419e-a598-edfb7f427b23 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:57.653385 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:57.676128 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90e1883-837f-47a8-8cef-b66c6a54ac15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:57.676759 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90e1883-837f-47a8-8cef-b66c6a54ac15 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:57.677039 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90e1883-837f-47a8-8cef-b66c6a54ac15 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:57.677352 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90e1883-837f-47a8-8cef-b66c6a54ac15 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:57.684378 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:57.687673 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1420fa13-b4a6-494b-a6e0-b435de1f43e4 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:57.688314 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90e1883-837f-47a8-8cef-b66c6a54ac15 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:57.689793 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90e1883-837f-47a8-8cef-b66c6a54ac15 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:57.707131 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-b90e1883-837f-47a8-8cef-b66c6a54ac15 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 15:15:57.707131 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:15:57.707131 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:15:57.707131 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:15:57.707131 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:15:57.707131 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:15:57.707131 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:15:57.707131 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:15:57.707131 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:15:57.707131 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:15:57.707131 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:15:57.707131 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:15:57.707131 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 15:15:57.707131 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 15:15:57.707131 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 15:15:57.707131 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 15:15:57.708101 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:15:57.708101 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:15:57.708101 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:15:57.708101 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:15:57.708101 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:15:57.708101 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:15:57.708101 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:15:57.708101 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Sep 13 15:15:57.708101 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:15:57.708101 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:15:57.708101 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:15:57.708101 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:15:57.708101 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:15:57.708101 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:15:57.708101 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:15:57.708101 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:15:57.708101 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 15:15:57.709069 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 15:15:57.709069 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 15:15:57.709069 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Sep 13 15:15:57.713435 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 341/668] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 13 15:15:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:15:57.714245 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90e1883-837f-47a8-8cef-b66c6a54ac15 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:57.727916 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f167c5f4-9200-4837-9466-b31dd9d9fa23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:57.728554 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f167c5f4-9200-4837-9466-b31dd9d9fa23 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:57.728838 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f167c5f4-9200-4837-9466-b31dd9d9fa23 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:57.729113 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f167c5f4-9200-4837-9466-b31dd9d9fa23 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:57.737094 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f167c5f4-9200-4837-9466-b31dd9d9fa23 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:57.738882 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f167c5f4-9200-4837-9466-b31dd9d9fa23 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:57.751888 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-f167c5f4-9200-4837-9466-b31dd9d9fa23 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 15:15:57.751888 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:15:57.751888 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:15:57.751888 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:15:57.751888 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:15:57.751888 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:15:57.751888 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:15:57.751888 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:15:57.751888 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:15:57.751888 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:15:57.751888 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:15:57.751888 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:15:57.751888 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 15:15:57.751888 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 15:15:57.751888 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 15:15:57.752852 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 15:15:57.752852 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:15:57.752852 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:15:57.752852 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:15:57.752852 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:15:57.752852 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:15:57.752852 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:15:57.752852 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:15:57.752852 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Sep 13 15:15:57.752852 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:15:57.752852 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:15:57.752852 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:15:57.752852 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:15:57.752852 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:15:57.752852 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:15:57.752852 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:15:57.752852 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:15:57.754429 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 15:15:57.754429 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 15:15:57.754429 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 15:15:57.754429 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 15:15:57.754429 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 15:15:57.754429 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 15:15:57.754429 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 15:15:57.754429 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Sep 13 15:15:57.758015 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 328/669] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Sep 13 15:15:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:15:57.758865 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f167c5f4-9200-4837-9466-b31dd9d9fa23 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:57.825419 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90e1883-837f-47a8-8cef-b66c6a54ac15 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:57.859543 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b978de-fc40-42a6-9ce2-c6cc6a381a2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:57.860177 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b978de-fc40-42a6-9ce2-c6cc6a381a2f None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:57.860462 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b978de-fc40-42a6-9ce2-c6cc6a381a2f None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:57.860736 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b978de-fc40-42a6-9ce2-c6cc6a381a2f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:57.870003 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f167c5f4-9200-4837-9466-b31dd9d9fa23 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:57.872755 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b978de-fc40-42a6-9ce2-c6cc6a381a2f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:57.874265 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b978de-fc40-42a6-9ce2-c6cc6a381a2f None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:57.890035 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-68b978de-fc40-42a6-9ce2-c6cc6a381a2f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 15:15:57.890035 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:15:57.890035 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:15:57.890035 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:15:57.890035 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:15:57.890035 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:15:57.890035 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:15:57.890035 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:15:57.890035 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:15:57.890035 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:15:57.890035 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:15:57.890035 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:15:57.890035 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 15:15:57.890035 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 15:15:57.890035 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 15:15:57.890035 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 15:15:57.891037 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:15:57.891037 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:15:57.891037 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:15:57.891037 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:15:57.891037 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:15:57.891037 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:15:57.891037 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:15:57.891037 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Sep 13 15:15:57.891037 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:15:57.891037 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:15:57.891037 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:15:57.891037 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:15:57.891037 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:15:57.891037 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:15:57.891037 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:15:57.891037 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:15:57.891037 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 15:15:57.891926 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 15:15:57.891926 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 15:15:57.891926 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Sep 13 15:15:57.891926 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 342/670] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 13 15:15:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:15:57.891926 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b978de-fc40-42a6-9ce2-c6cc6a381a2f None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:57.909268 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e942d253-4aff-4775-a426-e0e16a2b0c24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:57.910315 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e942d253-4aff-4775-a426-e0e16a2b0c24 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:57.910609 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e942d253-4aff-4775-a426-e0e16a2b0c24 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:57.911164 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e942d253-4aff-4775-a426-e0e16a2b0c24 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:57.913343 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:57.924142 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e942d253-4aff-4775-a426-e0e16a2b0c24 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:57.925618 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e942d253-4aff-4775-a426-e0e16a2b0c24 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:57.941873 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-e942d253-4aff-4775-a426-e0e16a2b0c24 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 15:15:57.941873 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:15:57.941873 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:15:57.941873 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:15:57.941873 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:15:57.941873 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:15:57.941873 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:15:57.941873 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:15:57.941873 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:15:57.941873 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:15:57.941873 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:15:57.941873 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:15:57.941873 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 15:15:57.941873 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 15:15:57.941873 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 15:15:57.941873 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 15:15:57.943172 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:15:57.943172 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:15:57.943172 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:15:57.943172 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:15:57.943172 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:15:57.943172 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:15:57.943172 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:15:57.943172 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Sep 13 15:15:57.943172 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:15:57.943172 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:15:57.943172 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:15:57.943172 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:15:57.943172 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:15:57.943172 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:15:57.943172 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:15:57.943172 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:15:57.943172 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 15:15:57.944358 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 15:15:57.944358 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 15:15:57.944358 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Sep 13 15:15:57.945860 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 329/671] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 13 15:15:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:15:57.946749 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e942d253-4aff-4775-a426-e0e16a2b0c24 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:57.963119 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:58.007734 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b978de-fc40-42a6-9ce2-c6cc6a381a2f None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:58.044792 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50530cf0-fac2-4058-9d3b-053bc7e25138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:58.045553 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50530cf0-fac2-4058-9d3b-053bc7e25138 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:58.045967 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50530cf0-fac2-4058-9d3b-053bc7e25138 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:58.046347 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50530cf0-fac2-4058-9d3b-053bc7e25138 None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:58.047090 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50530cf0-fac2-4058-9d3b-053bc7e25138 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:15:58.047485 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50530cf0-fac2-4058-9d3b-053bc7e25138 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:58.048945 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50530cf0-fac2-4058-9d3b-053bc7e25138 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:58.058715 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e942d253-4aff-4775-a426-e0e16a2b0c24 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:58.061820 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 343/672] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Sep 13 15:15:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:15:58.062897 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50530cf0-fac2-4058-9d3b-053bc7e25138 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:58.096565 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9284b95-0fc3-4dfc-b55f-4f890e4edd4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:58.097090 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9284b95-0fc3-4dfc-b55f-4f890e4edd4c None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:58.097373 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9284b95-0fc3-4dfc-b55f-4f890e4edd4c None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:58.097646 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9284b95-0fc3-4dfc-b55f-4f890e4edd4c None admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:58.098371 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9284b95-0fc3-4dfc-b55f-4f890e4edd4c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:15:58.098678 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9284b95-0fc3-4dfc-b55f-4f890e4edd4c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:58.100655 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9284b95-0fc3-4dfc-b55f-4f890e4edd4c None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:58.114226 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 330/673] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Sep 13 15:15:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:15:58.115254 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9284b95-0fc3-4dfc-b55f-4f890e4edd4c None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:58.158959 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:58.183990 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50530cf0-fac2-4058-9d3b-053bc7e25138 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:58.194170 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:58.221760 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e718954-3c29-4066-99f4-bb886f67c0e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:58.222420 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e718954-3c29-4066-99f4-bb886f67c0e8 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:58.222670 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e718954-3c29-4066-99f4-bb886f67c0e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:58.222942 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e718954-3c29-4066-99f4-bb886f67c0e8 None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:58.223588 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e718954-3c29-4066-99f4-bb886f67c0e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:15:58.223898 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e718954-3c29-4066-99f4-bb886f67c0e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:58.225924 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e718954-3c29-4066-99f4-bb886f67c0e8 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:58.229135 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9284b95-0fc3-4dfc-b55f-4f890e4edd4c None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:58.242205 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 344/674] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Sep 13 15:15:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:15:58.242205 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e718954-3c29-4066-99f4-bb886f67c0e8 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:58.273727 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f82693-9fb6-4e9e-966a-3a2e498582be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:58.274353 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f82693-9fb6-4e9e-966a-3a2e498582be None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:58.274650 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f82693-9fb6-4e9e-966a-3a2e498582be None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:58.274911 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f82693-9fb6-4e9e-966a-3a2e498582be None admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:58.275566 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f82693-9fb6-4e9e-966a-3a2e498582be None admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:15:58.275872 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f82693-9fb6-4e9e-966a-3a2e498582be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:58.277254 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f82693-9fb6-4e9e-966a-3a2e498582be None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:58.289349 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 331/675] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Sep 13 15:15:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:15:58.290192 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f82693-9fb6-4e9e-966a-3a2e498582be None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:58.371666 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e718954-3c29-4066-99f4-bb886f67c0e8 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:58.397516 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f82693-9fb6-4e9e-966a-3a2e498582be None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:58.405372 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94fb744-6e88-49f9-adde-2b5746b64b73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:58.406033 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94fb744-6e88-49f9-adde-2b5746b64b73 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:58.406323 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94fb744-6e88-49f9-adde-2b5746b64b73 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:58.406596 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94fb744-6e88-49f9-adde-2b5746b64b73 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:58.413111 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94fb744-6e88-49f9-adde-2b5746b64b73 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:58.414602 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94fb744-6e88-49f9-adde-2b5746b64b73 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:58.416277 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:58.425973 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:58.428026 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-f94fb744-6e88-49f9-adde-2b5746b64b73 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 15:15:58.428026 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:15:58.428026 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:15:58.428026 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:15:58.428026 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:15:58.428026 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:15:58.428026 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:15:58.428026 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:15:58.428026 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:15:58.428026 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:15:58.428026 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:15:58.428026 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:15:58.428026 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 15:15:58.428026 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 15:15:58.428026 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 15:15:58.429044 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 15:15:58.429044 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:15:58.429044 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:15:58.429044 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:15:58.429044 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:15:58.429044 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:15:58.429044 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:15:58.429044 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:15:58.429044 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Sep 13 15:15:58.429044 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:15:58.429044 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:15:58.429044 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:15:58.429044 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:15:58.429044 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:15:58.429044 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:15:58.429044 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:15:58.429044 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:15:58.430486 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 15:15:58.430486 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 15:15:58.430486 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 15:15:58.430486 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 15:15:58.430486 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 15:15:58.430486 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 15:15:58.430486 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 15:15:58.430486 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Sep 13 15:15:58.430486 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 345/676] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Sep 13 15:15:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:15:58.430486 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94fb744-6e88-49f9-adde-2b5746b64b73 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:58.436495 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95f66eb-ffc2-48f0-a705-cf207612d714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:58.437110 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95f66eb-ffc2-48f0-a705-cf207612d714 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:58.437390 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95f66eb-ffc2-48f0-a705-cf207612d714 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:58.437662 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95f66eb-ffc2-48f0-a705-cf207612d714 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:58.438424 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95f66eb-ffc2-48f0-a705-cf207612d714 None admin] RBAC: Adding query filter params (role.id=470736c596a14fa5ac78200239aa1104, scope.project.id=3d6e00339cfa47d2a6fa8724c587035f, user.id=8ef26a5203094c83b52f10b930dfc453) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:15:58.438736 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95f66eb-ffc2-48f0-a705-cf207612d714 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:58.440161 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95f66eb-ffc2-48f0-a705-cf207612d714 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:58.446863 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 332/677] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Sep 13 15:15:58 2022] GET /identity/v3/role_assignments?user.id=8ef26a5203094c83b52f10b930dfc453&scope.project.id=3d6e00339cfa47d2a6fa8724c587035f&role.id=470736c596a14fa5ac78200239aa1104 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:15:58.447636 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95f66eb-ffc2-48f0-a705-cf207612d714 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:58.561265 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94fb744-6e88-49f9-adde-2b5746b64b73 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:58.563968 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95f66eb-ffc2-48f0-a705-cf207612d714 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:58.598590 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc10893-de12-4d5b-afa7-ad3e23fd9602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:58.599365 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc10893-de12-4d5b-afa7-ad3e23fd9602 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:58.599649 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc10893-de12-4d5b-afa7-ad3e23fd9602 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:58.599931 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc10893-de12-4d5b-afa7-ad3e23fd9602 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:58.604959 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50605931-ba23-42f2-a8ba-52364ebb6013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:58.605683 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50605931-ba23-42f2-a8ba-52364ebb6013 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:58.605998 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50605931-ba23-42f2-a8ba-52364ebb6013 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:58.606272 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50605931-ba23-42f2-a8ba-52364ebb6013 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:58.607761 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc10893-de12-4d5b-afa7-ad3e23fd9602 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:58.609308 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc10893-de12-4d5b-afa7-ad3e23fd9602 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:58.615556 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50605931-ba23-42f2-a8ba-52364ebb6013 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:58.616992 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50605931-ba23-42f2-a8ba-52364ebb6013 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:58.621918 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-fbc10893-de12-4d5b-afa7-ad3e23fd9602 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 15:15:58.621918 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:15:58.621918 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:15:58.621918 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:15:58.621918 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:15:58.621918 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:15:58.621918 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:15:58.621918 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:15:58.621918 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:15:58.621918 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:15:58.621918 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:15:58.621918 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:15:58.621918 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 15:15:58.621918 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 15:15:58.621918 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 15:15:58.625139 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 15:15:58.625139 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:15:58.625139 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:15:58.625139 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:15:58.625139 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:15:58.625139 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:15:58.625139 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:15:58.625139 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:15:58.625139 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Sep 13 15:15:58.625139 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:15:58.625139 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:15:58.625139 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:15:58.625139 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:15:58.625139 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:15:58.625139 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:15:58.625139 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:15:58.625139 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:15:58.626317 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 15:15:58.626317 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 15:15:58.626317 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 15:15:58.626317 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 15:15:58.626317 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 15:15:58.626317 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 15:15:58.626317 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 15:15:58.626317 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Sep 13 15:15:58.629265 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 346/678] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Sep 13 15:15:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:15:58.629385 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-50605931-ba23-42f2-a8ba-52364ebb6013 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 13 15:15:58.629385 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:15:58.629385 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:15:58.629385 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:15:58.629385 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:15:58.629385 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:15:58.629385 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:15:58.629385 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:15:58.629385 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:15:58.629385 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:15:58.629385 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:15:58.629385 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:15:58.629385 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 15:15:58.629385 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 15:15:58.629385 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 15:15:58.629385 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 15:15:58.630290 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:15:58.630290 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:15:58.630290 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 15:15:58.630290 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 15:15:58.630290 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 15:15:58.630290 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 15:15:58.630290 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:15:58.630290 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:15:58.630290 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:15:58.630290 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:15:58.630290 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:15:58.630290 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Sep 13 15:15:58.630290 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:15:58.630290 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:15:58.630290 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:15:58.630290 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:15:58.630290 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:15:58.630290 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:15:58.631339 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:15:58.631339 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:15:58.631339 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 15:15:58.631339 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 15:15:58.631339 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 15:15:58.631339 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 15:15:58.631339 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 15:15:58.631339 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 15:15:58.631339 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 13 15:15:58.631339 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Sep 13 15:15:58.632777 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1048d34c-b6ae-4ebe-aa4c-5a35ee83d61f None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:58.632777 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1048d34c-b6ae-4ebe-aa4c-5a35ee83d61f None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:58.632777 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1048d34c-b6ae-4ebe-aa4c-5a35ee83d61f None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:58.633185 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 333/679] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Sep 13 15:15:58 2022] GET /identity/v3/users/swift => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:15:58.633185 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50605931-ba23-42f2-a8ba-52364ebb6013 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:58.633569 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 347/680] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:15:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:15:58.633569 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1048d34c-b6ae-4ebe-aa4c-5a35ee83d61f None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:58.702633 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:58.703921 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:58.750893 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1048d34c-b6ae-4ebe-aa4c-5a35ee83d61f None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:58.764990 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50605931-ba23-42f2-a8ba-52364ebb6013 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:58.784154 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f180d0-e6e7-4331-9d27-645cf6ff9b34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:58.784764 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f180d0-e6e7-4331-9d27-645cf6ff9b34 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:58.785046 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f180d0-e6e7-4331-9d27-645cf6ff9b34 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:58.785321 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f180d0-e6e7-4331-9d27-645cf6ff9b34 None admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:58.786039 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f180d0-e6e7-4331-9d27-645cf6ff9b34 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:15:58.786351 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f180d0-e6e7-4331-9d27-645cf6ff9b34 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:58.787815 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f180d0-e6e7-4331-9d27-645cf6ff9b34 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:58.799890 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 348/681] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Sep 13 15:15:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:15:58.801080 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70a6ff7-67c5-4501-bbda-49184c84c33e None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:58.801460 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70a6ff7-67c5-4501-bbda-49184c84c33e None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:58.801760 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70a6ff7-67c5-4501-bbda-49184c84c33e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:58.807919 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56bfbe0-8496-4e2c-b5f1-35399cdc817d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:58.808733 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56bfbe0-8496-4e2c-b5f1-35399cdc817d None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:58.809283 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56bfbe0-8496-4e2c-b5f1-35399cdc817d None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:58.809732 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56bfbe0-8496-4e2c-b5f1-35399cdc817d None admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:58.810651 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56bfbe0-8496-4e2c-b5f1-35399cdc817d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:15:58.811027 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56bfbe0-8496-4e2c-b5f1-35399cdc817d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:58.812470 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56bfbe0-8496-4e2c-b5f1-35399cdc817d None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:58.821513 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-a70a6ff7-67c5-4501-bbda-49184c84c33e None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:15:58.822736 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-a70a6ff7-67c5-4501-bbda-49184c84c33e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:15:58.831972 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 334/682] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Sep 13 15:15:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:15:58.831972 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56bfbe0-8496-4e2c-b5f1-35399cdc817d None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:58.898063 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 349/683] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:15:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 15:15:58.898063 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70a6ff7-67c5-4501-bbda-49184c84c33e None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:58.943337 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56bfbe0-8496-4e2c-b5f1-35399cdc817d None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:58.962452 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:58.965926 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:58.984828 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db51776-7b33-4428-abfa-763fb062da82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:58.985447 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db51776-7b33-4428-abfa-763fb062da82 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:58.985753 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db51776-7b33-4428-abfa-763fb062da82 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:58.986034 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db51776-7b33-4428-abfa-763fb062da82 None admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:58.986781 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db51776-7b33-4428-abfa-763fb062da82 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:15:58.987091 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db51776-7b33-4428-abfa-763fb062da82 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:58.988531 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db51776-7b33-4428-abfa-763fb062da82 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:59.013022 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 335/684] 10.222.0.27 () {56 vars in 1135 bytes} [Tue Sep 13 15:15:58 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:15:59.013022 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db51776-7b33-4428-abfa-763fb062da82 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:59.036320 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70a6ff7-67c5-4501-bbda-49184c84c33e None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:59.084792 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0c724c-fe13-4cd2-92d7-7bd15ac25f4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:59.085682 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0c724c-fe13-4cd2-92d7-7bd15ac25f4b None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:59.086399 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0c724c-fe13-4cd2-92d7-7bd15ac25f4b None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:59.086832 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0c724c-fe13-4cd2-92d7-7bd15ac25f4b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:59.088371 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0c724c-fe13-4cd2-92d7-7bd15ac25f4b None admin] RBAC: Adding query filter params (role.id=470736c596a14fa5ac78200239aa1104, scope.project.id=3d6e00339cfa47d2a6fa8724c587035f, user.id=41675154bbba47388040966f75d84c3c) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:15:59.089129 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0c724c-fe13-4cd2-92d7-7bd15ac25f4b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:59.091891 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0c724c-fe13-4cd2-92d7-7bd15ac25f4b None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:59.099422 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 350/685] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Sep 13 15:15:58 2022] GET /identity/v3/role_assignments?user.id=41675154bbba47388040966f75d84c3c&scope.project.id=3d6e00339cfa47d2a6fa8724c587035f&role.id=470736c596a14fa5ac78200239aa1104 => generated 608 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:15:59.100858 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0c724c-fe13-4cd2-92d7-7bd15ac25f4b None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:59.127403 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db51776-7b33-4428-abfa-763fb062da82 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:59.168759 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2574a13a-fca4-4ff4-bb44-d45445772562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:59.169649 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2574a13a-fca4-4ff4-bb44-d45445772562 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:59.170113 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2574a13a-fca4-4ff4-bb44-d45445772562 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:59.170538 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2574a13a-fca4-4ff4-bb44-d45445772562 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:59.171434 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2574a13a-fca4-4ff4-bb44-d45445772562 None admin] RBAC: Adding query filter params (role.id=470736c596a14fa5ac78200239aa1104, scope.project.id=3d6e00339cfa47d2a6fa8724c587035f, user.id=97acd23097d54bf7805c3cef60626ce7) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:15:59.171911 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2574a13a-fca4-4ff4-bb44-d45445772562 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:59.173527 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2574a13a-fca4-4ff4-bb44-d45445772562 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:59.185988 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 336/686] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Sep 13 15:15:59 2022] GET /identity/v3/role_assignments?user.id=97acd23097d54bf7805c3cef60626ce7&scope.project.id=3d6e00339cfa47d2a6fa8724c587035f&role.id=470736c596a14fa5ac78200239aa1104 => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:15:59.250358 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0c724c-fe13-4cd2-92d7-7bd15ac25f4b None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:59.273638 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:59.305665 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0509d6-a5fc-4e30-8f27-1156c8c01cd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:59.306408 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0509d6-a5fc-4e30-8f27-1156c8c01cd0 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:59.306700 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0509d6-a5fc-4e30-8f27-1156c8c01cd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:59.306972 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0509d6-a5fc-4e30-8f27-1156c8c01cd0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:59.322645 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2574a13a-fca4-4ff4-bb44-d45445772562 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:59.391075 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:59.422998 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0509d6-a5fc-4e30-8f27-1156c8c01cd0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:59.425051 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0509d6-a5fc-4e30-8f27-1156c8c01cd0 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:59.484551 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2574a13a-fca4-4ff4-bb44-d45445772562 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:59.522879 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7429c9f-04b8-44c3-95d0-0cac7e0caa10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:59.523676 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7429c9f-04b8-44c3-95d0-0cac7e0caa10 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:59.524051 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7429c9f-04b8-44c3-95d0-0cac7e0caa10 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:59.524522 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7429c9f-04b8-44c3-95d0-0cac7e0caa10 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:59.535588 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7429c9f-04b8-44c3-95d0-0cac7e0caa10 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 15:15:59.541425 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-c7429c9f-04b8-44c3-95d0-0cac7e0caa10 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 15:15:59.541425 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:15:59.541425 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:15:59.541425 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:15:59.541425 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:15:59.541425 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:15:59.541425 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:15:59.541425 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:15:59.541425 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:15:59.541425 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:15:59.541425 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:15:59.541425 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:15:59.541425 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 15:15:59.541425 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 15:15:59.541425 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 15:15:59.541425 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 15:15:59.542593 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 15:15:59.542593 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 15:15:59.542593 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 15:15:59.542593 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 15:15:59.542593 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:15:59.542593 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:15:59.542593 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:15:59.542593 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:15:59.542593 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:15:59.542593 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:15:59.542593 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:15:59.542593 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Sep 13 15:15:59.542593 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:15:59.542593 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:15:59.542593 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:15:59.542593 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:15:59.543677 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:15:59.543677 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:15:59.543677 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:15:59.543677 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:15:59.543677 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 15:15:59.543677 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 15:15:59.543677 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 15:15:59.543677 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 15:15:59.543677 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 15:15:59.543677 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 15:15:59.543677 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 15:15:59.543677 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Sep 13 15:15:59.548974 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 351/687] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Sep 13 15:15:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 15:15:59.549115 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 337/688] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Sep 13 15:15:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 15:15:59.550048 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0509d6-a5fc-4e30-8f27-1156c8c01cd0 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:59.556885 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7429c9f-04b8-44c3-95d0-0cac7e0caa10 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:59.565035 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:59.658895 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0509d6-a5fc-4e30-8f27-1156c8c01cd0 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:59.667531 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:59.672539 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7429c9f-04b8-44c3-95d0-0cac7e0caa10 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:59.720639 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb57cfb-065a-419a-b651-88a548dd7e93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:59.721204 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb57cfb-065a-419a-b651-88a548dd7e93 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:59.721487 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb57cfb-065a-419a-b651-88a548dd7e93 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:59.721787 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb57cfb-065a-419a-b651-88a548dd7e93 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:59.744467 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb57cfb-065a-419a-b651-88a548dd7e93 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:59.745980 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb57cfb-065a-419a-b651-88a548dd7e93 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:59.757675 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c675312-db88-4fb7-9f26-91d98b4a4862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:59.758312 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c675312-db88-4fb7-9f26-91d98b4a4862 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:59.758598 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c675312-db88-4fb7-9f26-91d98b4a4862 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:59.758869 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c675312-db88-4fb7-9f26-91d98b4a4862 None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:59.759537 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c675312-db88-4fb7-9f26-91d98b4a4862 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:15:59.759842 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c675312-db88-4fb7-9f26-91d98b4a4862 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:59.761202 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c675312-db88-4fb7-9f26-91d98b4a4862 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:59.778721 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 338/689] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Sep 13 15:15:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:15:59.781739 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-2cb57cfb-065a-419a-b651-88a548dd7e93 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 15:15:59.781739 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:15:59.781739 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:15:59.781739 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:15:59.781739 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:15:59.781739 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:15:59.781739 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:15:59.781739 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:15:59.781739 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:15:59.781739 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:15:59.781739 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:15:59.781739 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:15:59.781739 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 15:15:59.781739 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 15:15:59.781739 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 15:15:59.781739 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 15:15:59.782671 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:15:59.782671 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:15:59.782671 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:15:59.782671 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:15:59.782671 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:15:59.782671 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:15:59.782671 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:15:59.782671 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Sep 13 15:15:59.782671 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:15:59.782671 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:15:59.782671 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:15:59.782671 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:15:59.782671 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:15:59.782671 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:15:59.782671 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:15:59.782671 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:15:59.782671 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 15:15:59.783536 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 15:15:59.783536 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 15:15:59.783536 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Sep 13 15:15:59.784645 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 352/690] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 13 15:15:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 15:15:59.786130 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c675312-db88-4fb7-9f26-91d98b4a4862 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:59.788362 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb57cfb-065a-419a-b651-88a548dd7e93 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:15:59.872186 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:15:59.921932 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb57cfb-065a-419a-b651-88a548dd7e93 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:59.972662 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9c678e-7f57-4fa9-8b9a-9c43e1397f92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:15:59.973191 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9c678e-7f57-4fa9-8b9a-9c43e1397f92 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:15:59.973474 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9c678e-7f57-4fa9-8b9a-9c43e1397f92 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:15:59.973771 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9c678e-7f57-4fa9-8b9a-9c43e1397f92 None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:15:59.975112 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9c678e-7f57-4fa9-8b9a-9c43e1397f92 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:15:59.975315 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9c678e-7f57-4fa9-8b9a-9c43e1397f92 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:15:59.976944 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9c678e-7f57-4fa9-8b9a-9c43e1397f92 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:15:59.989455 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c675312-db88-4fb7-9f26-91d98b4a4862 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:15:59.993575 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 353/691] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Sep 13 15:15:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:15:59.994890 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9c678e-7f57-4fa9-8b9a-9c43e1397f92 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:00.053652 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85559466-e65d-4128-af58-85ca29f1cece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:00.054373 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85559466-e65d-4128-af58-85ca29f1cece None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:00.054649 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85559466-e65d-4128-af58-85ca29f1cece None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:00.054922 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85559466-e65d-4128-af58-85ca29f1cece None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:00.082661 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85559466-e65d-4128-af58-85ca29f1cece None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:00.084184 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85559466-e65d-4128-af58-85ca29f1cece None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:00.113287 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-85559466-e65d-4128-af58-85ca29f1cece None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 15:16:00.113287 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:16:00.113287 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:16:00.113287 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:16:00.113287 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:16:00.113287 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:16:00.113287 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:16:00.113287 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:16:00.113287 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:16:00.113287 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:16:00.113287 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:16:00.113287 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:16:00.113287 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 15:16:00.113287 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 15:16:00.113287 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 15:16:00.113287 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 15:16:00.114366 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:16:00.114366 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:16:00.114366 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:16:00.114366 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:16:00.114366 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:16:00.114366 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:16:00.114366 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:16:00.114366 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Sep 13 15:16:00.114366 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:16:00.114366 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:16:00.114366 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:16:00.114366 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:16:00.114366 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:16:00.114366 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:16:00.114366 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:16:00.114366 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:16:00.114366 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 15:16:00.115302 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 15:16:00.115302 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 15:16:00.115302 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Sep 13 15:16:00.115302 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 339/692] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 13 15:15:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:16:00.119053 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9c678e-7f57-4fa9-8b9a-9c43e1397f92 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:00.122344 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85559466-e65d-4128-af58-85ca29f1cece None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:00.149948 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:00.164929 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:00.179797 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07c5334-de63-4ba3-8ab6-493805cdf4ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:00.180441 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07c5334-de63-4ba3-8ab6-493805cdf4ba None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:00.180723 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07c5334-de63-4ba3-8ab6-493805cdf4ba None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:00.181002 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07c5334-de63-4ba3-8ab6-493805cdf4ba None admin] PATH_INFO: `/v3/projects/service` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:00.189991 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07c5334-de63-4ba3-8ab6-493805cdf4ba None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:00.191606 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07c5334-de63-4ba3-8ab6-493805cdf4ba None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:00.215411 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-d07c5334-de63-4ba3-8ab6-493805cdf4ba None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 15:16:00.215411 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:16:00.215411 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:16:00.215411 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:16:00.215411 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:16:00.215411 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:16:00.215411 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:16:00.215411 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:16:00.215411 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:16:00.215411 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:16:00.215411 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:16:00.215411 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:16:00.215411 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 15:16:00.215411 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 15:16:00.215411 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 15:16:00.216375 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 15:16:00.216375 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:16:00.216375 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:16:00.216375 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:16:00.216375 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:16:00.216375 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:16:00.216375 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:16:00.216375 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:16:00.216375 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Sep 13 15:16:00.216375 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:16:00.216375 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:16:00.216375 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:16:00.216375 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:16:00.216375 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:16:00.216375 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:16:00.216375 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:16:00.216375 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:16:00.217279 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 15:16:00.217279 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 15:16:00.217279 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 15:16:00.217279 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 15:16:00.217279 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 15:16:00.217279 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 15:16:00.217279 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 15:16:00.217279 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Sep 13 15:16:00.217279 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 354/693] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Sep 13 15:15:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:16:00.223687 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07c5334-de63-4ba3-8ab6-493805cdf4ba None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:00.266754 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85559466-e65d-4128-af58-85ca29f1cece None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:00.307095 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16a1cb5-1991-4080-a321-ae7a985d00ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:00.308010 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16a1cb5-1991-4080-a321-ae7a985d00ab None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:00.308476 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16a1cb5-1991-4080-a321-ae7a985d00ab None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:00.309008 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16a1cb5-1991-4080-a321-ae7a985d00ab None admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:00.309883 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16a1cb5-1991-4080-a321-ae7a985d00ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:16:00.310506 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16a1cb5-1991-4080-a321-ae7a985d00ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:00.312678 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16a1cb5-1991-4080-a321-ae7a985d00ab None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:00.327351 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 340/694] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Sep 13 15:16:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:16:00.335017 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16a1cb5-1991-4080-a321-ae7a985d00ab None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:00.467351 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:00.472466 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07c5334-de63-4ba3-8ab6-493805cdf4ba None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:00.509824 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16a1cb5-1991-4080-a321-ae7a985d00ab None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:00.560462 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e100ca-8186-421d-b922-8aa77e74b2bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:00.561100 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e100ca-8186-421d-b922-8aa77e74b2bd None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:00.561386 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e100ca-8186-421d-b922-8aa77e74b2bd None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:00.561663 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e100ca-8186-421d-b922-8aa77e74b2bd None admin] PATH_INFO: `/v3/users/nova` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:00.564825 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1afaaa-f3a6-4cc2-af8b-66206588d647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:00.565430 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1afaaa-f3a6-4cc2-af8b-66206588d647 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:00.565725 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1afaaa-f3a6-4cc2-af8b-66206588d647 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:00.566006 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1afaaa-f3a6-4cc2-af8b-66206588d647 None admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:00.566702 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1afaaa-f3a6-4cc2-af8b-66206588d647 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:16:00.567014 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1afaaa-f3a6-4cc2-af8b-66206588d647 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:00.570432 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1afaaa-f3a6-4cc2-af8b-66206588d647 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:00.575573 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e100ca-8186-421d-b922-8aa77e74b2bd None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:00.577004 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e100ca-8186-421d-b922-8aa77e74b2bd None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:00.592194 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 355/695] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Sep 13 15:16:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 369 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 15:16:00.598031 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1afaaa-f3a6-4cc2-af8b-66206588d647 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:00.598697 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-d5e100ca-8186-421d-b922-8aa77e74b2bd None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 13 15:16:00.598697 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:16:00.598697 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:16:00.598697 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:16:00.598697 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:16:00.598697 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:16:00.598697 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:16:00.598697 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:16:00.598697 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:16:00.598697 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:16:00.598697 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:16:00.598697 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:16:00.598697 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 15:16:00.598697 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 15:16:00.598697 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 15:16:00.598697 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 15:16:00.600179 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:16:00.600179 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:16:00.600179 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 15:16:00.600179 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 15:16:00.600179 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 15:16:00.600179 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 15:16:00.600179 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:16:00.600179 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:16:00.600179 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:16:00.600179 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:16:00.600179 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:16:00.600179 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Sep 13 15:16:00.600179 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:16:00.600179 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:16:00.600179 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:16:00.600179 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:16:00.600179 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:16:00.600179 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:16:00.601141 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:16:00.601141 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:16:00.601141 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 15:16:00.601141 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 15:16:00.601141 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 15:16:00.601141 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 15:16:00.601141 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 15:16:00.601141 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 15:16:00.601141 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 13 15:16:00.601141 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Sep 13 15:16:00.609537 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 341/696] 10.222.0.27 () {56 vars in 1093 bytes} [Tue Sep 13 15:16:00 2022] GET /identity/v3/users/nova => generated 82 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:16:00.610500 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e100ca-8186-421d-b922-8aa77e74b2bd None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:00.678750 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:00.793017 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1afaaa-f3a6-4cc2-af8b-66206588d647 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:00.822679 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e100ca-8186-421d-b922-8aa77e74b2bd None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:00.857284 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:00.862502 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a38ee1c-1796-46b7-9c82-6d09b6d533b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:00.863119 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a38ee1c-1796-46b7-9c82-6d09b6d533b1 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:00.863411 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a38ee1c-1796-46b7-9c82-6d09b6d533b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:00.863750 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a38ee1c-1796-46b7-9c82-6d09b6d533b1 None admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:00.864500 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a38ee1c-1796-46b7-9c82-6d09b6d533b1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:16:00.865594 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a38ee1c-1796-46b7-9c82-6d09b6d533b1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:00.867326 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a38ee1c-1796-46b7-9c82-6d09b6d533b1 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:00.867710 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b7d7f2-a426-499d-9d74-9769cd10cc02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:00.868321 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b7d7f2-a426-499d-9d74-9769cd10cc02 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:00.868601 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b7d7f2-a426-499d-9d74-9769cd10cc02 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:00.868875 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b7d7f2-a426-499d-9d74-9769cd10cc02 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:00.869601 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b7d7f2-a426-499d-9d74-9769cd10cc02 None admin] RBAC: Adding query filter params (role.id=470736c596a14fa5ac78200239aa1104, scope.project.id=3d6e00339cfa47d2a6fa8724c587035f, user.id=dc735644be394e0abe73e709373e2003) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:16:00.869984 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b7d7f2-a426-499d-9d74-9769cd10cc02 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:00.871406 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b7d7f2-a426-499d-9d74-9769cd10cc02 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:00.886086 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 356/697] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Sep 13 15:16:00 2022] GET /identity/v3/role_assignments?user.id=dc735644be394e0abe73e709373e2003&scope.project.id=3d6e00339cfa47d2a6fa8724c587035f&role.id=470736c596a14fa5ac78200239aa1104 => generated 608 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 15:16:00.890426 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 342/698] 10.222.0.27 () {56 vars in 1133 bytes} [Tue Sep 13 15:16:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:16:00.896330 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b7d7f2-a426-499d-9d74-9769cd10cc02 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:00.981801 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc06b6b-3ae8-44a9-a104-ce0c3cff5281 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:00.982468 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc06b6b-3ae8-44a9-a104-ce0c3cff5281 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:00.982986 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc06b6b-3ae8-44a9-a104-ce0c3cff5281 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:00.984570 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 343/699] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:16:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 15:16:00.999732 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa74cd3f-b4a8-42cd-9caf-032e238b6f4d None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:01.000782 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa74cd3f-b4a8-42cd-9caf-032e238b6f4d None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:01.001281 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa74cd3f-b4a8-42cd-9caf-032e238b6f4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:01.030882 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-fa74cd3f-b4a8-42cd-9caf-032e238b6f4d None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:16:01.033394 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-fa74cd3f-b4a8-42cd-9caf-032e238b6f4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:16:01.097742 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b7d7f2-a426-499d-9d74-9769cd10cc02 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:01.108324 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:01.141299 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74866e45-bab5-49b9-9db8-e7fea4d22f0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:01.141936 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74866e45-bab5-49b9-9db8-e7fea4d22f0f None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:01.142229 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74866e45-bab5-49b9-9db8-e7fea4d22f0f None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:01.142512 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74866e45-bab5-49b9-9db8-e7fea4d22f0f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:01.149879 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 344/700] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:16:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 15:16:01.219423 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74866e45-bab5-49b9-9db8-e7fea4d22f0f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:01.220891 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74866e45-bab5-49b9-9db8-e7fea4d22f0f None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:01.328843 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 357/701] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Sep 13 15:16:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 15:16:01.335734 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa74cd3f-b4a8-42cd-9caf-032e238b6f4d None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:01.448896 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa74cd3f-b4a8-42cd-9caf-032e238b6f4d None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:01.471795 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:01.488318 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dfeac9-4c6e-4bc8-8303-9a3fd0f57ba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:01.488951 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dfeac9-4c6e-4bc8-8303-9a3fd0f57ba1 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:01.489227 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dfeac9-4c6e-4bc8-8303-9a3fd0f57ba1 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:01.489514 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dfeac9-4c6e-4bc8-8303-9a3fd0f57ba1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:01.500111 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dfeac9-4c6e-4bc8-8303-9a3fd0f57ba1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:01.500383 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74866e45-bab5-49b9-9db8-e7fea4d22f0f None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:01.501561 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dfeac9-4c6e-4bc8-8303-9a3fd0f57ba1 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:01.518945 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-28dfeac9-4c6e-4bc8-8303-9a3fd0f57ba1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 15:16:01.518945 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:16:01.518945 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:16:01.518945 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:16:01.518945 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:16:01.518945 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:16:01.518945 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:16:01.518945 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:16:01.518945 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:16:01.518945 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:16:01.518945 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:16:01.518945 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:16:01.518945 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 15:16:01.518945 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 15:16:01.518945 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 15:16:01.518945 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 15:16:01.519932 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:16:01.519932 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:16:01.519932 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:16:01.519932 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:16:01.519932 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:16:01.519932 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:16:01.519932 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:16:01.519932 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Sep 13 15:16:01.519932 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:16:01.519932 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:16:01.519932 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:16:01.519932 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:16:01.519932 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:16:01.519932 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:16:01.519932 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:16:01.519932 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:16:01.519932 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 15:16:01.521061 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 15:16:01.521061 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 15:16:01.521061 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Sep 13 15:16:01.522069 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 345/702] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 13 15:16:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 15:16:01.522594 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:01.528612 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dfeac9-4c6e-4bc8-8303-9a3fd0f57ba1 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:01.707235 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74866e45-bab5-49b9-9db8-e7fea4d22f0f None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:01.734866 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dfeac9-4c6e-4bc8-8303-9a3fd0f57ba1 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:01.782069 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fa46a9-26bc-4cf0-b07d-1df342957bf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:01.782710 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fa46a9-26bc-4cf0-b07d-1df342957bf6 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:01.782987 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fa46a9-26bc-4cf0-b07d-1df342957bf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:01.783258 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fa46a9-26bc-4cf0-b07d-1df342957bf6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:01.804546 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90588ce7-be1c-4af2-be91-faf935b1b14f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:01.805158 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90588ce7-be1c-4af2-be91-faf935b1b14f None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:01.805435 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90588ce7-be1c-4af2-be91-faf935b1b14f None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:01.805723 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90588ce7-be1c-4af2-be91-faf935b1b14f None admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:01.806365 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90588ce7-be1c-4af2-be91-faf935b1b14f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:16:01.806665 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90588ce7-be1c-4af2-be91-faf935b1b14f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:01.808013 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90588ce7-be1c-4af2-be91-faf935b1b14f None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:01.809278 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fa46a9-26bc-4cf0-b07d-1df342957bf6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:01.810797 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fa46a9-26bc-4cf0-b07d-1df342957bf6 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:01.831216 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 346/703] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Sep 13 15:16:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:16:01.832547 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ef8692-5e38-4351-b4eb-84d788747651 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:01.832897 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ef8692-5e38-4351-b4eb-84d788747651 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:01.833175 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ef8692-5e38-4351-b4eb-84d788747651 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:01.835027 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-44fa46a9-26bc-4cf0-b07d-1df342957bf6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 15:16:01.835027 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:16:01.835027 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:16:01.835027 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:16:01.835027 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:16:01.835027 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:16:01.835027 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:16:01.835027 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:16:01.835027 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:16:01.835027 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:16:01.835027 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:16:01.835027 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:16:01.835027 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 15:16:01.835027 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 15:16:01.835027 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 15:16:01.835027 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 15:16:01.835960 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:16:01.835960 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:16:01.835960 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:16:01.835960 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:16:01.835960 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:16:01.835960 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:16:01.835960 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:16:01.835960 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Sep 13 15:16:01.835960 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:16:01.835960 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:16:01.835960 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:16:01.835960 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:16:01.835960 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:16:01.835960 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:16:01.835960 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:16:01.835960 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:16:01.835960 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 15:16:01.836896 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 15:16:01.836896 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 15:16:01.836896 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Sep 13 15:16:01.837073 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 347/704] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:16:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:16:01.841739 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 358/705] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 13 15:16:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 338 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:16:01.841946 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ef8692-5e38-4351-b4eb-84d788747651 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:01.847402 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bd5348-9bfd-46d3-a4af-f56e5bc36ddf None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:01.848024 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bd5348-9bfd-46d3-a4af-f56e5bc36ddf None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:01.848533 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bd5348-9bfd-46d3-a4af-f56e5bc36ddf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:01.869617 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-a9bd5348-9bfd-46d3-a4af-f56e5bc36ddf None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:16:01.871336 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-a9bd5348-9bfd-46d3-a4af-f56e5bc36ddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:16:01.878566 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:01.953204 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:01.958643 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ef8692-5e38-4351-b4eb-84d788747651 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:01.969754 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 359/706] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:16:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 15:16:01.969754 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bd5348-9bfd-46d3-a4af-f56e5bc36ddf None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:02.004780 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b9b93d-7af6-456b-b004-1157816099b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:02.006168 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b9b93d-7af6-456b-b004-1157816099b3 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:02.006633 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b9b93d-7af6-456b-b004-1157816099b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:02.006953 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b9b93d-7af6-456b-b004-1157816099b3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:02.014882 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b9b93d-7af6-456b-b004-1157816099b3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:02.016386 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b9b93d-7af6-456b-b004-1157816099b3 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:02.030056 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-b6b9b93d-7af6-456b-b004-1157816099b3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 15:16:02.030056 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:16:02.030056 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:16:02.030056 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:16:02.030056 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:16:02.030056 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:16:02.030056 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:16:02.030056 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:16:02.030056 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:16:02.030056 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:16:02.030056 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:16:02.030056 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:16:02.030056 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 15:16:02.030056 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 15:16:02.030056 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 15:16:02.031160 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 15:16:02.031160 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:16:02.031160 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:16:02.031160 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:16:02.031160 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:16:02.031160 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:16:02.031160 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:16:02.031160 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:16:02.031160 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Sep 13 15:16:02.031160 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:16:02.031160 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:16:02.031160 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:16:02.031160 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:16:02.031160 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:16:02.031160 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:16:02.031160 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:16:02.031160 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:16:02.032240 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 15:16:02.032240 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 15:16:02.032240 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 15:16:02.032240 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 15:16:02.032240 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 15:16:02.032240 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 15:16:02.032240 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 15:16:02.032240 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Sep 13 15:16:02.032959 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 348/707] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Sep 13 15:16:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 15:16:02.034111 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab15c1a-38bf-4e19-a983-da6fcb66426d None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:02.034396 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab15c1a-38bf-4e19-a983-da6fcb66426d None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:02.034679 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab15c1a-38bf-4e19-a983-da6fcb66426d None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:02.037828 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 349/708] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:16:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:16:02.039079 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab15c1a-38bf-4e19-a983-da6fcb66426d None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:02.102002 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bd5348-9bfd-46d3-a4af-f56e5bc36ddf None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:02.137555 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5907649-999c-4307-94e7-00e5f4218470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:02.138586 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5907649-999c-4307-94e7-00e5f4218470 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:02.139068 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5907649-999c-4307-94e7-00e5f4218470 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:02.139538 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5907649-999c-4307-94e7-00e5f4218470 None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:02.140370 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5907649-999c-4307-94e7-00e5f4218470 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:16:02.140878 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5907649-999c-4307-94e7-00e5f4218470 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:02.143148 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5907649-999c-4307-94e7-00e5f4218470 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:02.155720 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 360/709] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Sep 13 15:16:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:16:02.157328 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81766a13-e8a7-447e-9c6c-70ba74f008b1 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:02.157848 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81766a13-e8a7-447e-9c6c-70ba74f008b1 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:02.158332 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:02.158445 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81766a13-e8a7-447e-9c6c-70ba74f008b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:02.171509 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab15c1a-38bf-4e19-a983-da6fcb66426d None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:02.181769 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-81766a13-e8a7-447e-9c6c-70ba74f008b1 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:16:02.183593 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-81766a13-e8a7-447e-9c6c-70ba74f008b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:16:02.211185 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb85b55-739b-4c67-931f-8092e9b36a0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:02.212139 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb85b55-739b-4c67-931f-8092e9b36a0d None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:02.212496 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb85b55-739b-4c67-931f-8092e9b36a0d None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:02.212846 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb85b55-739b-4c67-931f-8092e9b36a0d None admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:02.214171 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb85b55-739b-4c67-931f-8092e9b36a0d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:16:02.214859 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb85b55-739b-4c67-931f-8092e9b36a0d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:02.217138 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb85b55-739b-4c67-931f-8092e9b36a0d None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:02.234790 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 350/710] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Sep 13 15:16:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 15:16:02.236269 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb85b55-739b-4c67-931f-8092e9b36a0d None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:02.240982 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:02.265029 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 361/711] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:16:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 15:16:02.265910 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81766a13-e8a7-447e-9c6c-70ba74f008b1 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:02.376253 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81766a13-e8a7-447e-9c6c-70ba74f008b1 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:02.382085 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb85b55-739b-4c67-931f-8092e9b36a0d None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:02.416267 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7e3aa0-6e9a-4cff-beab-0f61fdc5daf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:02.417728 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7e3aa0-6e9a-4cff-beab-0f61fdc5daf1 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:02.418308 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7e3aa0-6e9a-4cff-beab-0f61fdc5daf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:02.418777 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7e3aa0-6e9a-4cff-beab-0f61fdc5daf1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:02.420318 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7e3aa0-6e9a-4cff-beab-0f61fdc5daf1 None admin] RBAC: Adding query filter params (role.id=f34412ad29f1478cba775b033129f71f, scope.project.id=3d6e00339cfa47d2a6fa8724c587035f, user.id=62aad71c6c1a4469805762bba330bf0e) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:16:02.420935 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7e3aa0-6e9a-4cff-beab-0f61fdc5daf1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:02.422853 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7e3aa0-6e9a-4cff-beab-0f61fdc5daf1 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:02.424989 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4d4e11-dc5f-4977-b918-5130846329e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:02.425669 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4d4e11-dc5f-4977-b918-5130846329e7 None admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:02.426064 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4d4e11-dc5f-4977-b918-5130846329e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:02.426460 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4d4e11-dc5f-4977-b918-5130846329e7 None admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:02.427465 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4d4e11-dc5f-4977-b918-5130846329e7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:02.428962 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4d4e11-dc5f-4977-b918-5130846329e7 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:02.430813 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 362/712] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Sep 13 15:16:02 2022] GET /identity/v3/role_assignments?user.id=62aad71c6c1a4469805762bba330bf0e&scope.project.id=3d6e00339cfa47d2a6fa8724c587035f&role.id=f34412ad29f1478cba775b033129f71f => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:16:02.431917 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7e3aa0-6e9a-4cff-beab-0f61fdc5daf1 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:02.466116 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 351/713] 10.222.0.27 () {60 vars in 1132 bytes} [Tue Sep 13 15:16:02 2022] POST /identity/v3/users => generated 254 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:16:02.491221 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:02.540317 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4d4e11-dc5f-4977-b918-5130846329e7 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:02.553367 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:02.559153 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7e3aa0-6e9a-4cff-beab-0f61fdc5daf1 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:02.640540 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839637ba-80a3-44df-bfae-327132619d3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:02.642844 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839637ba-80a3-44df-bfae-327132619d3e None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:02.643361 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839637ba-80a3-44df-bfae-327132619d3e None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:02.648037 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839637ba-80a3-44df-bfae-327132619d3e None admin] PATH_INFO: `/v3/services/network` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:02.648946 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839637ba-80a3-44df-bfae-327132619d3e None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:02.650555 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839637ba-80a3-44df-bfae-327132619d3e None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:02.666136 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-839637ba-80a3-44df-bfae-327132619d3e None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 13 15:16:02.666136 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:16:02.666136 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 15:16:02.666136 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 15:16:02.666136 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 15:16:02.666136 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 15:16:02.666136 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 15:16:02.666136 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 15:16:02.666136 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 13 15:16:02.666136 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Sep 13 15:16:02.666136 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 15:16:02.666136 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Sep 13 15:16:02.666136 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:16:02.666136 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:16:02.666136 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:16:02.666136 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:16:02.666136 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:16:02.667233 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:16:02.667233 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:16:02.667233 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:16:02.667233 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:16:02.667233 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:16:02.667233 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:16:02.667233 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 15:16:02.667233 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 15:16:02.667233 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 15:16:02.667233 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 15:16:02.667233 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:16:02.667233 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:16:02.667233 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:16:02.667233 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:16:02.667233 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:16:02.667233 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:16:02.668184 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:16:02.668184 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Sep 13 15:16:02.668184 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:16:02.668184 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:16:02.668184 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:16:02.668184 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:16:02.668184 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:16:02.668184 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:16:02.668184 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:16:02.668184 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:16:02.668184 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 15:16:02.668184 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 15:16:02.668184 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 13 15:16:02.668184 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Sep 13 15:16:02.668184 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 363/714] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Sep 13 15:16:02 2022] GET /identity/v3/services/network => generated 88 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:16:02.677752 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839637ba-80a3-44df-bfae-327132619d3e None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:02.738394 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4d4e11-dc5f-4977-b918-5130846329e7 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:02.782104 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7da6b0-9675-4c13-bbc9-803db3c21dc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:02.782750 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7da6b0-9675-4c13-bbc9-803db3c21dc3 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:02.783034 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7da6b0-9675-4c13-bbc9-803db3c21dc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:02.783485 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7da6b0-9675-4c13-bbc9-803db3c21dc3 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:02.784366 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7da6b0-9675-4c13-bbc9-803db3c21dc3 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:02.785789 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7da6b0-9675-4c13-bbc9-803db3c21dc3 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:02.799968 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-ac7da6b0-9675-4c13-bbc9-803db3c21dc3 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 13 15:16:02.799968 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:16:02.799968 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 15:16:02.799968 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 15:16:02.799968 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 15:16:02.799968 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 15:16:02.799968 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 15:16:02.799968 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 15:16:02.799968 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 13 15:16:02.799968 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Sep 13 15:16:02.799968 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 15:16:02.799968 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Sep 13 15:16:02.799968 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:16:02.799968 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:16:02.799968 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:16:02.799968 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:16:02.799968 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:16:02.801010 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:16:02.801010 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:16:02.801010 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:16:02.801010 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:16:02.801010 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:16:02.801010 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:16:02.801010 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 15:16:02.801010 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 15:16:02.801010 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 15:16:02.801010 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 15:16:02.801010 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:16:02.801010 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:16:02.801010 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:16:02.801010 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:16:02.801010 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:16:02.801010 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:16:02.802260 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:16:02.802260 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Sep 13 15:16:02.802260 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:16:02.802260 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:16:02.802260 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:16:02.802260 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:16:02.802260 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:16:02.802260 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:16:02.802260 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:16:02.802260 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:16:02.802260 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 15:16:02.802260 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 15:16:02.802260 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 13 15:16:02.802260 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Sep 13 15:16:02.802260 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 352/715] 10.222.0.27 () {56 vars in 1129 bytes} [Tue Sep 13 15:16:02 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 15:16:02.803294 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839637ba-80a3-44df-bfae-327132619d3e None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:02.809224 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7da6b0-9675-4c13-bbc9-803db3c21dc3 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:02.814651 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:02.845340 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c5598d-1115-460e-810a-88cb5e4e7c81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:02.846285 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c5598d-1115-460e-810a-88cb5e4e7c81 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:02.846726 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c5598d-1115-460e-810a-88cb5e4e7c81 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:02.847003 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c5598d-1115-460e-810a-88cb5e4e7c81 None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:02.847752 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c5598d-1115-460e-810a-88cb5e4e7c81 None admin] RBAC: Adding query filter params (name=network) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:16:02.848066 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c5598d-1115-460e-810a-88cb5e4e7c81 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:02.851881 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c5598d-1115-460e-810a-88cb5e4e7c81 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:02.857315 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 364/716] 10.222.0.27 () {56 vars in 1112 bytes} [Tue Sep 13 15:16:02 2022] GET /identity/v3/services?name=network => generated 124 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:16:02.862767 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c5598d-1115-460e-810a-88cb5e4e7c81 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:02.899780 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:02.948281 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7da6b0-9675-4c13-bbc9-803db3c21dc3 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:02.989580 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c5598d-1115-460e-810a-88cb5e4e7c81 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:02.995077 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbe2b5a-350b-481c-a454-d62ac41ecee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:02.995968 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbe2b5a-350b-481c-a454-d62ac41ecee5 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:02.996447 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbe2b5a-350b-481c-a454-d62ac41ecee5 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:02.996943 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbe2b5a-350b-481c-a454-d62ac41ecee5 None admin] PATH_INFO: `/v3/services` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:02.998307 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbe2b5a-350b-481c-a454-d62ac41ecee5 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:16:02.998871 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbe2b5a-350b-481c-a454-d62ac41ecee5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:03.001273 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbe2b5a-350b-481c-a454-d62ac41ecee5 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:03.009496 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 353/717] 10.222.0.27 () {56 vars in 1124 bytes} [Tue Sep 13 15:16:02 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 15:16:03.016742 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbe2b5a-350b-481c-a454-d62ac41ecee5 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:03.031323 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805083e7-a8cb-49b0-937a-2d205545203e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:03.031993 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805083e7-a8cb-49b0-937a-2d205545203e None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:03.032273 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805083e7-a8cb-49b0-937a-2d205545203e None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:03.032550 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805083e7-a8cb-49b0-937a-2d205545203e None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:03.033238 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805083e7-a8cb-49b0-937a-2d205545203e None admin] RBAC: Adding query filter params (type=network) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:16:03.033657 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805083e7-a8cb-49b0-937a-2d205545203e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:03.035106 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805083e7-a8cb-49b0-937a-2d205545203e None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:03.045381 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 365/718] 10.222.0.27 () {56 vars in 1112 bytes} [Tue Sep 13 15:16:02 2022] GET /identity/v3/services?type=network => generated 124 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 15:16:03.168316 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbe2b5a-350b-481c-a454-d62ac41ecee5 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:03.214609 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724cbf43-2c21-430c-8373-d23f7ba316c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:03.215228 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724cbf43-2c21-430c-8373-d23f7ba316c0 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:03.215508 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724cbf43-2c21-430c-8373-d23f7ba316c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:03.215784 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724cbf43-2c21-430c-8373-d23f7ba316c0 None admin] PATH_INFO: `/v3/services` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:03.216426 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724cbf43-2c21-430c-8373-d23f7ba316c0 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:16:03.216728 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724cbf43-2c21-430c-8373-d23f7ba316c0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:03.218134 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724cbf43-2c21-430c-8373-d23f7ba316c0 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:03.231324 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:03.231620 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 354/719] 10.222.0.27 () {56 vars in 1124 bytes} [Tue Sep 13 15:16:03 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 15:16:03.812422 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52e5f24-019d-4186-a260-19f7b01e37a1 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:03.812936 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52e5f24-019d-4186-a260-19f7b01e37a1 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:03.813013 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52e5f24-019d-4186-a260-19f7b01e37a1 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:03.814610 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 366/720] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:16:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:16:03.821376 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc51518b-ef0b-40df-838d-5aacc31c0180 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:03.821671 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc51518b-ef0b-40df-838d-5aacc31c0180 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:03.821977 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc51518b-ef0b-40df-838d-5aacc31c0180 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:03.852317 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-dc51518b-ef0b-40df-838d-5aacc31c0180 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:16:03.853515 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-dc51518b-ef0b-40df-838d-5aacc31c0180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:16:03.947055 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 355/721] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:16:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 15:16:04.243721 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52e5f24-019d-4186-a260-19f7b01e37a1 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:04.290127 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:04.375423 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52e5f24-019d-4186-a260-19f7b01e37a1 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:04.427428 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa31a6fa-7869-46ae-914b-66c71dba281e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:04.428085 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa31a6fa-7869-46ae-914b-66c71dba281e None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:04.428372 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa31a6fa-7869-46ae-914b-66c71dba281e None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:04.428656 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa31a6fa-7869-46ae-914b-66c71dba281e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:04.444230 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa31a6fa-7869-46ae-914b-66c71dba281e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 15:16:04.450124 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-aa31a6fa-7869-46ae-914b-66c71dba281e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 15:16:04.450124 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:16:04.450124 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:16:04.450124 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:16:04.450124 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:16:04.450124 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:16:04.450124 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:16:04.450124 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:16:04.450124 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:16:04.450124 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:16:04.450124 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:16:04.450124 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:16:04.450124 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 15:16:04.450124 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 15:16:04.450124 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 15:16:04.450124 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 15:16:04.451116 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 15:16:04.451116 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 15:16:04.451116 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 15:16:04.451116 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 15:16:04.451116 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:16:04.451116 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:16:04.451116 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:16:04.451116 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:16:04.451116 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:16:04.451116 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:16:04.451116 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:16:04.451116 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Sep 13 15:16:04.451116 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:16:04.451116 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:16:04.451116 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:16:04.451116 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:16:04.452005 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:16:04.452005 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:16:04.452005 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:16:04.452005 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:16:04.452005 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 15:16:04.452005 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 15:16:04.452005 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 15:16:04.452005 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 15:16:04.452005 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 15:16:04.452005 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 15:16:04.452005 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 15:16:04.452005 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Sep 13 15:16:04.452005 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 367/722] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Sep 13 15:16:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:16:04.457090 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc51518b-ef0b-40df-838d-5aacc31c0180 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:04.613927 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc51518b-ef0b-40df-838d-5aacc31c0180 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:04.653722 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:04.662737 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7bf719-a20b-4be2-ab1d-935a325dc187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:04.663354 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7bf719-a20b-4be2-ab1d-935a325dc187 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:04.663635 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7bf719-a20b-4be2-ab1d-935a325dc187 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:04.663962 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7bf719-a20b-4be2-ab1d-935a325dc187 None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:04.664636 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7bf719-a20b-4be2-ab1d-935a325dc187 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:16:04.666668 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7bf719-a20b-4be2-ab1d-935a325dc187 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:04.668048 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7bf719-a20b-4be2-ab1d-935a325dc187 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:04.678847 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 356/723] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Sep 13 15:16:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:16:04.684406 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa31a6fa-7869-46ae-914b-66c71dba281e None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:04.821082 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:04.827655 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa31a6fa-7869-46ae-914b-66c71dba281e None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:04.871954 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72028ee-6d10-4c64-a2ed-d678c780c2db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:04.872483 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72028ee-6d10-4c64-a2ed-d678c780c2db None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:04.872762 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72028ee-6d10-4c64-a2ed-d678c780c2db None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:04.873035 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72028ee-6d10-4c64-a2ed-d678c780c2db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:04.888383 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72028ee-6d10-4c64-a2ed-d678c780c2db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:04.889885 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72028ee-6d10-4c64-a2ed-d678c780c2db None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:04.906702 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-c72028ee-6d10-4c64-a2ed-d678c780c2db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 15:16:04.906702 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:16:04.906702 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:16:04.906702 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:16:04.906702 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:16:04.906702 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:16:04.906702 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:16:04.906702 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:16:04.906702 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:16:04.906702 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:16:04.906702 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:16:04.906702 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:16:04.906702 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 15:16:04.906702 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 15:16:04.906702 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 15:16:04.906702 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 15:16:04.907836 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:16:04.907836 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:16:04.907836 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:16:04.907836 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:16:04.907836 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:16:04.907836 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:16:04.907836 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:16:04.907836 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Sep 13 15:16:04.907836 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:16:04.907836 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:16:04.907836 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:16:04.907836 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:16:04.907836 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:16:04.907836 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:16:04.907836 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:16:04.907836 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:16:04.907836 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 15:16:04.908732 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 15:16:04.908732 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 15:16:04.908732 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Sep 13 15:16:04.908732 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 368/724] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 13 15:16:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:16:04.914998 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7bf719-a20b-4be2-ab1d-935a325dc187 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:05.053919 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7bf719-a20b-4be2-ab1d-935a325dc187 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:05.090139 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbf7ef4-667f-49f2-a4af-79b8c7c69f99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:05.091201 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbf7ef4-667f-49f2-a4af-79b8c7c69f99 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:05.091486 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbf7ef4-667f-49f2-a4af-79b8c7c69f99 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:05.091765 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbf7ef4-667f-49f2-a4af-79b8c7c69f99 None admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:05.092415 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbf7ef4-667f-49f2-a4af-79b8c7c69f99 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:16:05.092721 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbf7ef4-667f-49f2-a4af-79b8c7c69f99 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:05.094123 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbf7ef4-667f-49f2-a4af-79b8c7c69f99 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:05.104427 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9405c183-5e0f-4ae3-8826-11fdfc978e64 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:05.105079 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9405c183-5e0f-4ae3-8826-11fdfc978e64 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:05.105562 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9405c183-5e0f-4ae3-8826-11fdfc978e64 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:05.107188 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 357/725] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Sep 13 15:16:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:16:05.107403 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 369/726] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:16:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:16:05.114713 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbf7ef4-667f-49f2-a4af-79b8c7c69f99 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:05.117764 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4767c98-e904-47ff-98a1-8706ae50fbca None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:05.118288 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4767c98-e904-47ff-98a1-8706ae50fbca None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:05.118847 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4767c98-e904-47ff-98a1-8706ae50fbca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:05.155166 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-c4767c98-e904-47ff-98a1-8706ae50fbca None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:16:05.156367 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-c4767c98-e904-47ff-98a1-8706ae50fbca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:16:05.170118 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:05.237121 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 370/727] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:16:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 15:16:05.245097 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbf7ef4-667f-49f2-a4af-79b8c7c69f99 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:05.280643 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fa7c1b-6c53-4a45-b782-8effb4ac69f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:05.281287 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fa7c1b-6c53-4a45-b782-8effb4ac69f9 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:05.281574 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fa7c1b-6c53-4a45-b782-8effb4ac69f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:05.281887 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fa7c1b-6c53-4a45-b782-8effb4ac69f9 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:05.289785 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fa7c1b-6c53-4a45-b782-8effb4ac69f9 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:05.291242 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fa7c1b-6c53-4a45-b782-8effb4ac69f9 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:05.303339 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-81fa7c1b-6c53-4a45-b782-8effb4ac69f9 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 13 15:16:05.303339 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:16:05.303339 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:16:05.303339 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:16:05.303339 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:16:05.303339 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:16:05.303339 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:16:05.303339 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:16:05.303339 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:16:05.303339 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:16:05.303339 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:16:05.303339 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:16:05.303339 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 15:16:05.303339 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 15:16:05.303339 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 15:16:05.303339 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 15:16:05.304505 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:16:05.304505 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:16:05.304505 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 15:16:05.304505 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 15:16:05.304505 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 15:16:05.304505 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 15:16:05.304505 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:16:05.304505 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:16:05.304505 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:16:05.304505 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:16:05.304505 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:16:05.304505 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Sep 13 15:16:05.304505 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:16:05.304505 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:16:05.304505 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:16:05.304505 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:16:05.304505 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:16:05.304505 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:16:05.305663 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:16:05.305663 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:16:05.305663 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 15:16:05.305663 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 15:16:05.305663 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 15:16:05.305663 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 15:16:05.305663 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 15:16:05.305663 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 15:16:05.305663 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 13 15:16:05.305663 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Sep 13 15:16:05.305663 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 358/728] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Sep 13 15:16:05 2022] GET /identity/v3/users/swift => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:16:05.310323 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4767c98-e904-47ff-98a1-8706ae50fbca None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:05.431025 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:05.458927 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4767c98-e904-47ff-98a1-8706ae50fbca None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:05.511354 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd52152-8d1f-4620-889d-f02d2c92df38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:05.511978 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd52152-8d1f-4620-889d-f02d2c92df38 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:05.512259 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd52152-8d1f-4620-889d-f02d2c92df38 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:05.512533 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd52152-8d1f-4620-889d-f02d2c92df38 None admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:05.513266 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd52152-8d1f-4620-889d-f02d2c92df38 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:16:05.513577 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd52152-8d1f-4620-889d-f02d2c92df38 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:05.515052 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd52152-8d1f-4620-889d-f02d2c92df38 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:05.541237 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 371/729] 10.222.0.27 () {56 vars in 1135 bytes} [Tue Sep 13 15:16:05 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:16:05.546503 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fa7c1b-6c53-4a45-b782-8effb4ac69f9 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:05.575830 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd52152-8d1f-4620-889d-f02d2c92df38 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:05.699802 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fa7c1b-6c53-4a45-b782-8effb4ac69f9 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:05.730053 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:05.778002 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22981f4-f1bd-444c-959f-ce86201b8321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:05.778628 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22981f4-f1bd-444c-959f-ce86201b8321 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:05.778911 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22981f4-f1bd-444c-959f-ce86201b8321 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:05.779188 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22981f4-f1bd-444c-959f-ce86201b8321 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:05.795315 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd52152-8d1f-4620-889d-f02d2c92df38 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:05.839960 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b942a0-a5cb-4ab5-96ac-186a441f4726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:05.840589 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b942a0-a5cb-4ab5-96ac-186a441f4726 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:05.840851 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b942a0-a5cb-4ab5-96ac-186a441f4726 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:05.841216 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b942a0-a5cb-4ab5-96ac-186a441f4726 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:05.847119 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:05.856044 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b942a0-a5cb-4ab5-96ac-186a441f4726 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 15:16:05.861179 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-28b942a0-a5cb-4ab5-96ac-186a441f4726 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 15:16:05.861179 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:16:05.861179 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:16:05.861179 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:16:05.861179 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:16:05.861179 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:16:05.861179 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:16:05.861179 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:16:05.861179 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:16:05.861179 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:16:05.861179 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:16:05.861179 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:16:05.861179 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 15:16:05.861179 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 15:16:05.861179 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 15:16:05.861179 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 15:16:05.862503 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 15:16:05.862503 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 15:16:05.862503 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 15:16:05.862503 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 15:16:05.862503 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:16:05.862503 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:16:05.862503 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:16:05.862503 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:16:05.862503 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:16:05.862503 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:16:05.862503 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:16:05.862503 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Sep 13 15:16:05.862503 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:16:05.862503 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:16:05.862503 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:16:05.862503 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:16:05.863628 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:16:05.863628 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:16:05.863628 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:16:05.863628 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:16:05.863628 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 15:16:05.863628 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 15:16:05.863628 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 15:16:05.863628 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 15:16:05.863628 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 15:16:05.863628 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 15:16:05.863628 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 15:16:05.863628 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Sep 13 15:16:05.864349 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 372/730] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Sep 13 15:16:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 15:16:05.866488 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8903e16f-21dc-4732-8e16-ad226867ab30 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:05.866784 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8903e16f-21dc-4732-8e16-ad226867ab30 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:05.867068 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8903e16f-21dc-4732-8e16-ad226867ab30 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:05.868504 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 373/731] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:16:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:16:05.873816 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c671687-5dd3-414b-b08f-c0ee5b6c6a6c None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:05.874105 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c671687-5dd3-414b-b08f-c0ee5b6c6a6c None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:05.874270 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22981f4-f1bd-444c-959f-ce86201b8321 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:05.874433 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c671687-5dd3-414b-b08f-c0ee5b6c6a6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:05.875614 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22981f4-f1bd-444c-959f-ce86201b8321 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:05.893285 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-3c671687-5dd3-414b-b08f-c0ee5b6c6a6c None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:16:05.894533 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-3c671687-5dd3-414b-b08f-c0ee5b6c6a6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:16:05.966986 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 374/732] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:16:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 15:16:05.975627 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c671687-5dd3-414b-b08f-c0ee5b6c6a6c None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:05.987953 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 359/733] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Sep 13 15:16:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 15:16:05.989458 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee851d4-56b9-48cc-aaa3-65234ad17041 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:05.990367 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee851d4-56b9-48cc-aaa3-65234ad17041 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:05.990367 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee851d4-56b9-48cc-aaa3-65234ad17041 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:05.993878 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 360/734] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:16:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:16:05.993878 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee851d4-56b9-48cc-aaa3-65234ad17041 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:06.010738 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:06.091633 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c671687-5dd3-414b-b08f-c0ee5b6c6a6c None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:06.104125 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee851d4-56b9-48cc-aaa3-65234ad17041 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:06.119885 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:06.130439 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f1e328-1ac5-4509-89da-85dd28b1265e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:06.131050 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f1e328-1ac5-4509-89da-85dd28b1265e None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:06.131332 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f1e328-1ac5-4509-89da-85dd28b1265e None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:06.131607 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f1e328-1ac5-4509-89da-85dd28b1265e None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:06.132259 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f1e328-1ac5-4509-89da-85dd28b1265e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:16:06.132570 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f1e328-1ac5-4509-89da-85dd28b1265e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:06.133956 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f1e328-1ac5-4509-89da-85dd28b1265e None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:06.142262 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 375/735] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Sep 13 15:16:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:16:06.142648 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7be09f-d12a-4e2f-9cce-8cbdd249d15b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:06.143405 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d5e842-451e-4b85-b6c8-92ad872cf257 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:06.143691 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d5e842-451e-4b85-b6c8-92ad872cf257 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:06.143868 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7be09f-d12a-4e2f-9cce-8cbdd249d15b None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:06.143967 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d5e842-451e-4b85-b6c8-92ad872cf257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:06.144400 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7be09f-d12a-4e2f-9cce-8cbdd249d15b None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:06.144829 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7be09f-d12a-4e2f-9cce-8cbdd249d15b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:06.156832 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7be09f-d12a-4e2f-9cce-8cbdd249d15b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:06.158355 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7be09f-d12a-4e2f-9cce-8cbdd249d15b None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:06.163093 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-61d5e842-451e-4b85-b6c8-92ad872cf257 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:16:06.164289 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-61d5e842-451e-4b85-b6c8-92ad872cf257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:16:06.175327 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-1b7be09f-d12a-4e2f-9cce-8cbdd249d15b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 15:16:06.175327 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:16:06.175327 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:16:06.175327 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:16:06.175327 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:16:06.175327 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:16:06.175327 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:16:06.175327 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:16:06.175327 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:16:06.175327 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:16:06.175327 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:16:06.175327 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:16:06.175327 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 15:16:06.175327 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 15:16:06.175327 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 15:16:06.175327 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 15:16:06.176304 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:16:06.176304 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:16:06.176304 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:16:06.176304 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:16:06.176304 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:16:06.176304 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:16:06.176304 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:16:06.176304 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Sep 13 15:16:06.176304 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:16:06.176304 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:16:06.176304 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:16:06.176304 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:16:06.176304 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:16:06.176304 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:16:06.176304 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:16:06.176304 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:16:06.176304 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 15:16:06.177347 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 15:16:06.177347 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 15:16:06.177347 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Sep 13 15:16:06.177347 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 361/736] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 13 15:16:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:16:06.178396 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b2587c-e2d7-4c2a-b924-9c75a84c5172 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:06.178396 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b2587c-e2d7-4c2a-b924-9c75a84c5172 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:06.178680 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b2587c-e2d7-4c2a-b924-9c75a84c5172 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:06.179911 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 362/737] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:16:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:16:06.180596 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b2587c-e2d7-4c2a-b924-9c75a84c5172 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:06.242216 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 376/738] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:16:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 15:16:06.243374 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d5e842-451e-4b85-b6c8-92ad872cf257 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:06.273232 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:06.298603 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b2587c-e2d7-4c2a-b924-9c75a84c5172 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:06.335204 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2816a719-e6ce-4cda-82bd-66434a71afac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:06.335842 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2816a719-e6ce-4cda-82bd-66434a71afac None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:06.336131 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2816a719-e6ce-4cda-82bd-66434a71afac None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:06.336415 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2816a719-e6ce-4cda-82bd-66434a71afac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:06.346992 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2816a719-e6ce-4cda-82bd-66434a71afac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:06.349223 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2816a719-e6ce-4cda-82bd-66434a71afac None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:06.354985 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d5e842-451e-4b85-b6c8-92ad872cf257 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:06.368876 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-2816a719-e6ce-4cda-82bd-66434a71afac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 15:16:06.368876 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:16:06.368876 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:16:06.368876 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:16:06.368876 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:16:06.368876 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:16:06.368876 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:16:06.368876 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:16:06.368876 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:16:06.368876 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:16:06.368876 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:16:06.368876 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:16:06.368876 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 15:16:06.368876 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 15:16:06.368876 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 15:16:06.368876 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 15:16:06.370160 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:16:06.370160 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:16:06.370160 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:16:06.370160 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:16:06.370160 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:16:06.370160 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:16:06.370160 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:16:06.370160 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Sep 13 15:16:06.370160 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:16:06.370160 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:16:06.370160 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:16:06.370160 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:16:06.370160 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:16:06.370160 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:16:06.370160 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:16:06.370160 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:16:06.370160 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 15:16:06.371325 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 15:16:06.371325 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 15:16:06.371325 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Sep 13 15:16:06.375512 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 363/739] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 13 15:16:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:16:06.376499 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:06.376612 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3be5d8d-dfb0-406d-8f48-1373e758f1f7 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:06.376791 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3be5d8d-dfb0-406d-8f48-1373e758f1f7 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:06.377059 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3be5d8d-dfb0-406d-8f48-1373e758f1f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:06.392384 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cdbe34-5893-414e-b755-28d20a877354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:06.392997 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cdbe34-5893-414e-b755-28d20a877354 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:06.393287 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cdbe34-5893-414e-b755-28d20a877354 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:06.393562 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cdbe34-5893-414e-b755-28d20a877354 None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:06.394243 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cdbe34-5893-414e-b755-28d20a877354 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:16:06.394551 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cdbe34-5893-414e-b755-28d20a877354 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:06.396479 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cdbe34-5893-414e-b755-28d20a877354 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:06.396663 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-c3be5d8d-dfb0-406d-8f48-1373e758f1f7 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:16:06.398014 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-c3be5d8d-dfb0-406d-8f48-1373e758f1f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:16:06.407868 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 377/740] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Sep 13 15:16:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:16:06.408588 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cdbe34-5893-414e-b755-28d20a877354 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:06.485732 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 364/741] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:16:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 15:16:06.485732 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3be5d8d-dfb0-406d-8f48-1373e758f1f7 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:06.525404 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cdbe34-5893-414e-b755-28d20a877354 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:06.536463 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:06.559746 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ed9636-4646-4031-bed3-f072b1225bf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:06.560537 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ed9636-4646-4031-bed3-f072b1225bf9 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:06.560671 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ed9636-4646-4031-bed3-f072b1225bf9 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:06.560931 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ed9636-4646-4031-bed3-f072b1225bf9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:06.572211 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ed9636-4646-4031-bed3-f072b1225bf9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 15:16:06.577603 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-59ed9636-4646-4031-bed3-f072b1225bf9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 15:16:06.577603 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:16:06.577603 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:16:06.577603 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:16:06.577603 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:16:06.577603 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:16:06.577603 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:16:06.577603 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:16:06.577603 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:16:06.577603 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:16:06.577603 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:16:06.577603 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:16:06.577603 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 15:16:06.577603 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 15:16:06.577603 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 15:16:06.577603 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 15:16:06.578653 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 15:16:06.578653 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 15:16:06.578653 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 15:16:06.578653 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 15:16:06.578653 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:16:06.578653 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:16:06.578653 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:16:06.578653 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:16:06.578653 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:16:06.578653 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:16:06.578653 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:16:06.578653 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Sep 13 15:16:06.578653 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:16:06.578653 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:16:06.578653 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:16:06.578653 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:16:06.579478 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:16:06.579478 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:16:06.579478 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:16:06.579478 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:16:06.579478 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 15:16:06.579478 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 15:16:06.579478 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 15:16:06.579478 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 15:16:06.579478 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 15:16:06.579478 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 15:16:06.579478 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 15:16:06.579478 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Sep 13 15:16:06.579478 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 378/742] 10.222.0.27 () {56 vars in 1102 bytes} [Tue Sep 13 15:16:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:16:06.580178 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ed9636-4646-4031-bed3-f072b1225bf9 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:06.599132 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3be5d8d-dfb0-406d-8f48-1373e758f1f7 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:06.620278 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:06.638348 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c53355-fb86-4cbd-bbb4-a5d57d3eb0ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:06.639332 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c53355-fb86-4cbd-bbb4-a5d57d3eb0ef None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:06.639941 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c53355-fb86-4cbd-bbb4-a5d57d3eb0ef None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:06.640396 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c53355-fb86-4cbd-bbb4-a5d57d3eb0ef None admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:06.641212 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c53355-fb86-4cbd-bbb4-a5d57d3eb0ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:16:06.641818 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c53355-fb86-4cbd-bbb4-a5d57d3eb0ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:06.643486 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c53355-fb86-4cbd-bbb4-a5d57d3eb0ef None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:06.655650 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 365/743] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Sep 13 15:16:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:16:06.656625 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c53355-fb86-4cbd-bbb4-a5d57d3eb0ef None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:06.684542 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ed9636-4646-4031-bed3-f072b1225bf9 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:06.726948 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13552809-fb51-497a-ac70-fad4df8de01e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:06.727593 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13552809-fb51-497a-ac70-fad4df8de01e None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:06.727878 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13552809-fb51-497a-ac70-fad4df8de01e None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:06.728155 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13552809-fb51-497a-ac70-fad4df8de01e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:06.736848 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13552809-fb51-497a-ac70-fad4df8de01e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:06.738340 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13552809-fb51-497a-ac70-fad4df8de01e None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:06.751736 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-13552809-fb51-497a-ac70-fad4df8de01e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 15:16:06.751736 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:16:06.751736 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:16:06.751736 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:16:06.751736 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:16:06.751736 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:16:06.751736 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:16:06.751736 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:16:06.751736 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:16:06.751736 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:16:06.751736 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:16:06.751736 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:16:06.751736 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 15:16:06.751736 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 15:16:06.751736 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 15:16:06.752666 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 15:16:06.752666 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:16:06.752666 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:16:06.752666 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:16:06.752666 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:16:06.752666 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:16:06.752666 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:16:06.752666 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:16:06.752666 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Sep 13 15:16:06.752666 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:16:06.752666 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:16:06.752666 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:16:06.752666 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:16:06.752666 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:16:06.752666 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:16:06.752666 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:16:06.752666 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:16:06.753588 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 15:16:06.753588 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 15:16:06.753588 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 15:16:06.753588 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 15:16:06.753588 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 15:16:06.753588 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 15:16:06.753588 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 15:16:06.753588 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Sep 13 15:16:06.753588 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 379/744] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Sep 13 15:16:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:16:06.753588 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13552809-fb51-497a-ac70-fad4df8de01e None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:06.766817 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c53355-fb86-4cbd-bbb4-a5d57d3eb0ef None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:06.773981 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:06.801431 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2ef3cb-baf5-4ead-bb55-c5dbd4dfbc1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:06.802559 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2ef3cb-baf5-4ead-bb55-c5dbd4dfbc1c None admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:06.803052 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2ef3cb-baf5-4ead-bb55-c5dbd4dfbc1c None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:06.803332 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2ef3cb-baf5-4ead-bb55-c5dbd4dfbc1c None admin] PATH_INFO: `/v3/services` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:06.803985 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2ef3cb-baf5-4ead-bb55-c5dbd4dfbc1c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:06.805355 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2ef3cb-baf5-4ead-bb55-c5dbd4dfbc1c None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:06.821106 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 366/745] 10.222.0.27 () {60 vars in 1141 bytes} [Tue Sep 13 15:16:06 2022] POST /identity/v3/services => generated 240 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:16:06.822034 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2ef3cb-baf5-4ead-bb55-c5dbd4dfbc1c None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:06.862755 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:06.868582 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13552809-fb51-497a-ac70-fad4df8de01e None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:06.917147 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0f086e-41d4-4626-8fc2-b56423556b34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:06.917817 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0f086e-41d4-4626-8fc2-b56423556b34 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:06.918157 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0f086e-41d4-4626-8fc2-b56423556b34 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:06.918442 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0f086e-41d4-4626-8fc2-b56423556b34 None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:06.919125 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0f086e-41d4-4626-8fc2-b56423556b34 None admin] RBAC: Adding query filter params (name=service) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:16:06.919432 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0f086e-41d4-4626-8fc2-b56423556b34 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:06.920817 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0f086e-41d4-4626-8fc2-b56423556b34 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:06.934956 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 380/746] 10.222.0.27 () {56 vars in 1103 bytes} [Tue Sep 13 15:16:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:16:06.935842 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0f086e-41d4-4626-8fc2-b56423556b34 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:06.943874 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2ef3cb-baf5-4ead-bb55-c5dbd4dfbc1c None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:06.983361 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c00d9a9-eaa1-4af7-93af-cc006ba52988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:06.984005 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c00d9a9-eaa1-4af7-93af-cc006ba52988 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:06.984283 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c00d9a9-eaa1-4af7-93af-cc006ba52988 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:06.984555 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c00d9a9-eaa1-4af7-93af-cc006ba52988 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:06.994871 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c00d9a9-eaa1-4af7-93af-cc006ba52988 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:06.996326 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c00d9a9-eaa1-4af7-93af-cc006ba52988 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:07.008932 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-3c00d9a9-eaa1-4af7-93af-cc006ba52988 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 13 15:16:07.008932 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:16:07.008932 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:16:07.008932 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:16:07.008932 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:16:07.008932 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:16:07.008932 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:16:07.008932 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:16:07.008932 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:16:07.008932 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:16:07.008932 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:16:07.008932 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:16:07.008932 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 15:16:07.008932 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 15:16:07.008932 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 15:16:07.008932 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 15:16:07.010193 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:16:07.010193 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:16:07.010193 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 15:16:07.010193 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 15:16:07.010193 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 15:16:07.010193 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 15:16:07.010193 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:16:07.010193 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:16:07.010193 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:16:07.010193 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:16:07.010193 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:16:07.010193 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Sep 13 15:16:07.010193 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:16:07.010193 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:16:07.010193 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:16:07.010193 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:16:07.010193 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:16:07.010193 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:16:07.011142 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:16:07.011142 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:16:07.011142 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 15:16:07.011142 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 15:16:07.011142 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 15:16:07.011142 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 15:16:07.011142 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 15:16:07.011142 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 15:16:07.011142 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 13 15:16:07.011142 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Sep 13 15:16:07.011142 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 367/747] 10.222.0.27 () {56 vars in 1093 bytes} [Tue Sep 13 15:16:06 2022] GET /identity/v3/users/nova => generated 82 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:16:07.011142 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c00d9a9-eaa1-4af7-93af-cc006ba52988 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:07.044043 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:07.060765 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0f086e-41d4-4626-8fc2-b56423556b34 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:07.096734 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62d01e7-f887-41a3-83b9-94cf60b31ce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:07.097351 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62d01e7-f887-41a3-83b9-94cf60b31ce2 None admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:07.097634 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62d01e7-f887-41a3-83b9-94cf60b31ce2 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:07.097944 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62d01e7-f887-41a3-83b9-94cf60b31ce2 None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:07.099200 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62d01e7-f887-41a3-83b9-94cf60b31ce2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:07.100700 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62d01e7-f887-41a3-83b9-94cf60b31ce2 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:07.116711 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 381/748] 10.222.0.27 () {60 vars in 1141 bytes} [Tue Sep 13 15:16:06 2022] POST /identity/v3/services => generated 251 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:16:07.117886 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62d01e7-f887-41a3-83b9-94cf60b31ce2 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:07.136000 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c00d9a9-eaa1-4af7-93af-cc006ba52988 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:07.145012 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:07.203985 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6cb90b-3cc6-4d43-81c8-51a4de030a1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:07.205009 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6cb90b-3cc6-4d43-81c8-51a4de030a1b None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:07.205507 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6cb90b-3cc6-4d43-81c8-51a4de030a1b None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:07.206190 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6cb90b-3cc6-4d43-81c8-51a4de030a1b None admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:07.207551 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6cb90b-3cc6-4d43-81c8-51a4de030a1b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:16:07.208826 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6cb90b-3cc6-4d43-81c8-51a4de030a1b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:07.210619 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6cb90b-3cc6-4d43-81c8-51a4de030a1b None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:07.226303 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 368/749] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Sep 13 15:16:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:16:07.227423 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6cb90b-3cc6-4d43-81c8-51a4de030a1b None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:07.259392 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62d01e7-f887-41a3-83b9-94cf60b31ce2 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:07.299103 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b205961d-278a-4f70-8842-52ed6d97cddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:07.300049 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b205961d-278a-4f70-8842-52ed6d97cddb None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:07.300506 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b205961d-278a-4f70-8842-52ed6d97cddb None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:07.300921 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b205961d-278a-4f70-8842-52ed6d97cddb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:07.316568 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b205961d-278a-4f70-8842-52ed6d97cddb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:07.318571 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b205961d-278a-4f70-8842-52ed6d97cddb None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:07.328876 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:07.336251 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-b205961d-278a-4f70-8842-52ed6d97cddb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 15:16:07.336251 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:16:07.336251 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:16:07.336251 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:16:07.336251 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:16:07.336251 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:16:07.336251 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:16:07.336251 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:16:07.336251 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:16:07.336251 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:16:07.336251 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:16:07.336251 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:16:07.336251 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 15:16:07.336251 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 15:16:07.336251 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 15:16:07.336251 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 15:16:07.337210 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:16:07.337210 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:16:07.337210 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:16:07.337210 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:16:07.337210 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:16:07.337210 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:16:07.337210 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:16:07.337210 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Sep 13 15:16:07.337210 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:16:07.337210 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:16:07.337210 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:16:07.337210 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:16:07.337210 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:16:07.337210 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:16:07.337210 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:16:07.337210 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:16:07.337210 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 15:16:07.338167 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 15:16:07.338167 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 15:16:07.338167 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Sep 13 15:16:07.338167 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 382/750] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 13 15:16:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:16:07.339039 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b205961d-278a-4f70-8842-52ed6d97cddb None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:07.354027 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6cb90b-3cc6-4d43-81c8-51a4de030a1b None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:07.398617 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5abb38-b3f6-45e6-b0b2-1ce608734a6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:07.399251 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5abb38-b3f6-45e6-b0b2-1ce608734a6f None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:07.399535 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5abb38-b3f6-45e6-b0b2-1ce608734a6f None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:07.399812 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5abb38-b3f6-45e6-b0b2-1ce608734a6f None admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:07.400549 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5abb38-b3f6-45e6-b0b2-1ce608734a6f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:16:07.400876 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5abb38-b3f6-45e6-b0b2-1ce608734a6f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:07.402330 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5abb38-b3f6-45e6-b0b2-1ce608734a6f None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:07.421300 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 369/751] 10.222.0.27 () {56 vars in 1133 bytes} [Tue Sep 13 15:16:07 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:16:07.422357 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5abb38-b3f6-45e6-b0b2-1ce608734a6f None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:07.427549 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:07.474480 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b205961d-278a-4f70-8842-52ed6d97cddb None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:07.524181 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829cd05c-b712-45e8-869e-e5027b3d1405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:07.525574 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829cd05c-b712-45e8-869e-e5027b3d1405 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:07.526329 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829cd05c-b712-45e8-869e-e5027b3d1405 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:07.526806 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829cd05c-b712-45e8-869e-e5027b3d1405 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:07.528358 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829cd05c-b712-45e8-869e-e5027b3d1405 None admin] RBAC: Adding query filter params (role.id=f34412ad29f1478cba775b033129f71f, scope.project.id=3d6e00339cfa47d2a6fa8724c587035f, user.id=dc735644be394e0abe73e709373e2003) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:16:07.528859 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829cd05c-b712-45e8-869e-e5027b3d1405 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:07.531038 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829cd05c-b712-45e8-869e-e5027b3d1405 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:07.534397 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5abb38-b3f6-45e6-b0b2-1ce608734a6f None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:07.539873 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 383/752] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Sep 13 15:16:07 2022] GET /identity/v3/role_assignments?user.id=dc735644be394e0abe73e709373e2003&scope.project.id=3d6e00339cfa47d2a6fa8724c587035f&role.id=f34412ad29f1478cba775b033129f71f => generated 259 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:16:07.540908 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829cd05c-b712-45e8-869e-e5027b3d1405 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:07.635018 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f805691-b30b-49b0-92ad-ebce14f38389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:07.635672 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f805691-b30b-49b0-92ad-ebce14f38389 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:07.635946 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f805691-b30b-49b0-92ad-ebce14f38389 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:07.636230 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f805691-b30b-49b0-92ad-ebce14f38389 None admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:07.636941 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f805691-b30b-49b0-92ad-ebce14f38389 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:16:07.637255 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f805691-b30b-49b0-92ad-ebce14f38389 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:07.638675 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f805691-b30b-49b0-92ad-ebce14f38389 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:07.660641 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:07.668332 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 370/753] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Sep 13 15:16:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:16:07.671998 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829cd05c-b712-45e8-869e-e5027b3d1405 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:07.673967 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f805691-b30b-49b0-92ad-ebce14f38389 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:07.712880 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:07.720972 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc34cf3-d1c8-4edb-8e5b-8227309e1325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:07.725305 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc34cf3-d1c8-4edb-8e5b-8227309e1325 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:07.725928 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc34cf3-d1c8-4edb-8e5b-8227309e1325 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:07.726411 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc34cf3-d1c8-4edb-8e5b-8227309e1325 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:07.740236 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc34cf3-d1c8-4edb-8e5b-8227309e1325 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:07.742131 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc34cf3-d1c8-4edb-8e5b-8227309e1325 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:07.758809 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-4cc34cf3-d1c8-4edb-8e5b-8227309e1325 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 15:16:07.758809 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:16:07.758809 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:16:07.758809 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:16:07.758809 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:16:07.758809 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:16:07.758809 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:16:07.758809 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:16:07.758809 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:16:07.758809 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:16:07.758809 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:16:07.758809 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:16:07.758809 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 15:16:07.758809 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 15:16:07.758809 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 15:16:07.758809 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 15:16:07.759842 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:16:07.759842 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:16:07.759842 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:16:07.759842 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:16:07.759842 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:16:07.759842 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:16:07.759842 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:16:07.759842 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Sep 13 15:16:07.759842 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:16:07.759842 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:16:07.759842 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:16:07.759842 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:16:07.759842 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:16:07.759842 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:16:07.759842 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:16:07.759842 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:16:07.759842 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 15:16:07.760752 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 15:16:07.760752 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 15:16:07.760752 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Sep 13 15:16:07.763296 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 384/754] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 13 15:16:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:16:07.769846 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc34cf3-d1c8-4edb-8e5b-8227309e1325 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:07.887005 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc34cf3-d1c8-4edb-8e5b-8227309e1325 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:07.901963 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f805691-b30b-49b0-92ad-ebce14f38389 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:07.928726 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367af444-c568-4627-853c-8853556a5f69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:07.929691 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367af444-c568-4627-853c-8853556a5f69 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:07.930199 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367af444-c568-4627-853c-8853556a5f69 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:07.930716 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367af444-c568-4627-853c-8853556a5f69 None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:07.931574 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367af444-c568-4627-853c-8853556a5f69 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:16:07.932081 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367af444-c568-4627-853c-8853556a5f69 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:07.933649 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367af444-c568-4627-853c-8853556a5f69 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:07.955522 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 385/755] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Sep 13 15:16:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:16:07.960006 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0adc82-352f-4de0-95e3-9056f15db398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:07.960640 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0adc82-352f-4de0-95e3-9056f15db398 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:07.960916 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0adc82-352f-4de0-95e3-9056f15db398 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:07.961186 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0adc82-352f-4de0-95e3-9056f15db398 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:07.963568 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367af444-c568-4627-853c-8853556a5f69 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:07.969161 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0adc82-352f-4de0-95e3-9056f15db398 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:07.970618 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0adc82-352f-4de0-95e3-9056f15db398 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:07.982205 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-9c0adc82-352f-4de0-95e3-9056f15db398 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 13 15:16:07.982205 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:16:07.982205 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:16:07.982205 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:16:07.982205 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:16:07.982205 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:16:07.982205 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:16:07.982205 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:16:07.982205 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:16:07.982205 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:16:07.982205 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:16:07.982205 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:16:07.982205 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 15:16:07.982205 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 15:16:07.982205 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 15:16:07.982205 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 15:16:07.983395 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:16:07.983395 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:16:07.983395 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 15:16:07.983395 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 15:16:07.983395 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 15:16:07.983395 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 15:16:07.983395 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:16:07.983395 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:16:07.983395 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:16:07.983395 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:16:07.983395 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:16:07.983395 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Sep 13 15:16:07.983395 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:16:07.983395 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:16:07.983395 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:16:07.983395 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:16:07.983395 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:16:07.983395 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:16:07.984545 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:16:07.984545 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:16:07.984545 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 15:16:07.984545 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 15:16:07.984545 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 15:16:07.984545 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 15:16:07.984545 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 15:16:07.984545 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 15:16:07.984545 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 13 15:16:07.984545 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Sep 13 15:16:07.984545 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 371/756] 10.222.0.27 () {56 vars in 1117 bytes} [Tue Sep 13 15:16:07 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 15:16:07.994671 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0adc82-352f-4de0-95e3-9056f15db398 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:08.021903 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:08.068432 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:08.109435 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0adc82-352f-4de0-95e3-9056f15db398 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:08.122840 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367af444-c568-4627-853c-8853556a5f69 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:08.169944 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b401fd1c-ced2-4752-b63d-934a1ea70fad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:08.170905 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b401fd1c-ced2-4752-b63d-934a1ea70fad None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:08.172671 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b401fd1c-ced2-4752-b63d-934a1ea70fad None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:08.173111 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b401fd1c-ced2-4752-b63d-934a1ea70fad None admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:08.175354 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b401fd1c-ced2-4752-b63d-934a1ea70fad None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:16:08.175849 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b401fd1c-ced2-4752-b63d-934a1ea70fad None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:08.178297 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b401fd1c-ced2-4752-b63d-934a1ea70fad None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:08.201666 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89521f69-b70e-4a97-b15a-f8636f05050b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:08.202632 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89521f69-b70e-4a97-b15a-f8636f05050b None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:08.203061 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89521f69-b70e-4a97-b15a-f8636f05050b None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:08.203536 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89521f69-b70e-4a97-b15a-f8636f05050b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:08.215740 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89521f69-b70e-4a97-b15a-f8636f05050b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:08.216602 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 372/757] 10.222.0.27 () {56 vars in 1149 bytes} [Tue Sep 13 15:16:07 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:16:08.218435 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89521f69-b70e-4a97-b15a-f8636f05050b None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:08.222035 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b401fd1c-ced2-4752-b63d-934a1ea70fad None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:08.242993 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-89521f69-b70e-4a97-b15a-f8636f05050b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 15:16:08.242993 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:16:08.242993 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:16:08.242993 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:16:08.242993 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:16:08.242993 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:16:08.242993 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:16:08.242993 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:16:08.242993 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:16:08.242993 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:16:08.242993 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:16:08.242993 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:16:08.242993 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 15:16:08.242993 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 15:16:08.242993 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 15:16:08.244154 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 15:16:08.244154 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:16:08.244154 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:16:08.244154 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:16:08.244154 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:16:08.244154 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:16:08.244154 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:16:08.244154 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:16:08.244154 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Sep 13 15:16:08.244154 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:16:08.244154 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:16:08.244154 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:16:08.244154 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:16:08.244154 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:16:08.244154 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:16:08.244154 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:16:08.244154 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:16:08.245294 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 15:16:08.245294 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 15:16:08.245294 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 15:16:08.245294 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 15:16:08.245294 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 15:16:08.245294 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 15:16:08.245294 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 15:16:08.245294 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Sep 13 15:16:08.247750 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 386/758] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Sep 13 15:16:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 15:16:08.254101 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89521f69-b70e-4a97-b15a-f8636f05050b None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:08.417012 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89521f69-b70e-4a97-b15a-f8636f05050b None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:08.421179 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:08.423720 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b401fd1c-ced2-4752-b63d-934a1ea70fad None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:08.457254 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:08.482791 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582e8d31-b846-4a2a-a98b-2ced36fed779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:08.484164 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582e8d31-b846-4a2a-a98b-2ced36fed779 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:08.484980 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582e8d31-b846-4a2a-a98b-2ced36fed779 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:08.485936 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582e8d31-b846-4a2a-a98b-2ced36fed779 None admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:08.487307 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582e8d31-b846-4a2a-a98b-2ced36fed779 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:16:08.488576 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582e8d31-b846-4a2a-a98b-2ced36fed779 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:08.491492 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582e8d31-b846-4a2a-a98b-2ced36fed779 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:08.492316 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ebee24-9724-40dd-9bf7-24f49731fd4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:08.493134 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ebee24-9724-40dd-9bf7-24f49731fd4a None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:08.493613 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ebee24-9724-40dd-9bf7-24f49731fd4a None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:08.494114 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ebee24-9724-40dd-9bf7-24f49731fd4a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:08.518655 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 387/759] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Sep 13 15:16:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:16:08.524845 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582e8d31-b846-4a2a-a98b-2ced36fed779 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:08.632330 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ebee24-9724-40dd-9bf7-24f49731fd4a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:08.635126 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ebee24-9724-40dd-9bf7-24f49731fd4a None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:08.743836 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582e8d31-b846-4a2a-a98b-2ced36fed779 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:08.794937 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 373/760] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Sep 13 15:16:08 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 573 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 13 15:16:08.803107 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ebee24-9724-40dd-9bf7-24f49731fd4a None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:08.822403 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b98440-ecd4-4c48-959b-e24a70916343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:08.823077 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b98440-ecd4-4c48-959b-e24a70916343 None admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:08.823361 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b98440-ecd4-4c48-959b-e24a70916343 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:08.823636 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b98440-ecd4-4c48-959b-e24a70916343 None admin] PATH_INFO: `/v3/projects/3d6e00339cfa47d2a6fa8724c587035f/users/62aad71c6c1a4469805762bba330bf0e/roles/f34412ad29f1478cba775b033129f71f` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:08.824591 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:08.826059 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b98440-ecd4-4c48-959b-e24a70916343 None admin] RBAC: Authorizing `identity:create_grant(project_id=3d6e00339cfa47d2a6fa8724c587035f, user_id=62aad71c6c1a4469805762bba330bf0e, role_id=f34412ad29f1478cba775b033129f71f)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:08.827677 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b98440-ecd4-4c48-959b-e24a70916343 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:08.860320 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 388/761] 10.222.0.27 () {58 vars in 1439 bytes} [Tue Sep 13 15:16:08 2022] PUT /identity/v3/projects/3d6e00339cfa47d2a6fa8724c587035f/users/62aad71c6c1a4469805762bba330bf0e/roles/f34412ad29f1478cba775b033129f71f => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 15:16:08.920944 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ebee24-9724-40dd-9bf7-24f49731fd4a None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:08.963042 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d264d8-e45f-4b99-ba75-5b039a5d0229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:08.964075 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d264d8-e45f-4b99-ba75-5b039a5d0229 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:08.964578 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d264d8-e45f-4b99-ba75-5b039a5d0229 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:08.965035 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d264d8-e45f-4b99-ba75-5b039a5d0229 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:08.978731 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d264d8-e45f-4b99-ba75-5b039a5d0229 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:08.980481 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d264d8-e45f-4b99-ba75-5b039a5d0229 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:08.998085 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-35d264d8-e45f-4b99-ba75-5b039a5d0229 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 15:16:08.998085 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:16:08.998085 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:16:08.998085 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:16:08.998085 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:16:08.998085 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:16:08.998085 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:16:08.998085 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:16:08.998085 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:16:08.998085 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:16:08.998085 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:16:08.998085 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:16:08.998085 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 15:16:08.998085 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 15:16:08.998085 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 15:16:08.998085 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 15:16:08.999127 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:16:08.999127 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:16:08.999127 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:16:08.999127 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:16:08.999127 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:16:08.999127 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:16:08.999127 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:16:08.999127 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Sep 13 15:16:08.999127 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:16:08.999127 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:16:08.999127 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:16:08.999127 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:16:08.999127 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:16:08.999127 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:16:08.999127 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:16:08.999127 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:16:08.999127 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 15:16:09.000032 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 15:16:09.000032 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 15:16:09.000032 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Sep 13 15:16:09.002020 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 374/762] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 13 15:16:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:16:09.008363 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b98440-ecd4-4c48-959b-e24a70916343 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:09.060838 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:09.153332 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b98440-ecd4-4c48-959b-e24a70916343 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:09.196413 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50edd34c-5b96-48af-8160-5a9dfe7debdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:09.197051 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50edd34c-5b96-48af-8160-5a9dfe7debdc None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:09.197331 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50edd34c-5b96-48af-8160-5a9dfe7debdc None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:09.197606 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50edd34c-5b96-48af-8160-5a9dfe7debdc None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:09.198300 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50edd34c-5b96-48af-8160-5a9dfe7debdc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:16:09.198608 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50edd34c-5b96-48af-8160-5a9dfe7debdc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:09.200074 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50edd34c-5b96-48af-8160-5a9dfe7debdc None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:09.217882 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 389/763] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Sep 13 15:16:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:16:09.223615 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d264d8-e45f-4b99-ba75-5b039a5d0229 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:09.302895 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2d61e5-864b-4b6a-9990-446da9d01682 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:09.303091 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2d61e5-864b-4b6a-9990-446da9d01682 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:09.303362 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2d61e5-864b-4b6a-9990-446da9d01682 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:09.305059 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 390/764] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:16:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:16:09.314265 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb500b9b-6274-472c-97ec-3b319bc25c8c None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:09.314552 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb500b9b-6274-472c-97ec-3b319bc25c8c None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:09.314820 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb500b9b-6274-472c-97ec-3b319bc25c8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:09.324495 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:09.351607 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-bb500b9b-6274-472c-97ec-3b319bc25c8c None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:16:09.352828 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-bb500b9b-6274-472c-97ec-3b319bc25c8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:16:09.362459 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d264d8-e45f-4b99-ba75-5b039a5d0229 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:09.403388 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4c89c4-8293-41c8-a16d-30bee50e41e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:09.404875 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4c89c4-8293-41c8-a16d-30bee50e41e8 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:09.405588 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4c89c4-8293-41c8-a16d-30bee50e41e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:09.406171 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4c89c4-8293-41c8-a16d-30bee50e41e8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:09.413984 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4c89c4-8293-41c8-a16d-30bee50e41e8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:09.415734 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4c89c4-8293-41c8-a16d-30bee50e41e8 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:09.429264 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-ac4c89c4-8293-41c8-a16d-30bee50e41e8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 15:16:09.429264 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:16:09.429264 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:16:09.429264 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:16:09.429264 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:16:09.429264 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:16:09.429264 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:16:09.429264 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:16:09.429264 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:16:09.429264 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:16:09.429264 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:16:09.429264 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:16:09.429264 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 15:16:09.429264 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 15:16:09.429264 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 15:16:09.430228 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 15:16:09.430228 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:16:09.430228 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:16:09.430228 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:16:09.430228 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:16:09.430228 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:16:09.430228 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:16:09.430228 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:16:09.430228 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Sep 13 15:16:09.430228 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:16:09.430228 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:16:09.430228 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:16:09.430228 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:16:09.430228 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:16:09.430228 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:16:09.430228 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:16:09.430228 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:16:09.431148 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 15:16:09.431148 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 15:16:09.431148 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 15:16:09.431148 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 15:16:09.431148 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 15:16:09.431148 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 15:16:09.431148 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 15:16:09.431148 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Sep 13 15:16:09.433642 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 375/765] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Sep 13 15:16:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:16:09.439308 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4c89c4-8293-41c8-a16d-30bee50e41e8 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:09.527357 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 391/766] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:16:09 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 15:16:09.561798 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4c89c4-8293-41c8-a16d-30bee50e41e8 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:09.593819 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:09.601511 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa97747-706c-45b9-80c5-7e5a1e574ff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:09.602423 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa97747-706c-45b9-80c5-7e5a1e574ff5 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:09.602977 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa97747-706c-45b9-80c5-7e5a1e574ff5 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:09.603461 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa97747-706c-45b9-80c5-7e5a1e574ff5 None admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:09.604397 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa97747-706c-45b9-80c5-7e5a1e574ff5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:16:09.604982 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa97747-706c-45b9-80c5-7e5a1e574ff5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:09.606649 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa97747-706c-45b9-80c5-7e5a1e574ff5 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:09.620576 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 376/767] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Sep 13 15:16:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:16:09.626083 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb500b9b-6274-472c-97ec-3b319bc25c8c None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:09.658872 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:09.777301 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb500b9b-6274-472c-97ec-3b319bc25c8c None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:09.830938 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ee98c3-b6dc-49f1-aac8-8cdf108947d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:09.831484 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ee98c3-b6dc-49f1-aac8-8cdf108947d1 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:09.831771 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ee98c3-b6dc-49f1-aac8-8cdf108947d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:09.832046 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ee98c3-b6dc-49f1-aac8-8cdf108947d1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:09.832905 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ee98c3-b6dc-49f1-aac8-8cdf108947d1 None admin] RBAC: Adding query filter params (role.id=470736c596a14fa5ac78200239aa1104, scope.project.id=3d6e00339cfa47d2a6fa8724c587035f, user.id=e97bcdb20f1e416ea41b99c226617faf) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:16:09.833225 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ee98c3-b6dc-49f1-aac8-8cdf108947d1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:09.834750 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ee98c3-b6dc-49f1-aac8-8cdf108947d1 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:09.842428 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 392/768] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Sep 13 15:16:09 2022] GET /identity/v3/role_assignments?user.id=e97bcdb20f1e416ea41b99c226617faf&scope.project.id=3d6e00339cfa47d2a6fa8724c587035f&role.id=470736c596a14fa5ac78200239aa1104 => generated 259 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:16:09.893549 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa97747-706c-45b9-80c5-7e5a1e574ff5 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:09.998083 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1f541e-22f2-4547-ba46-392d66ea0036 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:09.998418 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1f541e-22f2-4547-ba46-392d66ea0036 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:09.998633 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1f541e-22f2-4547-ba46-392d66ea0036 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:10.000481 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 393/769] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:16:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:16:10.007503 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170da8d1-5c1d-4f9b-859e-601cce8546fd None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:10.007862 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170da8d1-5c1d-4f9b-859e-601cce8546fd None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:10.008059 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170da8d1-5c1d-4f9b-859e-601cce8546fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:10.022821 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa97747-706c-45b9-80c5-7e5a1e574ff5 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:10.049857 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-170da8d1-5c1d-4f9b-859e-601cce8546fd None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:16:10.051082 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-170da8d1-5c1d-4f9b-859e-601cce8546fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:16:10.063827 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71936615-df40-41e8-be87-f91b10d6d75c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:10.064944 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71936615-df40-41e8-be87-f91b10d6d75c None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:10.065434 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71936615-df40-41e8-be87-f91b10d6d75c None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:10.065991 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71936615-df40-41e8-be87-f91b10d6d75c None admin] PATH_INFO: `/v3/services/network` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:10.066814 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71936615-df40-41e8-be87-f91b10d6d75c None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:10.068899 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71936615-df40-41e8-be87-f91b10d6d75c None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:10.080503 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-71936615-df40-41e8-be87-f91b10d6d75c None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 13 15:16:10.080503 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:16:10.080503 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 15:16:10.080503 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 15:16:10.080503 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 15:16:10.080503 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 15:16:10.080503 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 15:16:10.080503 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 15:16:10.080503 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 13 15:16:10.080503 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Sep 13 15:16:10.080503 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 15:16:10.080503 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Sep 13 15:16:10.080503 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:16:10.080503 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:16:10.080503 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:16:10.080503 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:16:10.080503 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:16:10.081640 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:16:10.081640 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:16:10.081640 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:16:10.081640 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:16:10.081640 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:16:10.081640 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:16:10.081640 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 15:16:10.081640 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 15:16:10.081640 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 15:16:10.081640 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 15:16:10.081640 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:16:10.081640 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:16:10.081640 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:16:10.081640 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:16:10.081640 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:16:10.081640 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:16:10.082543 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:16:10.082543 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Sep 13 15:16:10.082543 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:16:10.082543 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:16:10.082543 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:16:10.082543 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:16:10.082543 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:16:10.082543 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:16:10.082543 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:16:10.082543 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:16:10.082543 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 15:16:10.082543 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 15:16:10.082543 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 13 15:16:10.082543 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Sep 13 15:16:10.091846 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 377/770] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Sep 13 15:16:09 2022] GET /identity/v3/services/network => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:16:10.091846 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1819baa9-7871-4d15-8f6a-ee18eaf6b542 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:10.091846 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1819baa9-7871-4d15-8f6a-ee18eaf6b542 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:10.091846 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1819baa9-7871-4d15-8f6a-ee18eaf6b542 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:10.093656 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 378/771] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:16:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:16:10.094195 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1819baa9-7871-4d15-8f6a-ee18eaf6b542 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:10.137571 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 394/772] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:16:10 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 15:16:10.138963 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c94ad63-b5b5-4b77-bc4b-93f494111969 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:10.139264 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c94ad63-b5b5-4b77-bc4b-93f494111969 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:10.139533 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c94ad63-b5b5-4b77-bc4b-93f494111969 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:10.157931 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-7c94ad63-b5b5-4b77-bc4b-93f494111969 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:16:10.159122 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-7c94ad63-b5b5-4b77-bc4b-93f494111969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:16:10.161926 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:10.170204 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:10.232321 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1819baa9-7871-4d15-8f6a-ee18eaf6b542 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:10.243245 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 395/773] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:16:10 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 15:16:10.270832 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47687732-383b-4f00-bd62-01c4f8fee440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:10.271688 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47687732-383b-4f00-bd62-01c4f8fee440 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:10.272149 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47687732-383b-4f00-bd62-01c4f8fee440 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:10.272572 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47687732-383b-4f00-bd62-01c4f8fee440 None admin] PATH_INFO: `/v3/services` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:10.273359 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47687732-383b-4f00-bd62-01c4f8fee440 None admin] RBAC: Adding query filter params (name=network) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:16:10.273868 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47687732-383b-4f00-bd62-01c4f8fee440 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:10.275392 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47687732-383b-4f00-bd62-01c4f8fee440 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:10.284750 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 379/774] 10.222.0.27 () {56 vars in 1112 bytes} [Tue Sep 13 15:16:10 2022] GET /identity/v3/services?name=network => generated 124 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:16:10.286393 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c94ad63-b5b5-4b77-bc4b-93f494111969 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:10.416386 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c94ad63-b5b5-4b77-bc4b-93f494111969 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:10.461670 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee1548d-bf53-4727-81fc-a42b83bd0a62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:10.462302 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee1548d-bf53-4727-81fc-a42b83bd0a62 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:10.462583 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee1548d-bf53-4727-81fc-a42b83bd0a62 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:10.462860 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee1548d-bf53-4727-81fc-a42b83bd0a62 None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:10.463489 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee1548d-bf53-4727-81fc-a42b83bd0a62 None admin] RBAC: Adding query filter params (type=network) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:16:10.463791 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee1548d-bf53-4727-81fc-a42b83bd0a62 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:10.465155 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee1548d-bf53-4727-81fc-a42b83bd0a62 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:10.470394 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 396/775] 10.222.0.27 () {56 vars in 1112 bytes} [Tue Sep 13 15:16:10 2022] GET /identity/v3/services?type=network => generated 350 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:16:10.478932 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47687732-383b-4f00-bd62-01c4f8fee440 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:10.549558 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee1548d-bf53-4727-81fc-a42b83bd0a62 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:10.556382 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:10.608906 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47687732-383b-4f00-bd62-01c4f8fee440 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:10.626698 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:10.644262 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a7e827-30f9-449d-ba4f-6c3bce4d6455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:10.645772 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a7e827-30f9-449d-ba4f-6c3bce4d6455 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:10.646274 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a7e827-30f9-449d-ba4f-6c3bce4d6455 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:10.646755 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a7e827-30f9-449d-ba4f-6c3bce4d6455 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:10.647651 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a7e827-30f9-449d-ba4f-6c3bce4d6455 None admin] RBAC: Adding query filter params (interface=public, service_id=4a691b93e6ab44cfa3027fe127c7741b, region_id=RegionOne) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:16:10.648186 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a7e827-30f9-449d-ba4f-6c3bce4d6455 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:10.649801 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a7e827-30f9-449d-ba4f-6c3bce4d6455 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:10.657865 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 380/776] 10.222.0.27 () {56 vars in 1251 bytes} [Tue Sep 13 15:16:10 2022] GET /identity/v3/endpoints?service_id=4a691b93e6ab44cfa3027fe127c7741b&interface=public®ion_id=RegionOne => generated 194 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:16:10.659232 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a7e827-30f9-449d-ba4f-6c3bce4d6455 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:10.671531 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee1548d-bf53-4727-81fc-a42b83bd0a62 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:10.707277 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eca600-7b8d-4ab6-9066-2215eb989200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:10.708443 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eca600-7b8d-4ab6-9066-2215eb989200 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:10.708729 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eca600-7b8d-4ab6-9066-2215eb989200 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:10.709023 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eca600-7b8d-4ab6-9066-2215eb989200 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:10.719576 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01eca600-7b8d-4ab6-9066-2215eb989200 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 15:16:10.725221 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-01eca600-7b8d-4ab6-9066-2215eb989200 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 15:16:10.725221 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:16:10.725221 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:16:10.725221 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:16:10.725221 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:16:10.725221 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:16:10.725221 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:16:10.725221 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:16:10.725221 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:16:10.725221 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:16:10.725221 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:16:10.725221 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:16:10.725221 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 15:16:10.725221 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 15:16:10.725221 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 15:16:10.725221 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 15:16:10.726443 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 15:16:10.726443 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 15:16:10.726443 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 15:16:10.726443 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 15:16:10.726443 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:16:10.726443 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:16:10.726443 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:16:10.726443 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:16:10.726443 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:16:10.726443 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:16:10.726443 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:16:10.726443 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Sep 13 15:16:10.726443 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:16:10.726443 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:16:10.726443 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:16:10.726443 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:16:10.727261 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:16:10.727261 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:16:10.727261 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:16:10.727261 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:16:10.727261 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 15:16:10.727261 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 15:16:10.727261 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 15:16:10.727261 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 15:16:10.727261 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 15:16:10.727261 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 15:16:10.727261 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 15:16:10.727261 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Sep 13 15:16:10.727261 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 397/777] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Sep 13 15:16:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 15:16:10.728466 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eca600-7b8d-4ab6-9066-2215eb989200 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:10.781531 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a7e827-30f9-449d-ba4f-6c3bce4d6455 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:10.792312 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:10.820459 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6eed35-3d7d-4bab-9176-86d4ca3dc24f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:10.821642 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6eed35-3d7d-4bab-9176-86d4ca3dc24f None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:10.822186 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6eed35-3d7d-4bab-9176-86d4ca3dc24f None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:10.822661 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6eed35-3d7d-4bab-9176-86d4ca3dc24f None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:10.823438 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6eed35-3d7d-4bab-9176-86d4ca3dc24f None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:10.825206 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6eed35-3d7d-4bab-9176-86d4ca3dc24f None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:10.834081 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eca600-7b8d-4ab6-9066-2215eb989200 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:10.836275 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-4b6eed35-3d7d-4bab-9176-86d4ca3dc24f None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 13 15:16:10.836275 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:16:10.836275 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 15:16:10.836275 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 15:16:10.836275 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 15:16:10.836275 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 15:16:10.836275 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 15:16:10.836275 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 15:16:10.836275 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 13 15:16:10.836275 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Sep 13 15:16:10.836275 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 15:16:10.836275 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Sep 13 15:16:10.836275 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:16:10.836275 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:16:10.836275 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:16:10.836275 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:16:10.836275 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:16:10.837250 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:16:10.837250 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:16:10.837250 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:16:10.837250 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:16:10.837250 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:16:10.837250 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:16:10.837250 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 15:16:10.837250 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 15:16:10.837250 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 15:16:10.837250 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 15:16:10.837250 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:16:10.837250 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:16:10.837250 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:16:10.837250 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:16:10.837250 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:16:10.837250 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:16:10.838199 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:16:10.838199 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Sep 13 15:16:10.838199 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:16:10.838199 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:16:10.838199 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:16:10.838199 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:16:10.838199 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:16:10.838199 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:16:10.838199 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:16:10.838199 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:16:10.838199 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 15:16:10.838199 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 15:16:10.838199 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 13 15:16:10.838199 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Sep 13 15:16:10.840897 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 381/778] 10.222.0.27 () {56 vars in 1129 bytes} [Tue Sep 13 15:16:10 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:16:10.842063 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6eed35-3d7d-4bab-9176-86d4ca3dc24f None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:10.876236 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41e08b6-84c9-4d5c-8a39-6445da959221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:10.876713 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41e08b6-84c9-4d5c-8a39-6445da959221 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:10.876995 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41e08b6-84c9-4d5c-8a39-6445da959221 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:10.877270 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41e08b6-84c9-4d5c-8a39-6445da959221 None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:10.877907 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41e08b6-84c9-4d5c-8a39-6445da959221 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:10.879286 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41e08b6-84c9-4d5c-8a39-6445da959221 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:10.885155 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 398/779] 10.222.0.27 () {56 vars in 1087 bytes} [Tue Sep 13 15:16:10 2022] GET /identity/v3/services => generated 772 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:16:10.886003 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41e08b6-84c9-4d5c-8a39-6445da959221 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:10.910104 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:10.961200 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6eed35-3d7d-4bab-9176-86d4ca3dc24f None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:10.999359 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b35548-303b-4e3a-bdae-89462ea9d154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:11.000470 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b35548-303b-4e3a-bdae-89462ea9d154 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:11.001059 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b35548-303b-4e3a-bdae-89462ea9d154 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:11.001536 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b35548-303b-4e3a-bdae-89462ea9d154 None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:11.002496 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b35548-303b-4e3a-bdae-89462ea9d154 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:16:11.003013 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b35548-303b-4e3a-bdae-89462ea9d154 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:11.005207 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b35548-303b-4e3a-bdae-89462ea9d154 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:11.015480 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 382/780] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Sep 13 15:16:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:16:11.022353 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b35548-303b-4e3a-bdae-89462ea9d154 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:11.049876 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41e08b6-84c9-4d5c-8a39-6445da959221 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:11.102239 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:11.126440 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c282c2b2-8781-4907-8e65-a1f922509315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:11.127070 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c282c2b2-8781-4907-8e65-a1f922509315 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:11.127352 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c282c2b2-8781-4907-8e65-a1f922509315 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:11.127627 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c282c2b2-8781-4907-8e65-a1f922509315 None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:11.128269 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c282c2b2-8781-4907-8e65-a1f922509315 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:16:11.128574 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c282c2b2-8781-4907-8e65-a1f922509315 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:11.130611 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c282c2b2-8781-4907-8e65-a1f922509315 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:11.135639 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 399/781] 10.222.0.27 () {56 vars in 1124 bytes} [Tue Sep 13 15:16:10 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:16:11.144015 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b35548-303b-4e3a-bdae-89462ea9d154 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:11.146788 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c282c2b2-8781-4907-8e65-a1f922509315 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:11.170089 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:11.184897 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dddd350-e23a-4177-988b-083156bc401c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:11.185952 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dddd350-e23a-4177-988b-083156bc401c None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:11.186537 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dddd350-e23a-4177-988b-083156bc401c None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:11.187032 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dddd350-e23a-4177-988b-083156bc401c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:11.201291 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dddd350-e23a-4177-988b-083156bc401c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:11.203280 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dddd350-e23a-4177-988b-083156bc401c None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:11.221271 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-3dddd350-e23a-4177-988b-083156bc401c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 15:16:11.221271 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:16:11.221271 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:16:11.221271 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:16:11.221271 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:16:11.221271 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:16:11.221271 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:16:11.221271 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:16:11.221271 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:16:11.221271 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:16:11.221271 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:16:11.221271 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:16:11.221271 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 15:16:11.221271 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 15:16:11.221271 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 15:16:11.221271 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 15:16:11.222298 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:16:11.222298 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:16:11.222298 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:16:11.222298 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:16:11.222298 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:16:11.222298 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:16:11.222298 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:16:11.222298 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Sep 13 15:16:11.222298 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:16:11.222298 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:16:11.222298 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:16:11.222298 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:16:11.222298 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:16:11.222298 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:16:11.222298 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:16:11.222298 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:16:11.222298 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 15:16:11.223762 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 15:16:11.223762 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 15:16:11.223762 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Sep 13 15:16:11.226352 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 383/782] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 13 15:16:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 15:16:11.232863 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dddd350-e23a-4177-988b-083156bc401c None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:11.318351 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c282c2b2-8781-4907-8e65-a1f922509315 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:11.354447 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dddd350-e23a-4177-988b-083156bc401c None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:11.356803 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07dcefa-4192-4f29-81d6-cd9c18b06d86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:11.358235 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07dcefa-4192-4f29-81d6-cd9c18b06d86 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:11.358235 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07dcefa-4192-4f29-81d6-cd9c18b06d86 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:11.358235 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07dcefa-4192-4f29-81d6-cd9c18b06d86 None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:11.358651 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07dcefa-4192-4f29-81d6-cd9c18b06d86 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:16:11.358944 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07dcefa-4192-4f29-81d6-cd9c18b06d86 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:11.360357 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07dcefa-4192-4f29-81d6-cd9c18b06d86 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:11.367806 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 400/783] 10.222.0.27 () {56 vars in 1124 bytes} [Tue Sep 13 15:16:11 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:16:11.374246 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07dcefa-4192-4f29-81d6-cd9c18b06d86 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:11.403384 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe86e477-1ae5-4d22-92de-8dc3ae9fe554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:11.404404 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe86e477-1ae5-4d22-92de-8dc3ae9fe554 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:11.404936 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe86e477-1ae5-4d22-92de-8dc3ae9fe554 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:11.405407 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe86e477-1ae5-4d22-92de-8dc3ae9fe554 None admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:11.406458 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe86e477-1ae5-4d22-92de-8dc3ae9fe554 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:16:11.406965 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe86e477-1ae5-4d22-92de-8dc3ae9fe554 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:11.408891 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe86e477-1ae5-4d22-92de-8dc3ae9fe554 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:11.429288 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 384/784] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Sep 13 15:16:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 15:16:11.435823 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe86e477-1ae5-4d22-92de-8dc3ae9fe554 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:11.440836 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:11.466289 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:11.491137 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07dcefa-4192-4f29-81d6-cd9c18b06d86 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:11.530065 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de20b3d8-a618-4731-afa0-fc592b158eda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:11.530685 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de20b3d8-a618-4731-afa0-fc592b158eda None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:11.530983 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de20b3d8-a618-4731-afa0-fc592b158eda None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:11.531240 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de20b3d8-a618-4731-afa0-fc592b158eda None admin] PATH_INFO: `/v3/endpoints` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:11.531945 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de20b3d8-a618-4731-afa0-fc592b158eda None admin] RBAC: Adding query filter params (interface=public, service_id=76ebf845fedf4141ad4201daac36ede6, region_id=RegionOne) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:16:11.532254 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de20b3d8-a618-4731-afa0-fc592b158eda None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:11.533817 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de20b3d8-a618-4731-afa0-fc592b158eda None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:11.542393 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 401/785] 10.222.0.27 () {56 vars in 1251 bytes} [Tue Sep 13 15:16:11 2022] GET /identity/v3/endpoints?service_id=76ebf845fedf4141ad4201daac36ede6&interface=public®ion_id=RegionOne => generated 194 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:16:11.543638 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077f4406-7369-4345-a2f1-478faf495c4f None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:11.543924 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077f4406-7369-4345-a2f1-478faf495c4f None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:11.544204 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077f4406-7369-4345-a2f1-478faf495c4f None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:11.545838 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 402/786] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:16:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:16:11.550925 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547fab1f-9c86-414f-a489-32fece202227 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:11.551212 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547fab1f-9c86-414f-a489-32fece202227 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:11.552192 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547fab1f-9c86-414f-a489-32fece202227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:11.564029 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe86e477-1ae5-4d22-92de-8dc3ae9fe554 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:11.574774 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-547fab1f-9c86-414f-a489-32fece202227 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:16:11.576244 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-547fab1f-9c86-414f-a489-32fece202227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:16:11.611174 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ff207c-28a4-40ea-8ab0-02cee63c66c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:11.611815 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ff207c-28a4-40ea-8ab0-02cee63c66c9 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:11.612097 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ff207c-28a4-40ea-8ab0-02cee63c66c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:11.612371 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ff207c-28a4-40ea-8ab0-02cee63c66c9 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:11.621153 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ff207c-28a4-40ea-8ab0-02cee63c66c9 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:11.622741 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ff207c-28a4-40ea-8ab0-02cee63c66c9 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:11.637888 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-47ff207c-28a4-40ea-8ab0-02cee63c66c9 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 13 15:16:11.637888 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:16:11.637888 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:16:11.637888 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:16:11.637888 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:16:11.637888 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:16:11.637888 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:16:11.637888 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:16:11.637888 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:16:11.637888 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:16:11.637888 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:16:11.637888 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:16:11.637888 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 15:16:11.637888 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 15:16:11.637888 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 15:16:11.637888 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 15:16:11.638864 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:16:11.638864 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:16:11.638864 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 15:16:11.638864 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 15:16:11.638864 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 15:16:11.638864 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 15:16:11.638864 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:16:11.638864 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:16:11.638864 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:16:11.638864 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:16:11.638864 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:16:11.638864 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Sep 13 15:16:11.638864 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:16:11.638864 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:16:11.638864 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:16:11.638864 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:16:11.638864 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:16:11.638864 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:16:11.639817 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:16:11.639817 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:16:11.639817 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 15:16:11.639817 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 15:16:11.639817 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 15:16:11.639817 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 15:16:11.639817 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 15:16:11.639817 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 15:16:11.639817 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 13 15:16:11.639817 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Sep 13 15:16:11.639817 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 385/787] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Sep 13 15:16:11 2022] GET /identity/v3/users/swift => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 15:16:11.640394 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ff207c-28a4-40ea-8ab0-02cee63c66c9 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:11.668168 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 403/788] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:16:11 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 15:16:11.669996 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547fab1f-9c86-414f-a489-32fece202227 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:11.762363 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:11.782100 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:11.802759 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ff207c-28a4-40ea-8ab0-02cee63c66c9 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:11.841027 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccfefb0-a70d-4833-a46a-b296d52528ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:11.842192 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccfefb0-a70d-4833-a46a-b296d52528ee None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:11.842701 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccfefb0-a70d-4833-a46a-b296d52528ee None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:11.843171 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccfefb0-a70d-4833-a46a-b296d52528ee None admin] PATH_INFO: `/v3/services` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:11.843972 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccfefb0-a70d-4833-a46a-b296d52528ee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:11.845533 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccfefb0-a70d-4833-a46a-b296d52528ee None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:11.852837 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 386/789] 10.222.0.27 () {56 vars in 1087 bytes} [Tue Sep 13 15:16:11 2022] GET /identity/v3/services => generated 772 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:16:11.865980 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547fab1f-9c86-414f-a489-32fece202227 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:11.917056 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46018096-5240-4c1e-9664-56b1cff2025d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:11.917719 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46018096-5240-4c1e-9664-56b1cff2025d None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:11.918000 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46018096-5240-4c1e-9664-56b1cff2025d None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:11.918276 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46018096-5240-4c1e-9664-56b1cff2025d None admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:11.919030 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46018096-5240-4c1e-9664-56b1cff2025d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:16:11.919343 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46018096-5240-4c1e-9664-56b1cff2025d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:11.920805 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46018096-5240-4c1e-9664-56b1cff2025d None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:11.948499 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 404/790] 10.222.0.27 () {56 vars in 1135 bytes} [Tue Sep 13 15:16:11 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:16:11.954414 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccfefb0-a70d-4833-a46a-b296d52528ee None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:11.984759 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46018096-5240-4c1e-9664-56b1cff2025d None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:12.110567 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46018096-5240-4c1e-9664-56b1cff2025d None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:12.122293 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:12.138143 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccfefb0-a70d-4833-a46a-b296d52528ee None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:12.156224 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc32237f-1f7d-4794-b042-db45e445eb61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:12.156860 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc32237f-1f7d-4794-b042-db45e445eb61 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:12.157138 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc32237f-1f7d-4794-b042-db45e445eb61 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:12.157408 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc32237f-1f7d-4794-b042-db45e445eb61 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:12.172422 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc32237f-1f7d-4794-b042-db45e445eb61 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 15:16:12.179802 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-fc32237f-1f7d-4794-b042-db45e445eb61 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 15:16:12.179802 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:16:12.179802 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:16:12.179802 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:16:12.179802 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:16:12.179802 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:16:12.179802 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:16:12.179802 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:16:12.179802 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:16:12.179802 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:16:12.179802 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:16:12.179802 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:16:12.179802 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 15:16:12.179802 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 15:16:12.179802 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 15:16:12.179802 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 15:16:12.180753 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 15:16:12.180753 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 15:16:12.180753 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 15:16:12.180753 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 15:16:12.180753 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:16:12.180753 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:16:12.180753 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:16:12.180753 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:16:12.180753 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:16:12.180753 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:16:12.180753 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:16:12.180753 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Sep 13 15:16:12.180753 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:16:12.180753 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:16:12.180753 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:16:12.180753 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:16:12.181592 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:16:12.181592 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:16:12.181592 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:16:12.181592 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:16:12.181592 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 15:16:12.181592 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 15:16:12.181592 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 15:16:12.181592 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 15:16:12.181592 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 15:16:12.181592 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 15:16:12.181592 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 15:16:12.181592 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Sep 13 15:16:12.181592 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 405/791] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Sep 13 15:16:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:16:12.186761 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc32237f-1f7d-4794-b042-db45e445eb61 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:12.187371 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31f74ab-3a57-45e5-9810-cf437f903d06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:12.187998 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31f74ab-3a57-45e5-9810-cf437f903d06 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:12.188274 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31f74ab-3a57-45e5-9810-cf437f903d06 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:12.188576 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31f74ab-3a57-45e5-9810-cf437f903d06 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:12.213909 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31f74ab-3a57-45e5-9810-cf437f903d06 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:12.216599 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31f74ab-3a57-45e5-9810-cf437f903d06 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:12.224951 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:12.245254 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-a31f74ab-3a57-45e5-9810-cf437f903d06 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 15:16:12.245254 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:16:12.245254 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:16:12.245254 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:16:12.245254 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:16:12.245254 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:16:12.245254 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:16:12.245254 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:16:12.245254 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:16:12.245254 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:16:12.245254 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:16:12.245254 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:16:12.245254 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 15:16:12.245254 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 15:16:12.245254 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 15:16:12.245254 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 15:16:12.246387 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:16:12.246387 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:16:12.246387 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:16:12.246387 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:16:12.246387 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:16:12.246387 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:16:12.246387 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:16:12.246387 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Sep 13 15:16:12.246387 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:16:12.246387 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:16:12.246387 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:16:12.246387 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:16:12.246387 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:16:12.246387 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:16:12.246387 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:16:12.246387 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:16:12.246387 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 15:16:12.247479 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 15:16:12.247479 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 15:16:12.247479 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Sep 13 15:16:12.256267 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 387/792] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 13 15:16:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:16:12.261729 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31f74ab-3a57-45e5-9810-cf437f903d06 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:12.355496 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc32237f-1f7d-4794-b042-db45e445eb61 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:12.394583 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b54e0e-44e5-4e1b-bf1d-4ce96da99cb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:12.395908 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b54e0e-44e5-4e1b-bf1d-4ce96da99cb0 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:12.396340 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b54e0e-44e5-4e1b-bf1d-4ce96da99cb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:12.396525 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b54e0e-44e5-4e1b-bf1d-4ce96da99cb0 None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:12.397360 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b54e0e-44e5-4e1b-bf1d-4ce96da99cb0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:16:12.397675 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b54e0e-44e5-4e1b-bf1d-4ce96da99cb0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:12.399085 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b54e0e-44e5-4e1b-bf1d-4ce96da99cb0 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:12.408758 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 406/793] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Sep 13 15:16:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 15:16:12.417841 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b54e0e-44e5-4e1b-bf1d-4ce96da99cb0 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:12.469151 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31f74ab-3a57-45e5-9810-cf437f903d06 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:12.470653 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:12.566963 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b54e0e-44e5-4e1b-bf1d-4ce96da99cb0 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:12.574406 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3090bcdf-b830-4228-b2cd-d06d33495619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:12.575209 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3090bcdf-b830-4228-b2cd-d06d33495619 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:12.575647 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3090bcdf-b830-4228-b2cd-d06d33495619 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:12.576103 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3090bcdf-b830-4228-b2cd-d06d33495619 None admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:12.576904 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3090bcdf-b830-4228-b2cd-d06d33495619 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:16:12.577374 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3090bcdf-b830-4228-b2cd-d06d33495619 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:12.578928 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3090bcdf-b830-4228-b2cd-d06d33495619 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:12.591859 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 388/794] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Sep 13 15:16:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 15:16:12.599443 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3090bcdf-b830-4228-b2cd-d06d33495619 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:12.607246 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaa112b-535f-4596-a83e-58bfddd0cd0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:12.608012 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaa112b-535f-4596-a83e-58bfddd0cd0a None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:12.608388 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaa112b-535f-4596-a83e-58bfddd0cd0a None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:12.609434 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaa112b-535f-4596-a83e-58bfddd0cd0a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:12.629463 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edaa112b-535f-4596-a83e-58bfddd0cd0a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:12.632722 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edaa112b-535f-4596-a83e-58bfddd0cd0a None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:12.658371 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-edaa112b-535f-4596-a83e-58bfddd0cd0a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 15:16:12.658371 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:16:12.658371 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:16:12.658371 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:16:12.658371 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:16:12.658371 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:16:12.658371 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:16:12.658371 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:16:12.658371 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:16:12.658371 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:16:12.658371 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:16:12.658371 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:16:12.658371 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 15:16:12.658371 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 15:16:12.658371 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 15:16:12.658371 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 15:16:12.659561 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:16:12.659561 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:16:12.659561 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:16:12.659561 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:16:12.659561 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:16:12.659561 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:16:12.659561 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:16:12.659561 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Sep 13 15:16:12.659561 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:16:12.659561 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:16:12.659561 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:16:12.659561 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:16:12.659561 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:16:12.659561 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:16:12.659561 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:16:12.659561 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:16:12.659561 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 15:16:12.661336 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 15:16:12.661336 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 15:16:12.661336 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Sep 13 15:16:12.668030 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 407/795] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 13 15:16:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:16:12.668030 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa067688-dd9d-4f09-937d-9d6ef1d15e02 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:12.668030 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa067688-dd9d-4f09-937d-9d6ef1d15e02 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:12.668030 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa067688-dd9d-4f09-937d-9d6ef1d15e02 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:12.671125 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 408/796] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:16:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:16:12.673013 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa067688-dd9d-4f09-937d-9d6ef1d15e02 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:12.689040 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:12.750214 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3090bcdf-b830-4228-b2cd-d06d33495619 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:12.788745 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:12.801278 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf7439e-1c48-44cd-b846-6ecf2e07b0a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:12.802176 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf7439e-1c48-44cd-b846-6ecf2e07b0a8 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:12.802566 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf7439e-1c48-44cd-b846-6ecf2e07b0a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:12.802924 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf7439e-1c48-44cd-b846-6ecf2e07b0a8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:12.810371 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf7439e-1c48-44cd-b846-6ecf2e07b0a8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:12.811954 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf7439e-1c48-44cd-b846-6ecf2e07b0a8 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:12.819265 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa067688-dd9d-4f09-937d-9d6ef1d15e02 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:12.859741 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f10fc9-3fa6-442e-907c-f88805ae6a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:12.860721 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f10fc9-3fa6-442e-907c-f88805ae6a94 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:12.861154 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f10fc9-3fa6-442e-907c-f88805ae6a94 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:12.861695 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f10fc9-3fa6-442e-907c-f88805ae6a94 None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:12.862551 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f10fc9-3fa6-442e-907c-f88805ae6a94 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:16:12.863016 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f10fc9-3fa6-442e-907c-f88805ae6a94 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:12.864649 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f10fc9-3fa6-442e-907c-f88805ae6a94 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:12.884243 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 409/797] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Sep 13 15:16:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:16:12.886070 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8da3e0-c1ad-4883-9ff8-7011369d5924 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:12.886541 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8da3e0-c1ad-4883-9ff8-7011369d5924 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:12.886973 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8da3e0-c1ad-4883-9ff8-7011369d5924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:12.908157 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-ab8da3e0-c1ad-4883-9ff8-7011369d5924 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:16:12.909724 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-ab8da3e0-c1ad-4883-9ff8-7011369d5924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:16:12.940844 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-daf7439e-1c48-44cd-b846-6ecf2e07b0a8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 15:16:12.940844 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:16:12.940844 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:16:12.940844 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:16:12.940844 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:16:12.940844 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:16:12.940844 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:16:12.940844 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:16:12.940844 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:16:12.940844 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:16:12.940844 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:16:12.940844 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:16:12.940844 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 15:16:12.940844 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 15:16:12.940844 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 15:16:12.942305 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 15:16:12.942305 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:16:12.942305 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:16:12.942305 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:16:12.942305 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:16:12.942305 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:16:12.942305 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:16:12.942305 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:16:12.942305 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Sep 13 15:16:12.942305 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:16:12.942305 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:16:12.942305 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:16:12.942305 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:16:12.942305 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:16:12.942305 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:16:12.942305 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:16:12.942305 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:16:12.943380 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 15:16:12.943380 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 15:16:12.943380 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 15:16:12.943380 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 15:16:12.943380 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 15:16:12.943380 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 15:16:12.943380 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 15:16:12.943380 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Sep 13 15:16:12.945172 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 389/798] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Sep 13 15:16:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 347 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:16:12.946166 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf7439e-1c48-44cd-b846-6ecf2e07b0a8 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:12.996793 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 410/799] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:16:12 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 15:16:12.997976 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8da3e0-c1ad-4883-9ff8-7011369d5924 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:13.081478 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:13.117234 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8da3e0-c1ad-4883-9ff8-7011369d5924 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:13.134740 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf7439e-1c48-44cd-b846-6ecf2e07b0a8 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:13.161900 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:13.180196 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b23dc4d-f681-4bb2-ac64-396198a06454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:13.180863 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b23dc4d-f681-4bb2-ac64-396198a06454 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:13.181153 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b23dc4d-f681-4bb2-ac64-396198a06454 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:13.181431 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b23dc4d-f681-4bb2-ac64-396198a06454 None admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:13.182604 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b23dc4d-f681-4bb2-ac64-396198a06454 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:16:13.182928 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b23dc4d-f681-4bb2-ac64-396198a06454 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:13.184376 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b23dc4d-f681-4bb2-ac64-396198a06454 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:13.198878 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b601508-d981-42f4-9390-fe2d1721fdf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:13.199570 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b601508-d981-42f4-9390-fe2d1721fdf1 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:13.199917 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b601508-d981-42f4-9390-fe2d1721fdf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:13.200253 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b601508-d981-42f4-9390-fe2d1721fdf1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:13.205979 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 411/800] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Sep 13 15:16:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:16:13.211205 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b23dc4d-f681-4bb2-ac64-396198a06454 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:13.215824 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b601508-d981-42f4-9390-fe2d1721fdf1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:13.217269 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b601508-d981-42f4-9390-fe2d1721fdf1 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:13.238204 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-2b601508-d981-42f4-9390-fe2d1721fdf1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 13 15:16:13.238204 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:16:13.238204 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:16:13.238204 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:16:13.238204 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:16:13.238204 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:16:13.238204 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:16:13.238204 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:16:13.238204 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:16:13.238204 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:16:13.238204 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:16:13.238204 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:16:13.238204 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 15:16:13.238204 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 15:16:13.238204 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 15:16:13.238204 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 15:16:13.239215 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:16:13.239215 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:16:13.239215 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 15:16:13.239215 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 15:16:13.239215 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 15:16:13.239215 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 15:16:13.239215 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:16:13.239215 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:16:13.239215 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:16:13.239215 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:16:13.239215 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:16:13.239215 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Sep 13 15:16:13.239215 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:16:13.239215 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:16:13.239215 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:16:13.239215 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:16:13.239215 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:16:13.239215 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:16:13.240161 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:16:13.240161 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:16:13.240161 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 15:16:13.240161 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 15:16:13.240161 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 15:16:13.240161 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 15:16:13.240161 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 15:16:13.240161 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 15:16:13.240161 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 13 15:16:13.240161 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Sep 13 15:16:13.241235 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 390/801] 10.222.0.27 () {56 vars in 1093 bytes} [Tue Sep 13 15:16:12 2022] GET /identity/v3/users/nova => generated 82 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:16:13.249274 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b601508-d981-42f4-9390-fe2d1721fdf1 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:13.366191 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b23dc4d-f681-4bb2-ac64-396198a06454 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:13.388125 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b601508-d981-42f4-9390-fe2d1721fdf1 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:13.403032 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:13.415878 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e254f8a2-1ef8-40f0-8f05-7066d1219af8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:13.417053 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e254f8a2-1ef8-40f0-8f05-7066d1219af8 None admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:13.417842 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e254f8a2-1ef8-40f0-8f05-7066d1219af8 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:13.418767 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e254f8a2-1ef8-40f0-8f05-7066d1219af8 None admin] PATH_INFO: `/v3/projects/3d6e00339cfa47d2a6fa8724c587035f/users/dc735644be394e0abe73e709373e2003/roles/f34412ad29f1478cba775b033129f71f` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:13.421906 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e254f8a2-1ef8-40f0-8f05-7066d1219af8 None admin] RBAC: Authorizing `identity:create_grant(project_id=3d6e00339cfa47d2a6fa8724c587035f, user_id=dc735644be394e0abe73e709373e2003, role_id=f34412ad29f1478cba775b033129f71f)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:13.424111 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e254f8a2-1ef8-40f0-8f05-7066d1219af8 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:13.429971 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57daa6a-e8b1-4344-bab3-ea4c48663761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:13.430556 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57daa6a-e8b1-4344-bab3-ea4c48663761 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:13.430894 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57daa6a-e8b1-4344-bab3-ea4c48663761 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:13.431171 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57daa6a-e8b1-4344-bab3-ea4c48663761 None admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:13.432135 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57daa6a-e8b1-4344-bab3-ea4c48663761 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:16:13.432471 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57daa6a-e8b1-4344-bab3-ea4c48663761 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:13.433905 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57daa6a-e8b1-4344-bab3-ea4c48663761 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:13.443438 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 412/802] 10.222.0.27 () {58 vars in 1439 bytes} [Tue Sep 13 15:16:13 2022] PUT /identity/v3/projects/3d6e00339cfa47d2a6fa8724c587035f/users/dc735644be394e0abe73e709373e2003/roles/f34412ad29f1478cba775b033129f71f => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:16:13.445251 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e254f8a2-1ef8-40f0-8f05-7066d1219af8 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:13.460598 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 391/803] 10.222.0.27 () {56 vars in 1133 bytes} [Tue Sep 13 15:16:13 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:16:13.471843 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57daa6a-e8b1-4344-bab3-ea4c48663761 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:13.535449 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:13.580210 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e254f8a2-1ef8-40f0-8f05-7066d1219af8 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:13.625197 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3767eb1e-cb49-44d4-8d2c-b1fec15187e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:13.626155 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3767eb1e-cb49-44d4-8d2c-b1fec15187e4 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:13.626594 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3767eb1e-cb49-44d4-8d2c-b1fec15187e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:13.627055 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3767eb1e-cb49-44d4-8d2c-b1fec15187e4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:13.642461 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3767eb1e-cb49-44d4-8d2c-b1fec15187e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 15:16:13.648863 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-3767eb1e-cb49-44d4-8d2c-b1fec15187e4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 15:16:13.648863 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:16:13.648863 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:16:13.648863 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:16:13.648863 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:16:13.648863 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:16:13.648863 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:16:13.648863 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:16:13.648863 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:16:13.648863 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:16:13.648863 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:16:13.648863 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:16:13.648863 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 15:16:13.648863 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 15:16:13.648863 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 15:16:13.648863 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 15:16:13.650056 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 15:16:13.650056 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 15:16:13.650056 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 15:16:13.650056 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 15:16:13.650056 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:16:13.650056 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:16:13.650056 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:16:13.650056 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:16:13.650056 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:16:13.650056 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:16:13.650056 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:16:13.650056 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Sep 13 15:16:13.650056 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:16:13.650056 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:16:13.650056 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:16:13.650056 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:16:13.650894 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:16:13.650894 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:16:13.650894 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:16:13.650894 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:16:13.650894 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 15:16:13.650894 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 15:16:13.650894 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 15:16:13.650894 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 15:16:13.650894 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 15:16:13.650894 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 15:16:13.650894 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 15:16:13.650894 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Sep 13 15:16:13.653678 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 413/804] 10.222.0.27 () {56 vars in 1102 bytes} [Tue Sep 13 15:16:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:16:13.659940 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3767eb1e-cb49-44d4-8d2c-b1fec15187e4 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:13.687690 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57daa6a-e8b1-4344-bab3-ea4c48663761 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:13.729994 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:13.758638 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e369117f-36ce-4994-929e-4397b9f4a076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:13.759254 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e369117f-36ce-4994-929e-4397b9f4a076 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:13.759537 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e369117f-36ce-4994-929e-4397b9f4a076 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:13.759810 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e369117f-36ce-4994-929e-4397b9f4a076 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:13.797570 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3767eb1e-cb49-44d4-8d2c-b1fec15187e4 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:13.836602 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04372b0-4332-46b8-b49f-ce1208e9803d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:13.837615 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04372b0-4332-46b8-b49f-ce1208e9803d None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:13.838145 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04372b0-4332-46b8-b49f-ce1208e9803d None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:13.838611 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04372b0-4332-46b8-b49f-ce1208e9803d None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:13.839691 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04372b0-4332-46b8-b49f-ce1208e9803d None admin] RBAC: Adding query filter params (name=service) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:16:13.840204 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04372b0-4332-46b8-b49f-ce1208e9803d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:13.841947 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04372b0-4332-46b8-b49f-ce1208e9803d None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:13.851035 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e369117f-36ce-4994-929e-4397b9f4a076 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:13.851997 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 414/805] 10.222.0.27 () {56 vars in 1103 bytes} [Tue Sep 13 15:16:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:16:13.852502 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e369117f-36ce-4994-929e-4397b9f4a076 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:13.853789 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaed9b06-4daf-417c-9651-cb3ba35de54f None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:13.854324 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaed9b06-4daf-417c-9651-cb3ba35de54f None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:13.854996 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaed9b06-4daf-417c-9651-cb3ba35de54f None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:13.856983 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 415/806] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:16:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:16:13.858000 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaed9b06-4daf-417c-9651-cb3ba35de54f None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:13.896200 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:13.978666 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaed9b06-4daf-417c-9651-cb3ba35de54f None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:13.996947 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 392/807] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Sep 13 15:16:13 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 521 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 13 15:16:13.996947 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10445b18-c054-439c-b088-5386d95d78eb None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:13.996947 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10445b18-c054-439c-b088-5386d95d78eb None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:13.996947 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10445b18-c054-439c-b088-5386d95d78eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:13.999254 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:14.020601 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-10445b18-c054-439c-b088-5386d95d78eb None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:16:14.021885 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-10445b18-c054-439c-b088-5386d95d78eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:16:14.024135 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c042ccca-f368-4614-8d21-c11653c941b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:14.025077 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c042ccca-f368-4614-8d21-c11653c941b6 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:14.025569 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c042ccca-f368-4614-8d21-c11653c941b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:14.026073 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c042ccca-f368-4614-8d21-c11653c941b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:14.038223 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c042ccca-f368-4614-8d21-c11653c941b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:14.039993 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c042ccca-f368-4614-8d21-c11653c941b6 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:14.055957 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-c042ccca-f368-4614-8d21-c11653c941b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 15:16:14.055957 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:16:14.055957 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:16:14.055957 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:16:14.055957 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:16:14.055957 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:16:14.055957 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:16:14.055957 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:16:14.055957 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:16:14.055957 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:16:14.055957 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:16:14.055957 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:16:14.055957 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 15:16:14.055957 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 15:16:14.055957 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 15:16:14.055957 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 15:16:14.057000 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:16:14.057000 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:16:14.057000 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:16:14.057000 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:16:14.057000 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:16:14.057000 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:16:14.057000 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:16:14.057000 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Sep 13 15:16:14.057000 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:16:14.057000 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:16:14.057000 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:16:14.057000 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:16:14.057000 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:16:14.057000 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:16:14.057000 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:16:14.057000 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:16:14.057000 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 15:16:14.057915 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 15:16:14.057915 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 15:16:14.057915 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Sep 13 15:16:14.060364 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 416/808] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 13 15:16:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:16:14.061613 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c042ccca-f368-4614-8d21-c11653c941b6 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:14.108739 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 393/809] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:16:13 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 15:16:14.109609 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10445b18-c054-439c-b088-5386d95d78eb None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:14.188235 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:14.238496 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10445b18-c054-439c-b088-5386d95d78eb None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:14.275930 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c042ccca-f368-4614-8d21-c11653c941b6 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:14.290436 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3b658b-8060-4b04-a4a5-c14cb7786442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:14.291297 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3b658b-8060-4b04-a4a5-c14cb7786442 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:14.291730 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3b658b-8060-4b04-a4a5-c14cb7786442 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:14.292183 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3b658b-8060-4b04-a4a5-c14cb7786442 None admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:14.292980 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3b658b-8060-4b04-a4a5-c14cb7786442 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:16:14.293437 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3b658b-8060-4b04-a4a5-c14cb7786442 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:14.295022 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3b658b-8060-4b04-a4a5-c14cb7786442 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:14.309673 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 394/810] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Sep 13 15:16:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:16:14.314730 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3b658b-8060-4b04-a4a5-c14cb7786442 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:14.355637 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72f03ad-fe87-4835-be8a-9cf217c59a07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:14.356581 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72f03ad-fe87-4835-be8a-9cf217c59a07 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:14.358184 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72f03ad-fe87-4835-be8a-9cf217c59a07 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:14.358401 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72f03ad-fe87-4835-be8a-9cf217c59a07 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:14.457869 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3b658b-8060-4b04-a4a5-c14cb7786442 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:14.484947 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:14.487811 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72f03ad-fe87-4835-be8a-9cf217c59a07 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:14.490039 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72f03ad-fe87-4835-be8a-9cf217c59a07 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:14.499767 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549391da-ecc9-49a9-8d7a-aaae77cb0d96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:14.500579 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549391da-ecc9-49a9-8d7a-aaae77cb0d96 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:14.500865 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549391da-ecc9-49a9-8d7a-aaae77cb0d96 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:14.501141 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549391da-ecc9-49a9-8d7a-aaae77cb0d96 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:14.505624 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-e72f03ad-fe87-4835-be8a-9cf217c59a07 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 15:16:14.505624 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:16:14.505624 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:16:14.505624 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:16:14.505624 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:16:14.505624 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:16:14.505624 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:16:14.505624 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:16:14.505624 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:16:14.505624 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:16:14.505624 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:16:14.505624 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:16:14.505624 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 15:16:14.505624 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 15:16:14.505624 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 15:16:14.505624 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 15:16:14.506669 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:16:14.506669 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:16:14.506669 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:16:14.506669 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:16:14.506669 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:16:14.506669 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:16:14.506669 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:16:14.506669 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Sep 13 15:16:14.506669 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:16:14.506669 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:16:14.506669 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:16:14.506669 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:16:14.506669 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:16:14.506669 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:16:14.506669 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:16:14.506669 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:16:14.506669 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 15:16:14.512765 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 15:16:14.512765 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 15:16:14.512765 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Sep 13 15:16:14.512765 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 417/811] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 13 15:16:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 446 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:16:14.512765 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c05af2f-8ccf-427d-9926-66d66ddd3eca None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:14.512765 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c05af2f-8ccf-427d-9926-66d66ddd3eca None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:14.512765 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c05af2f-8ccf-427d-9926-66d66ddd3eca None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:14.512765 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 418/812] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:16:14 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:16:14.512765 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c05af2f-8ccf-427d-9926-66d66ddd3eca None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:14.515417 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549391da-ecc9-49a9-8d7a-aaae77cb0d96 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:14.517824 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549391da-ecc9-49a9-8d7a-aaae77cb0d96 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:14.530579 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-549391da-ecc9-49a9-8d7a-aaae77cb0d96 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 13 15:16:14.530579 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:16:14.530579 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:16:14.530579 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:16:14.530579 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:16:14.530579 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:16:14.530579 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:16:14.530579 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:16:14.530579 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:16:14.530579 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:16:14.530579 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:16:14.530579 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:16:14.530579 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 15:16:14.530579 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 15:16:14.530579 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 15:16:14.530579 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 15:16:14.531717 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:16:14.531717 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:16:14.531717 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 15:16:14.531717 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 15:16:14.531717 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 15:16:14.531717 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 15:16:14.531717 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:16:14.531717 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:16:14.531717 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:16:14.531717 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:16:14.531717 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:16:14.531717 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Sep 13 15:16:14.531717 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:16:14.531717 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:16:14.531717 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:16:14.531717 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:16:14.531717 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:16:14.531717 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:16:14.532826 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:16:14.532826 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:16:14.532826 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 15:16:14.532826 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 15:16:14.532826 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 15:16:14.532826 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 15:16:14.532826 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 15:16:14.532826 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 15:16:14.532826 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 13 15:16:14.532826 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Sep 13 15:16:14.533405 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:14.536949 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 395/813] 10.222.0.27 () {56 vars in 1117 bytes} [Tue Sep 13 15:16:14 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 15:16:14.537825 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549391da-ecc9-49a9-8d7a-aaae77cb0d96 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:14.623488 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c05af2f-8ccf-427d-9926-66d66ddd3eca None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:14.646992 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549391da-ecc9-49a9-8d7a-aaae77cb0d96 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:14.657695 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e705dc-9348-4e42-b0e1-a2b233ff268e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:14.658347 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e705dc-9348-4e42-b0e1-a2b233ff268e None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:14.658628 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e705dc-9348-4e42-b0e1-a2b233ff268e None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:14.658910 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e705dc-9348-4e42-b0e1-a2b233ff268e None admin] PATH_INFO: `/v3/services/network` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:14.659485 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e705dc-9348-4e42-b0e1-a2b233ff268e None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:14.661682 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e705dc-9348-4e42-b0e1-a2b233ff268e None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:14.670642 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-30e705dc-9348-4e42-b0e1-a2b233ff268e None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 13 15:16:14.670642 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:16:14.670642 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 15:16:14.670642 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 15:16:14.670642 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 15:16:14.670642 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 15:16:14.670642 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 15:16:14.670642 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 15:16:14.670642 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 13 15:16:14.670642 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Sep 13 15:16:14.670642 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 15:16:14.670642 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Sep 13 15:16:14.670642 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:16:14.670642 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:16:14.670642 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:16:14.670642 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:16:14.670642 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:16:14.671631 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:16:14.671631 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:16:14.671631 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:16:14.671631 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:16:14.671631 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:16:14.671631 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:16:14.671631 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 15:16:14.671631 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 15:16:14.671631 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 15:16:14.671631 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 15:16:14.671631 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:16:14.671631 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:16:14.671631 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:16:14.671631 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:16:14.671631 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:16:14.671631 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:16:14.672482 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:16:14.672482 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Sep 13 15:16:14.672482 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:16:14.672482 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:16:14.672482 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:16:14.672482 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:16:14.672482 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:16:14.672482 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:16:14.672482 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:16:14.672482 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:16:14.672482 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 15:16:14.672482 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 15:16:14.672482 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 13 15:16:14.672482 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Sep 13 15:16:14.672482 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 419/814] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Sep 13 15:16:14 2022] GET /identity/v3/services/network => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:16:14.673291 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea66f78-c9c9-49b4-b5cb-f25b40ccea37 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:14.675206 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea66f78-c9c9-49b4-b5cb-f25b40ccea37 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:14.675206 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea66f78-c9c9-49b4-b5cb-f25b40ccea37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:14.688622 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76cf20e-d41d-48b2-bacc-0df0fde70f41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:14.689224 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76cf20e-d41d-48b2-bacc-0df0fde70f41 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:14.689501 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76cf20e-d41d-48b2-bacc-0df0fde70f41 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:14.689802 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76cf20e-d41d-48b2-bacc-0df0fde70f41 None admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:14.690433 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76cf20e-d41d-48b2-bacc-0df0fde70f41 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:16:14.690741 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76cf20e-d41d-48b2-bacc-0df0fde70f41 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:14.691513 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-5ea66f78-c9c9-49b4-b5cb-f25b40ccea37 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:16:14.692356 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76cf20e-d41d-48b2-bacc-0df0fde70f41 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:14.692961 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-5ea66f78-c9c9-49b4-b5cb-f25b40ccea37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:16:14.706905 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 396/815] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Sep 13 15:16:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:16:14.712809 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76cf20e-d41d-48b2-bacc-0df0fde70f41 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:14.765343 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:14.769464 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 420/816] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:16:14 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 15:16:14.771371 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea66f78-c9c9-49b4-b5cb-f25b40ccea37 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:14.783006 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:14.844897 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76cf20e-d41d-48b2-bacc-0df0fde70f41 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:14.885841 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64753922-a268-4ab9-a921-6ad4206b93aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:14.886665 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea66f78-c9c9-49b4-b5cb-f25b40ccea37 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:14.887086 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64753922-a268-4ab9-a921-6ad4206b93aa None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:14.887576 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64753922-a268-4ab9-a921-6ad4206b93aa None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:14.888155 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64753922-a268-4ab9-a921-6ad4206b93aa None admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:14.889282 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64753922-a268-4ab9-a921-6ad4206b93aa None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:16:14.889854 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64753922-a268-4ab9-a921-6ad4206b93aa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:14.891476 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64753922-a268-4ab9-a921-6ad4206b93aa None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:14.917664 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 397/817] 10.222.0.27 () {56 vars in 1149 bytes} [Tue Sep 13 15:16:14 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:16:14.919089 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64753922-a268-4ab9-a921-6ad4206b93aa None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:14.929155 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ab189b-1936-41bf-b062-de78b54ecbf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:14.929862 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ab189b-1936-41bf-b062-de78b54ecbf5 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:14.930145 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ab189b-1936-41bf-b062-de78b54ecbf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:14.930471 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ab189b-1936-41bf-b062-de78b54ecbf5 None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:14.931104 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ab189b-1936-41bf-b062-de78b54ecbf5 None admin] RBAC: Adding query filter params (name=network) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:16:14.931407 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ab189b-1936-41bf-b062-de78b54ecbf5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:14.932934 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ab189b-1936-41bf-b062-de78b54ecbf5 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:14.938164 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 421/818] 10.222.0.27 () {56 vars in 1112 bytes} [Tue Sep 13 15:16:14 2022] GET /identity/v3/services?name=network => generated 124 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:16:14.939147 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ab189b-1936-41bf-b062-de78b54ecbf5 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:15.021820 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:15.041238 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64753922-a268-4ab9-a921-6ad4206b93aa None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:15.043312 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:15.049002 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ab189b-1936-41bf-b062-de78b54ecbf5 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:15.081475 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472a529e-dcdd-4768-be2d-7cab40ed7a0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:15.082151 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472a529e-dcdd-4768-be2d-7cab40ed7a0b None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:15.082667 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472a529e-dcdd-4768-be2d-7cab40ed7a0b None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:15.082906 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472a529e-dcdd-4768-be2d-7cab40ed7a0b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:15.085060 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e257107-b5c2-478b-9ebd-821e951a7746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:15.085688 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e257107-b5c2-478b-9ebd-821e951a7746 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:15.085995 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e257107-b5c2-478b-9ebd-821e951a7746 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:15.086270 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e257107-b5c2-478b-9ebd-821e951a7746 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:15.089952 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472a529e-dcdd-4768-be2d-7cab40ed7a0b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:15.091390 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472a529e-dcdd-4768-be2d-7cab40ed7a0b None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:15.096609 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e257107-b5c2-478b-9ebd-821e951a7746 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:15.098608 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e257107-b5c2-478b-9ebd-821e951a7746 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:15.103372 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-472a529e-dcdd-4768-be2d-7cab40ed7a0b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 15:16:15.103372 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:16:15.103372 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:16:15.103372 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:16:15.103372 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:16:15.103372 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:16:15.103372 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:16:15.103372 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:16:15.103372 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:16:15.103372 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:16:15.103372 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:16:15.103372 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:16:15.103372 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 15:16:15.103372 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 15:16:15.103372 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 15:16:15.104274 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 15:16:15.104274 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:16:15.104274 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:16:15.104274 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:16:15.104274 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:16:15.104274 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:16:15.104274 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:16:15.104274 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:16:15.104274 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Sep 13 15:16:15.104274 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:16:15.104274 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:16:15.104274 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:16:15.104274 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:16:15.104274 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:16:15.104274 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:16:15.104274 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:16:15.104274 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:16:15.105284 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 15:16:15.105284 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 15:16:15.105284 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 15:16:15.105284 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 15:16:15.105284 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 15:16:15.105284 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 15:16:15.105284 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 15:16:15.105284 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Sep 13 15:16:15.109218 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 398/819] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Sep 13 15:16:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:16:15.109952 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472a529e-dcdd-4768-be2d-7cab40ed7a0b None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:15.114265 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-2e257107-b5c2-478b-9ebd-821e951a7746 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 15:16:15.114265 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:16:15.114265 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:16:15.114265 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:16:15.114265 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:16:15.114265 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:16:15.114265 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:16:15.114265 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:16:15.114265 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:16:15.114265 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:16:15.114265 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:16:15.114265 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:16:15.114265 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 15:16:15.114265 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 15:16:15.114265 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 15:16:15.114265 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 15:16:15.115198 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:16:15.115198 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:16:15.115198 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:16:15.115198 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:16:15.115198 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:16:15.115198 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:16:15.115198 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:16:15.115198 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Sep 13 15:16:15.115198 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:16:15.115198 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:16:15.115198 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:16:15.115198 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:16:15.115198 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:16:15.115198 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:16:15.115198 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:16:15.115198 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:16:15.115198 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 15:16:15.116109 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 15:16:15.116109 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 15:16:15.116109 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Sep 13 15:16:15.116109 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 422/820] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 13 15:16:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:16:15.116332 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e257107-b5c2-478b-9ebd-821e951a7746 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:15.221559 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472a529e-dcdd-4768-be2d-7cab40ed7a0b None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:15.225206 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e257107-b5c2-478b-9ebd-821e951a7746 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:15.251125 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:15.257105 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a1ba57-c2b4-4edc-9832-64a1b46f2476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:15.257638 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a1ba57-c2b4-4edc-9832-64a1b46f2476 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:15.257947 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a1ba57-c2b4-4edc-9832-64a1b46f2476 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:15.258221 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a1ba57-c2b4-4edc-9832-64a1b46f2476 None admin] PATH_INFO: `/v3/services` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:15.258898 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a1ba57-c2b4-4edc-9832-64a1b46f2476 None admin] RBAC: Adding query filter params (type=network) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:16:15.259151 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a1ba57-c2b4-4edc-9832-64a1b46f2476 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:15.260506 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a1ba57-c2b4-4edc-9832-64a1b46f2476 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:15.261346 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4096f773-1687-4004-9cec-463103aa26d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:15.262200 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4096f773-1687-4004-9cec-463103aa26d2 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:15.262784 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4096f773-1687-4004-9cec-463103aa26d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:15.263078 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4096f773-1687-4004-9cec-463103aa26d2 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:15.263662 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4096f773-1687-4004-9cec-463103aa26d2 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:15.265021 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4096f773-1687-4004-9cec-463103aa26d2 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:15.270876 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 399/821] 10.222.0.27 () {56 vars in 1112 bytes} [Tue Sep 13 15:16:15 2022] GET /identity/v3/services?type=network => generated 350 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:16:15.270876 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a1ba57-c2b4-4edc-9832-64a1b46f2476 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:15.280745 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-4096f773-1687-4004-9cec-463103aa26d2 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 13 15:16:15.280745 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:16:15.280745 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 15:16:15.280745 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 15:16:15.280745 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 15:16:15.280745 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 15:16:15.280745 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 15:16:15.280745 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 15:16:15.280745 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 13 15:16:15.280745 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Sep 13 15:16:15.280745 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 15:16:15.280745 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Sep 13 15:16:15.280745 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:16:15.280745 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:16:15.280745 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:16:15.280745 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:16:15.280745 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:16:15.282276 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:16:15.282276 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:16:15.282276 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:16:15.282276 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:16:15.282276 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:16:15.282276 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:16:15.282276 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 15:16:15.282276 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 15:16:15.282276 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 15:16:15.282276 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 15:16:15.282276 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:16:15.282276 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:16:15.282276 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:16:15.282276 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:16:15.282276 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:16:15.282276 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:16:15.283131 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:16:15.283131 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Sep 13 15:16:15.283131 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:16:15.283131 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:16:15.283131 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:16:15.283131 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:16:15.283131 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:16:15.283131 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:16:15.283131 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:16:15.283131 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:16:15.283131 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 15:16:15.283131 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 15:16:15.283131 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 13 15:16:15.283131 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Sep 13 15:16:15.283131 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 423/822] 10.222.0.27 () {56 vars in 1129 bytes} [Tue Sep 13 15:16:15 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:16:15.283930 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4096f773-1687-4004-9cec-463103aa26d2 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:15.305957 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:15.387102 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a1ba57-c2b4-4edc-9832-64a1b46f2476 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:15.387680 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4096f773-1687-4004-9cec-463103aa26d2 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:15.423635 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a6f410-8c6a-4aa4-9443-eb82c71f7be1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:15.424241 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a6f410-8c6a-4aa4-9443-eb82c71f7be1 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:15.424523 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a6f410-8c6a-4aa4-9443-eb82c71f7be1 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:15.424802 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a6f410-8c6a-4aa4-9443-eb82c71f7be1 None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:15.425102 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bfa8a5-4c48-47c8-98b6-161d1b3b9644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:15.425455 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a6f410-8c6a-4aa4-9443-eb82c71f7be1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:16:15.425750 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bfa8a5-4c48-47c8-98b6-161d1b3b9644 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:15.425863 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a6f410-8c6a-4aa4-9443-eb82c71f7be1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:15.426094 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bfa8a5-4c48-47c8-98b6-161d1b3b9644 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:15.426350 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bfa8a5-4c48-47c8-98b6-161d1b3b9644 None admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:15.427134 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bfa8a5-4c48-47c8-98b6-161d1b3b9644 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:16:15.427236 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a6f410-8c6a-4aa4-9443-eb82c71f7be1 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:15.427443 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bfa8a5-4c48-47c8-98b6-161d1b3b9644 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:15.429052 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bfa8a5-4c48-47c8-98b6-161d1b3b9644 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:15.443500 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 424/823] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Sep 13 15:16:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:16:15.443500 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a6f410-8c6a-4aa4-9443-eb82c71f7be1 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:15.451536 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 400/824] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Sep 13 15:16:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:16:15.452245 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bfa8a5-4c48-47c8-98b6-161d1b3b9644 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:15.496419 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:15.549682 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:15.553087 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a6f410-8c6a-4aa4-9443-eb82c71f7be1 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:15.565188 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bfa8a5-4c48-47c8-98b6-161d1b3b9644 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:15.589305 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fff1816-6063-4760-881b-3e88869deb52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:15.590013 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fff1816-6063-4760-881b-3e88869deb52 None admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:15.590297 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fff1816-6063-4760-881b-3e88869deb52 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:15.590578 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fff1816-6063-4760-881b-3e88869deb52 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:15.591245 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fff1816-6063-4760-881b-3e88869deb52 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:15.592608 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fff1816-6063-4760-881b-3e88869deb52 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:15.603055 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13da561-7258-4502-8498-48ee71e5e42c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:15.604089 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13da561-7258-4502-8498-48ee71e5e42c None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:15.604589 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13da561-7258-4502-8498-48ee71e5e42c None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:15.605041 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13da561-7258-4502-8498-48ee71e5e42c None admin] PATH_INFO: `/v3/services` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:15.605802 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13da561-7258-4502-8498-48ee71e5e42c None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:16:15.606132 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13da561-7258-4502-8498-48ee71e5e42c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:15.607567 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13da561-7258-4502-8498-48ee71e5e42c None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:15.612478 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 401/825] 10.222.0.27 () {56 vars in 1124 bytes} [Tue Sep 13 15:16:15 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:16:15.621720 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 425/826] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 13 15:16:15 2022] POST /identity/v3/endpoints => generated 337 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:16:15.621925 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13da561-7258-4502-8498-48ee71e5e42c None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:15.622020 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fff1816-6063-4760-881b-3e88869deb52 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:15.755176 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13da561-7258-4502-8498-48ee71e5e42c None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:15.767955 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fff1816-6063-4760-881b-3e88869deb52 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:15.770747 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:15.796115 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d23dbb-a300-471e-b4e1-e1e51324280e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:15.796489 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d23dbb-a300-471e-b4e1-e1e51324280e None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:15.796825 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d23dbb-a300-471e-b4e1-e1e51324280e None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:15.797096 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d23dbb-a300-471e-b4e1-e1e51324280e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:15.805302 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d23dbb-a300-471e-b4e1-e1e51324280e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:15.807620 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d23dbb-a300-471e-b4e1-e1e51324280e None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:15.812757 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816ca2f0-665b-47b5-ba29-c92418e94af9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:15.813373 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816ca2f0-665b-47b5-ba29-c92418e94af9 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:15.813656 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816ca2f0-665b-47b5-ba29-c92418e94af9 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:15.813960 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816ca2f0-665b-47b5-ba29-c92418e94af9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:15.814700 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816ca2f0-665b-47b5-ba29-c92418e94af9 None admin] RBAC: Adding query filter params (role.id=f34412ad29f1478cba775b033129f71f, scope.project.id=3d6e00339cfa47d2a6fa8724c587035f, user.id=62aad71c6c1a4469805762bba330bf0e) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:16:15.815022 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816ca2f0-665b-47b5-ba29-c92418e94af9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:15.816516 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816ca2f0-665b-47b5-ba29-c92418e94af9 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:15.820976 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-36d23dbb-a300-471e-b4e1-e1e51324280e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 15:16:15.820976 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:16:15.820976 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:16:15.820976 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:16:15.820976 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:16:15.820976 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:16:15.820976 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:16:15.820976 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:16:15.820976 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:16:15.820976 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:16:15.820976 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:16:15.820976 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:16:15.820976 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 15:16:15.820976 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 15:16:15.820976 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 15:16:15.821904 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 15:16:15.821904 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:16:15.821904 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:16:15.821904 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:16:15.821904 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:16:15.821904 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:16:15.821904 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:16:15.821904 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:16:15.821904 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Sep 13 15:16:15.821904 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:16:15.821904 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:16:15.821904 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:16:15.821904 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:16:15.821904 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:16:15.821904 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:16:15.821904 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:16:15.821904 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:16:15.822815 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 15:16:15.822815 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 15:16:15.822815 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 15:16:15.822815 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 15:16:15.822815 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 15:16:15.822815 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 15:16:15.822815 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 15:16:15.822815 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Sep 13 15:16:15.822815 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 402/827] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Sep 13 15:16:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:16:15.823310 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d23dbb-a300-471e-b4e1-e1e51324280e None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:15.828299 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 426/828] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Sep 13 15:16:15 2022] GET /identity/v3/role_assignments?user.id=62aad71c6c1a4469805762bba330bf0e&scope.project.id=3d6e00339cfa47d2a6fa8724c587035f&role.id=f34412ad29f1478cba775b033129f71f => generated 608 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:16:15.829603 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd181fe-70a1-42fb-8fc6-5c74eb08bc30 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:15.829929 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd181fe-70a1-42fb-8fc6-5c74eb08bc30 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:15.830211 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd181fe-70a1-42fb-8fc6-5c74eb08bc30 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:15.831705 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 427/829] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:16:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:16:15.834573 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd181fe-70a1-42fb-8fc6-5c74eb08bc30 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:15.838176 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:15.964725 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d23dbb-a300-471e-b4e1-e1e51324280e None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:15.969892 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd181fe-70a1-42fb-8fc6-5c74eb08bc30 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:16.003136 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f45cb44-a614-4b45-8a51-50b639ae7747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:16.003759 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f45cb44-a614-4b45-8a51-50b639ae7747 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:16.004042 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f45cb44-a614-4b45-8a51-50b639ae7747 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:16.004376 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f45cb44-a614-4b45-8a51-50b639ae7747 None admin] PATH_INFO: `/v3/services` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:16.005014 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f45cb44-a614-4b45-8a51-50b639ae7747 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:16:16.005446 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f45cb44-a614-4b45-8a51-50b639ae7747 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:16.006884 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f45cb44-a614-4b45-8a51-50b639ae7747 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:16.012285 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 403/830] 10.222.0.27 () {56 vars in 1124 bytes} [Tue Sep 13 15:16:15 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:16:16.013498 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a82ed5a-8cd5-497f-a035-e4cf45e20161 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:16.013815 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a82ed5a-8cd5-497f-a035-e4cf45e20161 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:16.014103 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a82ed5a-8cd5-497f-a035-e4cf45e20161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:16.023384 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582617e1-e118-480b-b78b-da7c637fcfdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:16.024015 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582617e1-e118-480b-b78b-da7c637fcfdc None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:16.024296 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582617e1-e118-480b-b78b-da7c637fcfdc None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:16.024570 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582617e1-e118-480b-b78b-da7c637fcfdc None admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:16.025272 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582617e1-e118-480b-b78b-da7c637fcfdc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:16:16.025574 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582617e1-e118-480b-b78b-da7c637fcfdc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:16.027064 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582617e1-e118-480b-b78b-da7c637fcfdc None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:16.034535 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-4a82ed5a-8cd5-497f-a035-e4cf45e20161 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:16:16.036568 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-4a82ed5a-8cd5-497f-a035-e4cf45e20161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:16:16.041156 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 428/831] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Sep 13 15:16:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 15:16:16.042074 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582617e1-e118-480b-b78b-da7c637fcfdc None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:16.073994 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:16.118369 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 404/832] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:16:16 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 15:16:16.119806 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a82ed5a-8cd5-497f-a035-e4cf45e20161 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:16.127660 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:16.159438 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582617e1-e118-480b-b78b-da7c637fcfdc None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:16.207461 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34189866-86c8-43fc-9f82-a7a1c10700c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:16.208815 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34189866-86c8-43fc-9f82-a7a1c10700c1 None admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:16.209249 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34189866-86c8-43fc-9f82-a7a1c10700c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:16.210073 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34189866-86c8-43fc-9f82-a7a1c10700c1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:16.210766 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34189866-86c8-43fc-9f82-a7a1c10700c1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:16.213221 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34189866-86c8-43fc-9f82-a7a1c10700c1 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:16.236233 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 429/833] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 13 15:16:16 2022] POST /identity/v3/endpoints => generated 346 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:16:16.250686 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a82ed5a-8cd5-497f-a035-e4cf45e20161 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:16.298952 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19484a46-1e2f-48fb-9a10-3cb0c0b077b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:16.299905 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19484a46-1e2f-48fb-9a10-3cb0c0b077b0 None admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:16.300332 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19484a46-1e2f-48fb-9a10-3cb0c0b077b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:16.300789 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19484a46-1e2f-48fb-9a10-3cb0c0b077b0 None admin] PATH_INFO: `/v3/projects/3d6e00339cfa47d2a6fa8724c587035f/users/e97bcdb20f1e416ea41b99c226617faf/roles/470736c596a14fa5ac78200239aa1104` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:16.320629 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19484a46-1e2f-48fb-9a10-3cb0c0b077b0 None admin] RBAC: Authorizing `identity:create_grant(project_id=3d6e00339cfa47d2a6fa8724c587035f, user_id=e97bcdb20f1e416ea41b99c226617faf, role_id=470736c596a14fa5ac78200239aa1104)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:16.322383 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19484a46-1e2f-48fb-9a10-3cb0c0b077b0 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:16.342371 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 405/834] 10.222.0.27 () {58 vars in 1439 bytes} [Tue Sep 13 15:16:16 2022] PUT /identity/v3/projects/3d6e00339cfa47d2a6fa8724c587035f/users/e97bcdb20f1e416ea41b99c226617faf/roles/470736c596a14fa5ac78200239aa1104 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:16:16.408254 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34189866-86c8-43fc-9f82-a7a1c10700c1 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:16.506313 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:16.530047 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34189866-86c8-43fc-9f82-a7a1c10700c1 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:16.566245 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a3a8f9-8760-4a8c-b5cd-3de8807161a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:16.567580 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a3a8f9-8760-4a8c-b5cd-3de8807161a8 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:16.567859 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a3a8f9-8760-4a8c-b5cd-3de8807161a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:16.568133 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a3a8f9-8760-4a8c-b5cd-3de8807161a8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:16.579040 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a3a8f9-8760-4a8c-b5cd-3de8807161a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 15:16:16.585011 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-20a3a8f9-8760-4a8c-b5cd-3de8807161a8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 15:16:16.585011 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:16:16.585011 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:16:16.585011 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:16:16.585011 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:16:16.585011 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:16:16.585011 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:16:16.585011 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:16:16.585011 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:16:16.585011 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:16:16.585011 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:16:16.585011 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:16:16.585011 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 15:16:16.585011 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 15:16:16.585011 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 15:16:16.585011 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 15:16:16.585980 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 15:16:16.585980 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 15:16:16.585980 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 15:16:16.585980 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 15:16:16.585980 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:16:16.585980 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:16:16.585980 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:16:16.585980 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:16:16.585980 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:16:16.585980 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:16:16.585980 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:16:16.585980 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Sep 13 15:16:16.585980 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:16:16.585980 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:16:16.585980 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:16:16.585980 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:16:16.587213 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:16:16.587213 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:16:16.587213 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:16:16.587213 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:16:16.587213 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 15:16:16.587213 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 15:16:16.587213 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 15:16:16.587213 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 15:16:16.587213 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 15:16:16.587213 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 15:16:16.587213 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 15:16:16.587213 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Sep 13 15:16:16.587213 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 430/835] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Sep 13 15:16:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:16:16.594229 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19484a46-1e2f-48fb-9a10-3cb0c0b077b0 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:16.649974 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:16.705396 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19484a46-1e2f-48fb-9a10-3cb0c0b077b0 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:16.743287 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ead617b-efcf-41a8-93c1-0cf3d7304fab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:16.744262 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ead617b-efcf-41a8-93c1-0cf3d7304fab None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:16.744768 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ead617b-efcf-41a8-93c1-0cf3d7304fab None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:16.745235 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ead617b-efcf-41a8-93c1-0cf3d7304fab None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:16.746135 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ead617b-efcf-41a8-93c1-0cf3d7304fab None admin] RBAC: Adding query filter params (name=admin) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:16:16.746636 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ead617b-efcf-41a8-93c1-0cf3d7304fab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:16.748200 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ead617b-efcf-41a8-93c1-0cf3d7304fab None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:16.761799 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 406/836] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Sep 13 15:16:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:16:16.766754 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a3a8f9-8760-4a8c-b5cd-3de8807161a8 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:16.882329 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a3a8f9-8760-4a8c-b5cd-3de8807161a8 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:16.917926 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40bcf0c-3d51-4363-8afa-12a7b2849642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:16.918554 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40bcf0c-3d51-4363-8afa-12a7b2849642 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:16.918835 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40bcf0c-3d51-4363-8afa-12a7b2849642 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:16.919109 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40bcf0c-3d51-4363-8afa-12a7b2849642 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:16.934256 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40bcf0c-3d51-4363-8afa-12a7b2849642 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:16.935785 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40bcf0c-3d51-4363-8afa-12a7b2849642 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:16.937570 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:16.951977 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-e40bcf0c-3d51-4363-8afa-12a7b2849642 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 15:16:16.951977 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:16:16.951977 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:16:16.951977 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:16:16.951977 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:16:16.951977 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:16:16.951977 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:16:16.951977 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:16:16.951977 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:16:16.951977 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:16:16.951977 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:16:16.951977 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:16:16.951977 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 15:16:16.951977 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 15:16:16.951977 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 15:16:16.951977 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 15:16:16.952931 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:16:16.952931 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:16:16.952931 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:16:16.952931 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:16:16.952931 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:16:16.952931 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:16:16.952931 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:16:16.952931 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Sep 13 15:16:16.952931 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:16:16.952931 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:16:16.952931 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:16:16.952931 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:16:16.952931 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:16:16.952931 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:16:16.952931 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:16:16.952931 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:16:16.952931 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 15:16:16.954183 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 15:16:16.954183 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 15:16:16.954183 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Sep 13 15:16:16.954183 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 431/837] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 13 15:16:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:16:16.960251 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ead617b-efcf-41a8-93c1-0cf3d7304fab None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:17.061621 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ead617b-efcf-41a8-93c1-0cf3d7304fab None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:17.079877 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:17.104874 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f7bac7-95ee-4c6a-baaf-d765a8407b30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:17.105762 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f7bac7-95ee-4c6a-baaf-d765a8407b30 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:17.106262 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f7bac7-95ee-4c6a-baaf-d765a8407b30 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:17.106707 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f7bac7-95ee-4c6a-baaf-d765a8407b30 None admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:17.107509 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f7bac7-95ee-4c6a-baaf-d765a8407b30 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:16:17.107958 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f7bac7-95ee-4c6a-baaf-d765a8407b30 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:17.109462 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f7bac7-95ee-4c6a-baaf-d765a8407b30 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:17.122608 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 407/838] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Sep 13 15:16:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:16:17.129829 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40bcf0c-3d51-4363-8afa-12a7b2849642 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:17.236536 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40bcf0c-3d51-4363-8afa-12a7b2849642 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:17.272469 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97889517-7a0d-49ab-b73f-82dd50b7e84b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:17.273135 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97889517-7a0d-49ab-b73f-82dd50b7e84b None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:17.273419 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97889517-7a0d-49ab-b73f-82dd50b7e84b None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:17.273715 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97889517-7a0d-49ab-b73f-82dd50b7e84b None admin] PATH_INFO: `/v3/users/swift` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:17.282515 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97889517-7a0d-49ab-b73f-82dd50b7e84b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:17.283989 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97889517-7a0d-49ab-b73f-82dd50b7e84b None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:17.296700 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-97889517-7a0d-49ab-b73f-82dd50b7e84b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 13 15:16:17.296700 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:16:17.296700 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:16:17.296700 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:16:17.296700 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:16:17.296700 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:16:17.296700 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:16:17.296700 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:16:17.296700 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:16:17.296700 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:16:17.296700 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:16:17.296700 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:16:17.296700 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 15:16:17.296700 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 15:16:17.296700 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 15:16:17.296700 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 15:16:17.297658 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:16:17.297658 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:16:17.297658 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 15:16:17.297658 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 15:16:17.297658 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 15:16:17.297658 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 15:16:17.297658 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:16:17.297658 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:16:17.297658 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:16:17.297658 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:16:17.297658 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:16:17.297658 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Sep 13 15:16:17.297658 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:16:17.297658 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:16:17.297658 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:16:17.297658 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:16:17.297658 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:16:17.297658 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:16:17.299009 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:16:17.299009 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:16:17.299009 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 15:16:17.299009 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 15:16:17.299009 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 15:16:17.299009 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 15:16:17.299009 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 15:16:17.299009 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 15:16:17.299009 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 13 15:16:17.299009 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Sep 13 15:16:17.299009 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 432/839] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Sep 13 15:16:17 2022] GET /identity/v3/users/swift => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:16:17.303994 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f7bac7-95ee-4c6a-baaf-d765a8407b30 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:17.409876 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f7bac7-95ee-4c6a-baaf-d765a8407b30 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:17.445221 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b32cb7-1d52-4c96-99d9-71efeffa8f69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:17.445860 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b32cb7-1d52-4c96-99d9-71efeffa8f69 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:17.446139 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b32cb7-1d52-4c96-99d9-71efeffa8f69 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:17.446401 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b32cb7-1d52-4c96-99d9-71efeffa8f69 None admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:17.447132 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b32cb7-1d52-4c96-99d9-71efeffa8f69 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:16:17.447437 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b32cb7-1d52-4c96-99d9-71efeffa8f69 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:17.448852 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b32cb7-1d52-4c96-99d9-71efeffa8f69 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:17.467161 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 408/840] 10.222.0.27 () {56 vars in 1135 bytes} [Tue Sep 13 15:16:17 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:16:17.472516 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97889517-7a0d-49ab-b73f-82dd50b7e84b None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:17.542781 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:17.584602 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97889517-7a0d-49ab-b73f-82dd50b7e84b None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:17.620692 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bea3ee5-a477-40ff-af9d-d33c5a0fada8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:17.621652 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bea3ee5-a477-40ff-af9d-d33c5a0fada8 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:17.622188 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bea3ee5-a477-40ff-af9d-d33c5a0fada8 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:17.622674 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bea3ee5-a477-40ff-af9d-d33c5a0fada8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:17.694263 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bea3ee5-a477-40ff-af9d-d33c5a0fada8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:17.695722 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bea3ee5-a477-40ff-af9d-d33c5a0fada8 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:17.762014 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:17.808994 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 433/841] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Sep 13 15:16:17 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 15:16:17.814374 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b32cb7-1d52-4c96-99d9-71efeffa8f69 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:17.845787 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:17.919222 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b32cb7-1d52-4c96-99d9-71efeffa8f69 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:17.954762 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9277ac2f-b3cc-4092-8f12-88968f8e68cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:17.955392 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9277ac2f-b3cc-4092-8f12-88968f8e68cf None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:17.955674 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9277ac2f-b3cc-4092-8f12-88968f8e68cf None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:17.955948 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9277ac2f-b3cc-4092-8f12-88968f8e68cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:17.967496 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9277ac2f-b3cc-4092-8f12-88968f8e68cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:17.969068 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9277ac2f-b3cc-4092-8f12-88968f8e68cf None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:17.984323 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-9277ac2f-b3cc-4092-8f12-88968f8e68cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 15:16:17.984323 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:16:17.984323 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:16:17.984323 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:16:17.984323 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:16:17.984323 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:16:17.984323 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:16:17.984323 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:16:17.984323 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:16:17.984323 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:16:17.984323 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:16:17.984323 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:16:17.984323 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 15:16:17.984323 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 15:16:17.984323 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 15:16:17.984323 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 15:16:17.985304 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:16:17.985304 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:16:17.985304 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:16:17.985304 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:16:17.985304 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:16:17.985304 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:16:17.985304 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:16:17.985304 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Sep 13 15:16:17.985304 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:16:17.985304 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:16:17.985304 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:16:17.985304 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:16:17.985304 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:16:17.985304 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:16:17.985304 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:16:17.985304 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:16:17.985304 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 15:16:17.986571 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 15:16:17.986571 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 15:16:17.986571 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Sep 13 15:16:17.986571 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 409/842] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 13 15:16:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:16:17.991269 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bea3ee5-a477-40ff-af9d-d33c5a0fada8 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:18.107769 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bea3ee5-a477-40ff-af9d-d33c5a0fada8 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:18.151431 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4be1f9-ac54-4446-af90-0d24b9d03a26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:18.152354 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4be1f9-ac54-4446-af90-0d24b9d03a26 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:18.152811 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4be1f9-ac54-4446-af90-0d24b9d03a26 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:18.153258 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4be1f9-ac54-4446-af90-0d24b9d03a26 None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:18.154136 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4be1f9-ac54-4446-af90-0d24b9d03a26 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:16:18.154630 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4be1f9-ac54-4446-af90-0d24b9d03a26 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:18.156231 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4be1f9-ac54-4446-af90-0d24b9d03a26 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:18.169743 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 434/843] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Sep 13 15:16:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:16:18.177759 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9277ac2f-b3cc-4092-8f12-88968f8e68cf None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:18.248703 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09359968-9dc6-4104-8a09-5d4983eca7c9 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:18.249272 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09359968-9dc6-4104-8a09-5d4983eca7c9 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:18.249741 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09359968-9dc6-4104-8a09-5d4983eca7c9 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:18.251557 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 435/844] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:16:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 15:16:18.259695 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae81abc-79d7-4f3c-9236-f2f755dc2d11 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:18.259986 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae81abc-79d7-4f3c-9236-f2f755dc2d11 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:18.260270 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae81abc-79d7-4f3c-9236-f2f755dc2d11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:18.271865 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:18.284256 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-3ae81abc-79d7-4f3c-9236-f2f755dc2d11 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:16:18.286418 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-3ae81abc-79d7-4f3c-9236-f2f755dc2d11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:16:18.293975 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9277ac2f-b3cc-4092-8f12-88968f8e68cf None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:18.299158 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:18.334753 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc33152-ec78-4473-8e3b-ee7492b0519e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:18.336082 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc33152-ec78-4473-8e3b-ee7492b0519e None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:18.336591 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc33152-ec78-4473-8e3b-ee7492b0519e None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:18.337071 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc33152-ec78-4473-8e3b-ee7492b0519e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:18.344729 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc33152-ec78-4473-8e3b-ee7492b0519e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:18.346479 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc33152-ec78-4473-8e3b-ee7492b0519e None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:18.360674 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-efc33152-ec78-4473-8e3b-ee7492b0519e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 15:16:18.360674 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:16:18.360674 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:16:18.360674 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:16:18.360674 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:16:18.360674 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:16:18.360674 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:16:18.360674 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:16:18.360674 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:16:18.360674 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:16:18.360674 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:16:18.360674 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:16:18.360674 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 15:16:18.360674 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 15:16:18.360674 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 15:16:18.361567 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 15:16:18.361567 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:16:18.361567 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:16:18.361567 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:16:18.361567 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:16:18.361567 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:16:18.361567 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:16:18.361567 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:16:18.361567 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Sep 13 15:16:18.361567 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:16:18.361567 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:16:18.361567 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:16:18.361567 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:16:18.361567 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:16:18.361567 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:16:18.361567 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:16:18.361567 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:16:18.362506 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 15:16:18.362506 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 15:16:18.362506 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 15:16:18.362506 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 15:16:18.362506 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 15:16:18.362506 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 15:16:18.362506 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 15:16:18.362506 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Sep 13 15:16:18.363882 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 410/845] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Sep 13 15:16:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:16:18.369048 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc33152-ec78-4473-8e3b-ee7492b0519e None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:18.385876 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 436/846] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:16:18 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 15:16:18.483956 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc33152-ec78-4473-8e3b-ee7492b0519e None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:18.524594 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c88482-d792-455f-aba9-678d5b184faa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:18.525218 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c88482-d792-455f-aba9-678d5b184faa None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:18.525501 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c88482-d792-455f-aba9-678d5b184faa None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:18.525805 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c88482-d792-455f-aba9-678d5b184faa None admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:18.526520 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c88482-d792-455f-aba9-678d5b184faa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:16:18.526832 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c88482-d792-455f-aba9-678d5b184faa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:18.528269 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c88482-d792-455f-aba9-678d5b184faa None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:18.542340 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 411/847] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Sep 13 15:16:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 15:16:18.548560 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae81abc-79d7-4f3c-9236-f2f755dc2d11 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:18.578612 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b40c599-9a44-49bb-ba92-13eaffd983ef None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:18.578930 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b40c599-9a44-49bb-ba92-13eaffd983ef None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:18.579176 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b40c599-9a44-49bb-ba92-13eaffd983ef None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:18.580752 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 412/848] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:16:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 15:16:18.586243 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374ffcca-76d2-46a0-86e6-c99fe7658d0a None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:18.586524 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374ffcca-76d2-46a0-86e6-c99fe7658d0a None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:18.586799 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374ffcca-76d2-46a0-86e6-c99fe7658d0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:18.593371 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:18.607562 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-374ffcca-76d2-46a0-86e6-c99fe7658d0a None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:16:18.608916 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-374ffcca-76d2-46a0-86e6-c99fe7658d0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:16:18.670306 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae81abc-79d7-4f3c-9236-f2f755dc2d11 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:18.689744 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 413/849] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:16:18 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 15:16:18.689744 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6793895d-cd61-4f24-86c4-4ee64630abed None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:18.689744 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6793895d-cd61-4f24-86c4-4ee64630abed None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:18.689744 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6793895d-cd61-4f24-86c4-4ee64630abed None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:18.689744 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 414/850] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:16:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:16:18.689744 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6793895d-cd61-4f24-86c4-4ee64630abed None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:18.705535 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbc1303-e99e-4cb8-b831-66a92256c284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:18.706177 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbc1303-e99e-4cb8-b831-66a92256c284 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:18.706473 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbc1303-e99e-4cb8-b831-66a92256c284 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:18.706739 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbc1303-e99e-4cb8-b831-66a92256c284 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:18.708119 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbc1303-e99e-4cb8-b831-66a92256c284 None admin] RBAC: Adding query filter params (role.id=f34412ad29f1478cba775b033129f71f, scope.project.id=3d6e00339cfa47d2a6fa8724c587035f, user.id=dc735644be394e0abe73e709373e2003) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:16:18.708436 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbc1303-e99e-4cb8-b831-66a92256c284 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:18.709903 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbc1303-e99e-4cb8-b831-66a92256c284 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:18.716407 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 437/851] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Sep 13 15:16:18 2022] GET /identity/v3/role_assignments?user.id=dc735644be394e0abe73e709373e2003&scope.project.id=3d6e00339cfa47d2a6fa8724c587035f&role.id=f34412ad29f1478cba775b033129f71f => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:16:18.724209 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec682c59-2eaf-489e-9828-76bdf6a43831 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:18.724503 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec682c59-2eaf-489e-9828-76bdf6a43831 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:18.724783 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec682c59-2eaf-489e-9828-76bdf6a43831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:18.745254 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-ec682c59-2eaf-489e-9828-76bdf6a43831 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:16:18.746523 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-ec682c59-2eaf-489e-9828-76bdf6a43831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:16:18.748833 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:18.826763 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6793895d-cd61-4f24-86c4-4ee64630abed None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:18.838599 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 438/852] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:16:18 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 15:16:18.872720 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:18.880159 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170defd0-f679-4f67-88ed-cbc48556e20e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:18.880815 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170defd0-f679-4f67-88ed-cbc48556e20e None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:18.881099 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170defd0-f679-4f67-88ed-cbc48556e20e None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:18.881375 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170defd0-f679-4f67-88ed-cbc48556e20e None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:18.882006 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170defd0-f679-4f67-88ed-cbc48556e20e None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:18.883449 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170defd0-f679-4f67-88ed-cbc48556e20e None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:18.893340 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-170defd0-f679-4f67-88ed-cbc48556e20e None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 13 15:16:18.893340 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:16:18.893340 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 15:16:18.893340 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 15:16:18.893340 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 15:16:18.893340 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 15:16:18.893340 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 15:16:18.893340 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 15:16:18.893340 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 13 15:16:18.893340 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Sep 13 15:16:18.893340 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 15:16:18.893340 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Sep 13 15:16:18.893340 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:16:18.893340 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:16:18.893340 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:16:18.893340 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:16:18.895063 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:16:18.895063 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:16:18.895063 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:16:18.895063 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:16:18.895063 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:16:18.895063 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:16:18.895063 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:16:18.895063 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 15:16:18.895063 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 15:16:18.895063 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 15:16:18.895063 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 15:16:18.895063 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:16:18.895063 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:16:18.895063 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:16:18.895063 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:16:18.895063 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:16:18.895063 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:16:18.896701 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:16:18.896701 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Sep 13 15:16:18.896701 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:16:18.896701 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:16:18.896701 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:16:18.896701 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:16:18.896701 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:16:18.896701 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:16:18.896701 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:16:18.896701 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:16:18.896701 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 15:16:18.896701 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 15:16:18.896701 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 13 15:16:18.896701 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Sep 13 15:16:18.896701 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 415/853] 10.222.0.27 () {56 vars in 1132 bytes} [Tue Sep 13 15:16:18 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:16:18.904575 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec682c59-2eaf-489e-9828-76bdf6a43831 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:18.956883 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170defd0-f679-4f67-88ed-cbc48556e20e None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:19.041526 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec682c59-2eaf-489e-9828-76bdf6a43831 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:19.078012 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170defd0-f679-4f67-88ed-cbc48556e20e None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:19.101100 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a942caca-f73b-4217-8060-c58dde9ca1bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:19.101804 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a942caca-f73b-4217-8060-c58dde9ca1bc None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:19.102090 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a942caca-f73b-4217-8060-c58dde9ca1bc None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:19.102364 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a942caca-f73b-4217-8060-c58dde9ca1bc None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:19.103659 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a942caca-f73b-4217-8060-c58dde9ca1bc None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:16:19.104104 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a942caca-f73b-4217-8060-c58dde9ca1bc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:19.105888 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a942caca-f73b-4217-8060-c58dde9ca1bc None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:19.117798 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 439/854] 10.222.0.27 () {56 vars in 1126 bytes} [Tue Sep 13 15:16:18 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:16:19.118999 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a942caca-f73b-4217-8060-c58dde9ca1bc None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:19.122758 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:19.125771 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da583308-7818-47eb-bda7-74760e2ad046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:19.126637 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da583308-7818-47eb-bda7-74760e2ad046 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:19.127086 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da583308-7818-47eb-bda7-74760e2ad046 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:19.127556 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da583308-7818-47eb-bda7-74760e2ad046 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:19.128296 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da583308-7818-47eb-bda7-74760e2ad046 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:19.130008 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da583308-7818-47eb-bda7-74760e2ad046 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:19.141610 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-da583308-7818-47eb-bda7-74760e2ad046 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 13 15:16:19.141610 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:16:19.141610 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 15:16:19.141610 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 15:16:19.141610 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 15:16:19.141610 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 15:16:19.141610 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 15:16:19.141610 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 15:16:19.141610 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 13 15:16:19.141610 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Sep 13 15:16:19.141610 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 15:16:19.141610 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Sep 13 15:16:19.141610 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:16:19.141610 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:16:19.141610 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:16:19.141610 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:16:19.141610 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:16:19.142849 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:16:19.142849 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:16:19.142849 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:16:19.142849 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:16:19.142849 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:16:19.142849 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:16:19.142849 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 15:16:19.142849 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 15:16:19.142849 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 15:16:19.142849 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 15:16:19.142849 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:16:19.142849 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:16:19.142849 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:16:19.142849 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:16:19.142849 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:16:19.142849 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:16:19.143694 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:16:19.143694 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Sep 13 15:16:19.143694 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:16:19.143694 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:16:19.143694 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:16:19.143694 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:16:19.143694 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:16:19.143694 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:16:19.143694 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:16:19.143694 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:16:19.143694 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 15:16:19.143694 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 15:16:19.143694 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 13 15:16:19.143694 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Sep 13 15:16:19.148257 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 416/855] 10.222.0.27 () {56 vars in 1114 bytes} [Tue Sep 13 15:16:18 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:16:19.149123 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da583308-7818-47eb-bda7-74760e2ad046 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:19.211409 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:19.232345 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a942caca-f73b-4217-8060-c58dde9ca1bc None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:19.258585 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da583308-7818-47eb-bda7-74760e2ad046 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:19.267022 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04eb4c84-4d47-4d84-8298-8cf887ea6755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:19.267713 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eb4c84-4d47-4d84-8298-8cf887ea6755 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:19.268000 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eb4c84-4d47-4d84-8298-8cf887ea6755 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:19.268271 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eb4c84-4d47-4d84-8298-8cf887ea6755 None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:19.268898 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04eb4c84-4d47-4d84-8298-8cf887ea6755 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:16:19.269204 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04eb4c84-4d47-4d84-8298-8cf887ea6755 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:19.271284 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04eb4c84-4d47-4d84-8298-8cf887ea6755 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:19.282210 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 440/856] 10.222.0.27 () {56 vars in 1126 bytes} [Tue Sep 13 15:16:19 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 15:16:19.283106 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04eb4c84-4d47-4d84-8298-8cf887ea6755 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:19.299967 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad42b04-3eed-494c-93e3-822bbfcf3bfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:19.300708 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad42b04-3eed-494c-93e3-822bbfcf3bfd None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:19.300977 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad42b04-3eed-494c-93e3-822bbfcf3bfd None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:19.301396 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad42b04-3eed-494c-93e3-822bbfcf3bfd None admin] PATH_INFO: `/v3/roles/service` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:19.313984 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad42b04-3eed-494c-93e3-822bbfcf3bfd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 15:16:19.320973 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-2ad42b04-3eed-494c-93e3-822bbfcf3bfd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 15:16:19.320973 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:16:19.320973 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:16:19.320973 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:16:19.320973 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:16:19.320973 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:16:19.320973 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:16:19.320973 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:16:19.320973 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:16:19.320973 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:16:19.320973 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:16:19.320973 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:16:19.320973 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 15:16:19.320973 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 15:16:19.320973 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 15:16:19.320973 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 15:16:19.322033 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 15:16:19.322033 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 15:16:19.322033 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 15:16:19.322033 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 15:16:19.322033 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:16:19.322033 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:16:19.322033 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:16:19.322033 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:16:19.322033 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:16:19.322033 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:16:19.322033 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:16:19.322033 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Sep 13 15:16:19.322033 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:16:19.322033 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:16:19.322033 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:16:19.322033 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:16:19.322873 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:16:19.322873 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:16:19.322873 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:16:19.322873 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:16:19.322873 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 15:16:19.322873 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 15:16:19.322873 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 15:16:19.322873 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 15:16:19.322873 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 15:16:19.322873 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 15:16:19.322873 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 15:16:19.322873 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Sep 13 15:16:19.327163 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 417/857] 10.222.0.27 () {56 vars in 1102 bytes} [Tue Sep 13 15:16:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:16:19.328095 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad42b04-3eed-494c-93e3-822bbfcf3bfd None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:19.386633 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:19.441183 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04eb4c84-4d47-4d84-8298-8cf887ea6755 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:19.445693 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad42b04-3eed-494c-93e3-822bbfcf3bfd None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:19.471040 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:19.489087 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5d4c8c-4dc2-4302-9eb9-68e5bd7db86d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:19.489940 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5d4c8c-4dc2-4302-9eb9-68e5bd7db86d None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:19.490228 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5d4c8c-4dc2-4302-9eb9-68e5bd7db86d None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:19.490846 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5d4c8c-4dc2-4302-9eb9-68e5bd7db86d None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:19.491810 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5d4c8c-4dc2-4302-9eb9-68e5bd7db86d None admin] RBAC: Adding query filter params (name=service) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:16:19.492130 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5d4c8c-4dc2-4302-9eb9-68e5bd7db86d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:19.493509 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5d4c8c-4dc2-4302-9eb9-68e5bd7db86d None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:19.495824 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91445331-8142-4360-9e95-c75dc22084d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:19.496532 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91445331-8142-4360-9e95-c75dc22084d2 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:19.496965 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91445331-8142-4360-9e95-c75dc22084d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:19.497334 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91445331-8142-4360-9e95-c75dc22084d2 None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:19.498156 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91445331-8142-4360-9e95-c75dc22084d2 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:16:19.498552 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91445331-8142-4360-9e95-c75dc22084d2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:19.500036 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91445331-8142-4360-9e95-c75dc22084d2 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:19.504884 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 418/858] 10.222.0.27 () {56 vars in 1103 bytes} [Tue Sep 13 15:16:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:16:19.509635 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 441/859] 10.222.0.27 () {56 vars in 1114 bytes} [Tue Sep 13 15:16:19 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:16:19.511377 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5d4c8c-4dc2-4302-9eb9-68e5bd7db86d None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:19.511943 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91445331-8142-4360-9e95-c75dc22084d2 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:19.621500 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5d4c8c-4dc2-4302-9eb9-68e5bd7db86d None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:19.645519 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91445331-8142-4360-9e95-c75dc22084d2 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:19.660856 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5647cad-e23b-4c92-a727-eb1184fe7107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:19.661755 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5647cad-e23b-4c92-a727-eb1184fe7107 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:19.662148 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5647cad-e23b-4c92-a727-eb1184fe7107 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:19.662545 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5647cad-e23b-4c92-a727-eb1184fe7107 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:19.674694 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5647cad-e23b-4c92-a727-eb1184fe7107 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:19.677338 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5647cad-e23b-4c92-a727-eb1184fe7107 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:19.686657 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:19.695756 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-a5647cad-e23b-4c92-a727-eb1184fe7107 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 15:16:19.695756 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:16:19.695756 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:16:19.695756 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:16:19.695756 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:16:19.695756 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:16:19.695756 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:16:19.695756 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:16:19.695756 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:16:19.695756 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:16:19.695756 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:16:19.695756 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:16:19.695756 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 15:16:19.695756 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 15:16:19.695756 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 15:16:19.695756 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 15:16:19.696983 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:16:19.696983 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:16:19.696983 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:16:19.696983 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:16:19.696983 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:16:19.696983 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:16:19.696983 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:16:19.696983 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Sep 13 15:16:19.696983 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:16:19.696983 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:16:19.696983 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:16:19.696983 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:16:19.696983 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:16:19.696983 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:16:19.696983 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:16:19.696983 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:16:19.696983 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 15:16:19.698162 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 15:16:19.698162 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 15:16:19.698162 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Sep 13 15:16:19.698866 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7b8638-381d-402d-bb3e-8a0d17a23264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:19.703894 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 419/860] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 13 15:16:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:16:19.704038 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7b8638-381d-402d-bb3e-8a0d17a23264 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:19.704038 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7b8638-381d-402d-bb3e-8a0d17a23264 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:19.704038 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7b8638-381d-402d-bb3e-8a0d17a23264 None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:19.704038 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7b8638-381d-402d-bb3e-8a0d17a23264 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:16:19.704038 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7b8638-381d-402d-bb3e-8a0d17a23264 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:19.705398 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5647cad-e23b-4c92-a727-eb1184fe7107 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:19.706213 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7b8638-381d-402d-bb3e-8a0d17a23264 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:19.713176 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 442/861] 10.222.0.27 () {56 vars in 1114 bytes} [Tue Sep 13 15:16:19 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 15:16:19.749719 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:19.830702 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5647cad-e23b-4c92-a727-eb1184fe7107 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:19.870006 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a6cab3-5f77-427d-9b71-0edc949d24a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:19.870633 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a6cab3-5f77-427d-9b71-0edc949d24a2 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:19.870921 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a6cab3-5f77-427d-9b71-0edc949d24a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:19.871200 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a6cab3-5f77-427d-9b71-0edc949d24a2 None admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:19.871860 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a6cab3-5f77-427d-9b71-0edc949d24a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:16:19.872169 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a6cab3-5f77-427d-9b71-0edc949d24a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:19.873560 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a6cab3-5f77-427d-9b71-0edc949d24a2 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:19.887820 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 420/862] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Sep 13 15:16:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:16:19.894320 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7b8638-381d-402d-bb3e-8a0d17a23264 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:20.002228 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7b8638-381d-402d-bb3e-8a0d17a23264 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:20.038693 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d029ff-434a-431c-b146-6f4b06743e6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:20.039345 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d029ff-434a-431c-b146-6f4b06743e6b None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:20.039628 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d029ff-434a-431c-b146-6f4b06743e6b None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:20.039905 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d029ff-434a-431c-b146-6f4b06743e6b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:20.048014 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d029ff-434a-431c-b146-6f4b06743e6b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:20.049524 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d029ff-434a-431c-b146-6f4b06743e6b None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:20.061645 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-26d029ff-434a-431c-b146-6f4b06743e6b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 13 15:16:20.061645 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:16:20.061645 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:16:20.061645 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:16:20.061645 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:16:20.061645 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:16:20.061645 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:16:20.061645 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:16:20.061645 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:16:20.061645 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:16:20.061645 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:16:20.061645 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:16:20.061645 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 15:16:20.061645 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 15:16:20.061645 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 15:16:20.061645 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 15:16:20.062640 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:16:20.062640 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:16:20.062640 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 15:16:20.062640 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 15:16:20.062640 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 15:16:20.062640 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 15:16:20.062640 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:16:20.062640 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:16:20.062640 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:16:20.062640 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:16:20.062640 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:16:20.062640 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Sep 13 15:16:20.062640 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:16:20.062640 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:16:20.062640 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:16:20.062640 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:16:20.062640 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:16:20.062640 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:16:20.063582 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:16:20.063582 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:16:20.063582 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 15:16:20.063582 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 15:16:20.063582 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 15:16:20.063582 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 15:16:20.063582 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 15:16:20.063582 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 15:16:20.063582 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 13 15:16:20.063582 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Sep 13 15:16:20.063582 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 443/863] 10.222.0.27 () {56 vars in 1117 bytes} [Tue Sep 13 15:16:19 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:16:20.069637 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a6cab3-5f77-427d-9b71-0edc949d24a2 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:20.170881 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:20.178031 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a6cab3-5f77-427d-9b71-0edc949d24a2 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:20.217509 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be413b92-1bc5-4df6-a215-98811537b0b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:20.218164 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be413b92-1bc5-4df6-a215-98811537b0b7 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:20.218448 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be413b92-1bc5-4df6-a215-98811537b0b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:20.218730 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be413b92-1bc5-4df6-a215-98811537b0b7 None admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:20.219473 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be413b92-1bc5-4df6-a215-98811537b0b7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:16:20.219791 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be413b92-1bc5-4df6-a215-98811537b0b7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:20.221281 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be413b92-1bc5-4df6-a215-98811537b0b7 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:20.240206 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 421/864] 10.222.0.27 () {56 vars in 1149 bytes} [Tue Sep 13 15:16:20 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:16:20.245777 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d029ff-434a-431c-b146-6f4b06743e6b None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:20.303307 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:20.351179 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d029ff-434a-431c-b146-6f4b06743e6b None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:20.385586 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e302c5e0-acdd-4437-9c92-57b10037f694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:20.386231 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e302c5e0-acdd-4437-9c92-57b10037f694 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:20.386513 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e302c5e0-acdd-4437-9c92-57b10037f694 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:20.386786 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e302c5e0-acdd-4437-9c92-57b10037f694 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:20.461617 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e302c5e0-acdd-4437-9c92-57b10037f694 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:20.463104 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e302c5e0-acdd-4437-9c92-57b10037f694 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:20.518030 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:20.566868 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 444/865] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Sep 13 15:16:20 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 15:16:20.572632 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be413b92-1bc5-4df6-a215-98811537b0b7 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:20.677206 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be413b92-1bc5-4df6-a215-98811537b0b7 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:20.716600 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12888259-e88a-41af-806e-1a695950c738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:20.717256 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12888259-e88a-41af-806e-1a695950c738 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:20.717528 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12888259-e88a-41af-806e-1a695950c738 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:20.717837 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12888259-e88a-41af-806e-1a695950c738 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:20.728968 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12888259-e88a-41af-806e-1a695950c738 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:20.730604 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12888259-e88a-41af-806e-1a695950c738 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:20.746401 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-12888259-e88a-41af-806e-1a695950c738 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 15:16:20.746401 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:16:20.746401 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:16:20.746401 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:16:20.746401 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:16:20.746401 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:16:20.746401 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:16:20.746401 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:16:20.746401 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:16:20.746401 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:16:20.746401 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:16:20.746401 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:16:20.746401 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 15:16:20.746401 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 15:16:20.746401 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 15:16:20.746401 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 15:16:20.747390 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:16:20.747390 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:16:20.747390 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:16:20.747390 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:16:20.747390 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:16:20.747390 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:16:20.747390 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:16:20.747390 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Sep 13 15:16:20.747390 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:16:20.747390 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:16:20.747390 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:16:20.747390 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:16:20.747390 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:16:20.747390 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:16:20.747390 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:16:20.747390 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:16:20.747390 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 15:16:20.748282 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 15:16:20.748282 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 15:16:20.748282 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Sep 13 15:16:20.748282 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 422/866] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 13 15:16:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:16:20.753409 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e302c5e0-acdd-4437-9c92-57b10037f694 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:20.854393 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e302c5e0-acdd-4437-9c92-57b10037f694 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:20.889991 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420bb300-7004-4b95-a16d-2577ecf9b56b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:20.890604 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420bb300-7004-4b95-a16d-2577ecf9b56b None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:20.890887 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420bb300-7004-4b95-a16d-2577ecf9b56b None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:20.891164 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420bb300-7004-4b95-a16d-2577ecf9b56b None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:20.891867 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420bb300-7004-4b95-a16d-2577ecf9b56b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:16:20.892177 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420bb300-7004-4b95-a16d-2577ecf9b56b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:20.893596 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420bb300-7004-4b95-a16d-2577ecf9b56b None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:20.906447 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 445/867] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Sep 13 15:16:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:16:20.912312 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12888259-e88a-41af-806e-1a695950c738 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:20.916549 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:21.021673 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12888259-e88a-41af-806e-1a695950c738 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:21.045177 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9151da2-5023-4d35-b784-7c2191f35009 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:21.045514 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9151da2-5023-4d35-b784-7c2191f35009 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:21.045816 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9151da2-5023-4d35-b784-7c2191f35009 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:21.047697 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 446/868] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:16:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:16:21.056925 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793af410-9924-4c36-8798-122949ee2643 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:21.057535 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793af410-9924-4c36-8798-122949ee2643 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:21.058071 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793af410-9924-4c36-8798-122949ee2643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:21.061737 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1743c153-e08e-40e2-bdad-7d388535e3ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:21.062362 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1743c153-e08e-40e2-bdad-7d388535e3ad None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:21.062646 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1743c153-e08e-40e2-bdad-7d388535e3ad None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:21.062964 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1743c153-e08e-40e2-bdad-7d388535e3ad None admin] PATH_INFO: `/v3/projects/service` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:21.071142 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1743c153-e08e-40e2-bdad-7d388535e3ad None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:21.072595 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1743c153-e08e-40e2-bdad-7d388535e3ad None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:21.079547 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-793af410-9924-4c36-8798-122949ee2643 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:16:21.081015 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-793af410-9924-4c36-8798-122949ee2643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:16:21.085642 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-1743c153-e08e-40e2-bdad-7d388535e3ad None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 15:16:21.085642 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:16:21.085642 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:16:21.085642 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:16:21.085642 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:16:21.085642 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:16:21.085642 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:16:21.085642 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:16:21.085642 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:16:21.085642 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:16:21.085642 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:16:21.085642 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:16:21.085642 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 15:16:21.085642 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 15:16:21.085642 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 15:16:21.086687 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 15:16:21.086687 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:16:21.086687 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:16:21.086687 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:16:21.086687 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:16:21.086687 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:16:21.086687 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:16:21.086687 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:16:21.086687 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Sep 13 15:16:21.086687 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:16:21.086687 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:16:21.086687 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:16:21.086687 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:16:21.086687 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:16:21.086687 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:16:21.086687 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:16:21.086687 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:16:21.087980 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 15:16:21.087980 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 15:16:21.087980 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 15:16:21.087980 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 15:16:21.087980 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 15:16:21.087980 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 15:16:21.087980 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 15:16:21.087980 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Sep 13 15:16:21.087980 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 423/869] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Sep 13 15:16:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:16:21.094668 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1743c153-e08e-40e2-bdad-7d388535e3ad None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:21.095446 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:21.168970 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:21.181734 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 447/870] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:16:21 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 15:16:21.212497 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1743c153-e08e-40e2-bdad-7d388535e3ad None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:21.247775 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d823a4fa-d009-48ec-8418-66a4096aabbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:21.248389 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d823a4fa-d009-48ec-8418-66a4096aabbf None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:21.248666 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d823a4fa-d009-48ec-8418-66a4096aabbf None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:21.248937 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d823a4fa-d009-48ec-8418-66a4096aabbf None admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:21.249622 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d823a4fa-d009-48ec-8418-66a4096aabbf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:16:21.249958 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d823a4fa-d009-48ec-8418-66a4096aabbf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:21.251375 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d823a4fa-d009-48ec-8418-66a4096aabbf None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:21.263886 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 424/871] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Sep 13 15:16:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:16:21.270423 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793af410-9924-4c36-8798-122949ee2643 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:21.371546 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793af410-9924-4c36-8798-122949ee2643 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:21.408776 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961afa5a-5064-4a3e-ab7a-659daf19a386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:21.409411 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961afa5a-5064-4a3e-ab7a-659daf19a386 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:21.409694 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961afa5a-5064-4a3e-ab7a-659daf19a386 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:21.410089 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961afa5a-5064-4a3e-ab7a-659daf19a386 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:21.410925 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961afa5a-5064-4a3e-ab7a-659daf19a386 None admin] RBAC: Adding query filter params (role.id=470736c596a14fa5ac78200239aa1104, scope.project.id=3d6e00339cfa47d2a6fa8724c587035f, user.id=e97bcdb20f1e416ea41b99c226617faf) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:16:21.411263 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961afa5a-5064-4a3e-ab7a-659daf19a386 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:21.412859 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961afa5a-5064-4a3e-ab7a-659daf19a386 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:21.420185 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 448/872] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Sep 13 15:16:21 2022] GET /identity/v3/role_assignments?user.id=e97bcdb20f1e416ea41b99c226617faf&scope.project.id=3d6e00339cfa47d2a6fa8724c587035f&role.id=470736c596a14fa5ac78200239aa1104 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:16:21.465059 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d823a4fa-d009-48ec-8418-66a4096aabbf None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:21.521859 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366da0e9-9d6b-4475-ada4-b47b4fff2673 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:21.522148 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366da0e9-9d6b-4475-ada4-b47b4fff2673 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:21.522440 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366da0e9-9d6b-4475-ada4-b47b4fff2673 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:21.523759 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 449/873] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:16:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:16:21.530769 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f852d7-f982-4d74-9dd9-ab5d9b4e7de3 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:21.531636 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f852d7-f982-4d74-9dd9-ab5d9b4e7de3 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:21.532751 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f852d7-f982-4d74-9dd9-ab5d9b4e7de3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:21.556559 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-55f852d7-f982-4d74-9dd9-ab5d9b4e7de3 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:16:21.557983 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-55f852d7-f982-4d74-9dd9-ab5d9b4e7de3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:16:21.560053 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:21.585333 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d823a4fa-d009-48ec-8418-66a4096aabbf None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:21.614303 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:21.627923 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b437ea-398d-4700-91a6-8d8e67089264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:21.628559 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b437ea-398d-4700-91a6-8d8e67089264 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:21.630848 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b437ea-398d-4700-91a6-8d8e67089264 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:21.630848 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b437ea-398d-4700-91a6-8d8e67089264 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:21.630848 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b437ea-398d-4700-91a6-8d8e67089264 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:21.632665 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b437ea-398d-4700-91a6-8d8e67089264 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:21.640898 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-31b437ea-398d-4700-91a6-8d8e67089264 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 15:16:21.640898 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:16:21.640898 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 15:16:21.640898 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 15:16:21.640898 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 15:16:21.640898 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 15:16:21.640898 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 15:16:21.640898 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 15:16:21.640898 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 15:16:21.640898 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Sep 13 15:16:21.640898 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 15:16:21.640898 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Sep 13 15:16:21.640898 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:16:21.640898 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:16:21.640898 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:16:21.640898 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:16:21.640898 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:16:21.641984 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:16:21.641984 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:16:21.641984 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:16:21.641984 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:16:21.641984 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:16:21.641984 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:16:21.641984 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 15:16:21.641984 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 15:16:21.641984 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 15:16:21.641984 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 15:16:21.641984 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:16:21.641984 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:16:21.641984 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:16:21.641984 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:16:21.641984 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:16:21.641984 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:16:21.642819 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:16:21.642819 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Sep 13 15:16:21.642819 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:16:21.642819 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:16:21.642819 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:16:21.642819 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:16:21.642819 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:16:21.642819 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:16:21.642819 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:16:21.642819 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:16:21.642819 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 15:16:21.642819 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 15:16:21.642819 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 15:16:21.642819 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Sep 13 15:16:21.642819 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 425/874] 10.222.0.27 () {56 vars in 1126 bytes} [Tue Sep 13 15:16:21 2022] GET /identity/v3/services/object-store => generated 93 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:16:21.649221 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b437ea-398d-4700-91a6-8d8e67089264 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:21.670113 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 450/875] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:16:21 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 15:16:21.760132 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b437ea-398d-4700-91a6-8d8e67089264 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:21.796126 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d35e1d5-f4eb-48e8-8b80-62d90fbee927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:21.796738 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d35e1d5-f4eb-48e8-8b80-62d90fbee927 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:21.797015 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d35e1d5-f4eb-48e8-8b80-62d90fbee927 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:21.797290 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d35e1d5-f4eb-48e8-8b80-62d90fbee927 None admin] PATH_INFO: `/v3/services` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:21.797945 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d35e1d5-f4eb-48e8-8b80-62d90fbee927 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:16:21.798250 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d35e1d5-f4eb-48e8-8b80-62d90fbee927 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:21.799662 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d35e1d5-f4eb-48e8-8b80-62d90fbee927 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:21.804694 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 426/876] 10.222.0.27 () {56 vars in 1122 bytes} [Tue Sep 13 15:16:21 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 15:16:21.810036 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f852d7-f982-4d74-9dd9-ab5d9b4e7de3 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:21.916556 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f852d7-f982-4d74-9dd9-ab5d9b4e7de3 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:21.956577 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f5fdb6-f2e1-4e6b-8fbb-3f378f8b052d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:21.957771 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f5fdb6-f2e1-4e6b-8fbb-3f378f8b052d None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:21.958058 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f5fdb6-f2e1-4e6b-8fbb-3f378f8b052d None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:21.958332 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f5fdb6-f2e1-4e6b-8fbb-3f378f8b052d None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:21.958988 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f5fdb6-f2e1-4e6b-8fbb-3f378f8b052d None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:16:21.959297 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f5fdb6-f2e1-4e6b-8fbb-3f378f8b052d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:21.960712 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f5fdb6-f2e1-4e6b-8fbb-3f378f8b052d None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:21.966565 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 451/877] 10.222.0.27 () {56 vars in 1122 bytes} [Tue Sep 13 15:16:21 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:16:21.967219 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d35e1d5-f4eb-48e8-8b80-62d90fbee927 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:22.041403 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:22.076828 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79beba4f-24fe-4404-9e5a-2a7beda40987 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:22.077190 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79beba4f-24fe-4404-9e5a-2a7beda40987 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:22.077390 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79beba4f-24fe-4404-9e5a-2a7beda40987 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:22.079021 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 452/878] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:16:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:16:22.085275 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac83e657-6b9b-460d-8447-a295463c21de None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:22.085901 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac83e657-6b9b-460d-8447-a295463c21de None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:22.086479 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac83e657-6b9b-460d-8447-a295463c21de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:22.093352 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:22.096998 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d35e1d5-f4eb-48e8-8b80-62d90fbee927 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:22.110012 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-ac83e657-6b9b-460d-8447-a295463c21de None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:16:22.111504 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-ac83e657-6b9b-460d-8447-a295463c21de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:16:22.135093 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bbcae4-0eb1-4ae0-801b-ac907868c4b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:22.136014 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bbcae4-0eb1-4ae0-801b-ac907868c4b2 None admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:22.136441 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bbcae4-0eb1-4ae0-801b-ac907868c4b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:22.136871 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bbcae4-0eb1-4ae0-801b-ac907868c4b2 None admin] PATH_INFO: `/v3/services` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:22.137684 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bbcae4-0eb1-4ae0-801b-ac907868c4b2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:22.139256 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bbcae4-0eb1-4ae0-801b-ac907868c4b2 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:22.157570 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 427/879] 10.222.0.27 () {60 vars in 1141 bytes} [Tue Sep 13 15:16:21 2022] POST /identity/v3/services => generated 269 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 15:16:22.206603 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 453/880] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:16:22 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 15:16:22.483868 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bbcae4-0eb1-4ae0-801b-ac907868c4b2 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:22.595149 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bbcae4-0eb1-4ae0-801b-ac907868c4b2 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:22.609731 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:22.633158 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6cf694-0b57-474c-bf15-16aeea1b5c1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:22.634075 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6cf694-0b57-474c-bf15-16aeea1b5c1d None admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:22.634533 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6cf694-0b57-474c-bf15-16aeea1b5c1d None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:22.634999 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6cf694-0b57-474c-bf15-16aeea1b5c1d None admin] PATH_INFO: `/v3/services` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:22.635820 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6cf694-0b57-474c-bf15-16aeea1b5c1d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:22.637355 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6cf694-0b57-474c-bf15-16aeea1b5c1d None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:22.654155 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 428/881] 10.222.0.27 () {60 vars in 1141 bytes} [Tue Sep 13 15:16:22 2022] POST /identity/v3/services => generated 251 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:16:23.782956 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d53b50-cd3f-4396-9cac-d2514bd1cf78 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:23.783472 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d53b50-cd3f-4396-9cac-d2514bd1cf78 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:23.783585 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d53b50-cd3f-4396-9cac-d2514bd1cf78 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:23.785652 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 454/882] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:16:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:16:23.791147 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e28aa9-838f-4673-8050-20363e5576f8 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:23.791567 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e28aa9-838f-4673-8050-20363e5576f8 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:23.791710 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e28aa9-838f-4673-8050-20363e5576f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:23.810708 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-30e28aa9-838f-4673-8050-20363e5576f8 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:16:23.811911 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-30e28aa9-838f-4673-8050-20363e5576f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:16:23.888266 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 429/883] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:16:23 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 15:16:24.158316 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d53b50-cd3f-4396-9cac-d2514bd1cf78 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:24.243152 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a8aafb-5df8-45ba-8730-81ddd4c88091 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:24.243472 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a8aafb-5df8-45ba-8730-81ddd4c88091 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:24.243723 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a8aafb-5df8-45ba-8730-81ddd4c88091 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:24.245360 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 430/884] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:16:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 15:16:24.254515 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675ef9a7-d10b-47d7-9b1f-013479d083fb None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:24.254805 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675ef9a7-d10b-47d7-9b1f-013479d083fb None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:24.255082 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675ef9a7-d10b-47d7-9b1f-013479d083fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:24.273236 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d53b50-cd3f-4396-9cac-d2514bd1cf78 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:24.275266 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-675ef9a7-d10b-47d7-9b1f-013479d083fb None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:16:24.276513 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-675ef9a7-d10b-47d7-9b1f-013479d083fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:16:24.306649 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:24.317844 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bee1686-a68b-49fd-ae23-c6c41d7788cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:24.319360 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bee1686-a68b-49fd-ae23-c6c41d7788cc None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:24.320787 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bee1686-a68b-49fd-ae23-c6c41d7788cc None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:24.321280 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bee1686-a68b-49fd-ae23-c6c41d7788cc None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:24.335739 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bee1686-a68b-49fd-ae23-c6c41d7788cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 15:16:24.342894 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-7bee1686-a68b-49fd-ae23-c6c41d7788cc None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 13 15:16:24.342894 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:16:24.342894 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:16:24.342894 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:16:24.342894 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:16:24.342894 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:16:24.342894 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:16:24.342894 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:16:24.342894 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:16:24.342894 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:16:24.342894 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:16:24.342894 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:16:24.342894 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 15:16:24.342894 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 15:16:24.342894 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 15:16:24.342894 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 15:16:24.343844 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 15:16:24.343844 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 15:16:24.343844 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 15:16:24.343844 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 15:16:24.343844 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:16:24.343844 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:16:24.343844 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:16:24.343844 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:16:24.343844 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:16:24.343844 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:16:24.343844 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:16:24.343844 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Sep 13 15:16:24.343844 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:16:24.343844 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:16:24.343844 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:16:24.343844 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:16:24.344700 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:16:24.344700 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:16:24.344700 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:16:24.344700 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:16:24.344700 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 15:16:24.344700 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 15:16:24.344700 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 15:16:24.344700 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 15:16:24.344700 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 15:16:24.344700 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 15:16:24.344700 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 13 15:16:24.344700 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Sep 13 15:16:24.352515 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 455/885] 10.222.0.27 () {56 vars in 1120 bytes} [Tue Sep 13 15:16:24 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:16:24.354210 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bee1686-a68b-49fd-ae23-c6c41d7788cc None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:24.363492 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 431/886] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:16:24 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 15:16:24.383830 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f900c001-f73e-4a14-859c-e6b72156004b None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:24.384128 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f900c001-f73e-4a14-859c-e6b72156004b None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:24.384400 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f900c001-f73e-4a14-859c-e6b72156004b None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:24.386059 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 432/887] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:16:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 15:16:24.392396 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c78e94-3148-49c7-96eb-cae03f329a00 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:24.392855 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c78e94-3148-49c7-96eb-cae03f329a00 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:24.393462 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c78e94-3148-49c7-96eb-cae03f329a00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:24.418001 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-14c78e94-3148-49c7-96eb-cae03f329a00 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:16:24.419264 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-14c78e94-3148-49c7-96eb-cae03f329a00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:16:24.452203 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:24.480526 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bee1686-a68b-49fd-ae23-c6c41d7788cc None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:24.509631 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 433/888] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:16:24 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 15:16:24.523466 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcd1789-8a04-4b3b-a1e6-02ce5b3a9260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:24.524298 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcd1789-8a04-4b3b-a1e6-02ce5b3a9260 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:24.524741 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcd1789-8a04-4b3b-a1e6-02ce5b3a9260 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:24.525162 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcd1789-8a04-4b3b-a1e6-02ce5b3a9260 None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:24.526078 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcd1789-8a04-4b3b-a1e6-02ce5b3a9260 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:16:24.526555 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcd1789-8a04-4b3b-a1e6-02ce5b3a9260 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:24.528077 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcd1789-8a04-4b3b-a1e6-02ce5b3a9260 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:24.542613 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 456/889] 10.222.0.27 () {56 vars in 1115 bytes} [Tue Sep 13 15:16:24 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 15:16:24.544223 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c78e94-3148-49c7-96eb-cae03f329a00 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:24.630072 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcd1789-8a04-4b3b-a1e6-02ce5b3a9260 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:24.650644 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c78e94-3148-49c7-96eb-cae03f329a00 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:24.690136 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:24.695423 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f84482-02e3-4da5-8329-90920947fe09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:24.696083 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f84482-02e3-4da5-8329-90920947fe09 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:24.696362 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f84482-02e3-4da5-8329-90920947fe09 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:24.696633 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f84482-02e3-4da5-8329-90920947fe09 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:24.711583 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f84482-02e3-4da5-8329-90920947fe09 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:24.713405 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f84482-02e3-4da5-8329-90920947fe09 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:24.734925 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-08f84482-02e3-4da5-8329-90920947fe09 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 15:16:24.734925 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:16:24.734925 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:16:24.734925 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:16:24.734925 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:16:24.734925 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:16:24.734925 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:16:24.734925 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:16:24.734925 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:16:24.734925 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:16:24.734925 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:16:24.734925 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:16:24.734925 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 15:16:24.734925 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 15:16:24.734925 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 15:16:24.734925 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 15:16:24.735899 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:16:24.735899 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:16:24.735899 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:16:24.735899 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:16:24.735899 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:16:24.735899 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:16:24.735899 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:16:24.735899 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Sep 13 15:16:24.735899 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:16:24.735899 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:16:24.735899 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:16:24.735899 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:16:24.735899 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:16:24.735899 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:16:24.735899 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:16:24.735899 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:16:24.735899 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 15:16:24.736797 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 15:16:24.736797 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 15:16:24.736797 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Sep 13 15:16:24.743915 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 434/890] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 13 15:16:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:16:24.745445 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f84482-02e3-4da5-8329-90920947fe09 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:24.759353 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:24.774190 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcd1789-8a04-4b3b-a1e6-02ce5b3a9260 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:24.814170 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c97906-b186-42f3-81c5-ede455a1f34b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:24.815608 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c97906-b186-42f3-81c5-ede455a1f34b None admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:24.816592 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c97906-b186-42f3-81c5-ede455a1f34b None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:24.817248 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c97906-b186-42f3-81c5-ede455a1f34b None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:24.818292 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c97906-b186-42f3-81c5-ede455a1f34b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:24.820386 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c97906-b186-42f3-81c5-ede455a1f34b None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:24.838347 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 457/891] 10.222.0.27 () {60 vars in 1141 bytes} [Tue Sep 13 15:16:24 2022] POST /identity/v3/services => generated 241 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 15:16:24.839280 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c97906-b186-42f3-81c5-ede455a1f34b None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:24.867004 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f84482-02e3-4da5-8329-90920947fe09 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:24.917495 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f52c8a-a7b5-4866-ad5a-a6950b598f42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:24.919033 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f52c8a-a7b5-4866-ad5a-a6950b598f42 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:24.919309 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f52c8a-a7b5-4866-ad5a-a6950b598f42 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:24.919697 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f52c8a-a7b5-4866-ad5a-a6950b598f42 None admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:24.920415 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f52c8a-a7b5-4866-ad5a-a6950b598f42 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:16:24.920721 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f52c8a-a7b5-4866-ad5a-a6950b598f42 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:24.922226 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f52c8a-a7b5-4866-ad5a-a6950b598f42 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:24.936029 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 435/892] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Sep 13 15:16:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:16:24.937746 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f51111-3628-4795-ae2b-af7607c22a23 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:24.937746 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f51111-3628-4795-ae2b-af7607c22a23 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:24.937971 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f51111-3628-4795-ae2b-af7607c22a23 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:24.939977 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 436/893] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:16:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:16:24.942803 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f51111-3628-4795-ae2b-af7607c22a23 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:24.976762 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c97906-b186-42f3-81c5-ede455a1f34b None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:24.989391 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:25.019134 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef1ca17-5543-49d9-a02d-2cfaa8fa71a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:25.019397 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:25.019956 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef1ca17-5543-49d9-a02d-2cfaa8fa71a2 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:25.020303 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef1ca17-5543-49d9-a02d-2cfaa8fa71a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:25.020750 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef1ca17-5543-49d9-a02d-2cfaa8fa71a2 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:25.021541 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef1ca17-5543-49d9-a02d-2cfaa8fa71a2 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:25.022978 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef1ca17-5543-49d9-a02d-2cfaa8fa71a2 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:25.032982 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-4ef1ca17-5543-49d9-a02d-2cfaa8fa71a2 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 13 15:16:25.032982 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:16:25.032982 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 15:16:25.032982 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 15:16:25.032982 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 15:16:25.032982 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 15:16:25.032982 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 15:16:25.032982 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 15:16:25.032982 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 13 15:16:25.032982 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Sep 13 15:16:25.032982 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 15:16:25.032982 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Sep 13 15:16:25.032982 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:16:25.032982 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:16:25.032982 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:16:25.032982 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:16:25.033971 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:16:25.033971 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:16:25.033971 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:16:25.033971 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:16:25.033971 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:16:25.033971 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:16:25.033971 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:16:25.033971 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 15:16:25.033971 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 15:16:25.033971 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 15:16:25.033971 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 15:16:25.033971 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:16:25.033971 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:16:25.033971 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:16:25.033971 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:16:25.033971 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:16:25.033971 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:16:25.037027 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:16:25.037027 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Sep 13 15:16:25.037027 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:16:25.037027 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:16:25.037027 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:16:25.037027 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:16:25.037027 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:16:25.037027 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:16:25.037027 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:16:25.037027 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:16:25.037027 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 15:16:25.037027 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 15:16:25.037027 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 13 15:16:25.037027 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Sep 13 15:16:25.037027 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 458/894] 10.222.0.27 () {56 vars in 1132 bytes} [Tue Sep 13 15:16:24 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:16:25.037902 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3b7658-731c-4f82-8f0e-af3874019e35 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:25.037902 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3b7658-731c-4f82-8f0e-af3874019e35 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:25.037902 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3b7658-731c-4f82-8f0e-af3874019e35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:25.055805 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-5b3b7658-731c-4f82-8f0e-af3874019e35 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:16:25.057016 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-5b3b7658-731c-4f82-8f0e-af3874019e35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:16:25.068039 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f51111-3628-4795-ae2b-af7607c22a23 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:25.104397 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc75b3f-2fd1-4b01-8956-1859afabb2c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:25.105249 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc75b3f-2fd1-4b01-8956-1859afabb2c4 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:25.105361 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc75b3f-2fd1-4b01-8956-1859afabb2c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:25.106951 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc75b3f-2fd1-4b01-8956-1859afabb2c4 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:25.114353 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc75b3f-2fd1-4b01-8956-1859afabb2c4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:25.115840 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc75b3f-2fd1-4b01-8956-1859afabb2c4 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:25.127719 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-fbc75b3f-2fd1-4b01-8956-1859afabb2c4 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 13 15:16:25.127719 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:16:25.127719 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:16:25.127719 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:16:25.127719 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:16:25.127719 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:16:25.127719 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:16:25.127719 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:16:25.127719 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:16:25.127719 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:16:25.127719 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:16:25.127719 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:16:25.127719 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 15:16:25.127719 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 15:16:25.127719 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 15:16:25.127719 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 15:16:25.128934 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:16:25.128934 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:16:25.128934 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 15:16:25.128934 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 15:16:25.128934 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 15:16:25.128934 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 15:16:25.128934 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:16:25.128934 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:16:25.128934 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:16:25.128934 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:16:25.128934 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:16:25.128934 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Sep 13 15:16:25.128934 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:16:25.128934 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:16:25.128934 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:16:25.128934 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:16:25.128934 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:16:25.128934 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:16:25.130642 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:16:25.130642 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:16:25.130642 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 15:16:25.130642 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 15:16:25.130642 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 15:16:25.130642 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 15:16:25.130642 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 15:16:25.130642 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 15:16:25.130642 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 13 15:16:25.130642 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Sep 13 15:16:25.130642 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 437/895] 10.222.0.27 () {56 vars in 1117 bytes} [Tue Sep 13 15:16:24 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:16:25.130642 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc75b3f-2fd1-4b01-8956-1859afabb2c4 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:25.135208 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 459/896] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:16:25 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 15:16:25.135957 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3b7658-731c-4f82-8f0e-af3874019e35 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:25.247696 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3b7658-731c-4f82-8f0e-af3874019e35 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:25.251463 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:25.260808 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc75b3f-2fd1-4b01-8956-1859afabb2c4 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:25.287498 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:25.297747 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1389e3b2-9c50-43cc-8bce-235ecb156dd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:25.298366 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1389e3b2-9c50-43cc-8bce-235ecb156dd9 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:25.298647 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1389e3b2-9c50-43cc-8bce-235ecb156dd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:25.298942 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1389e3b2-9c50-43cc-8bce-235ecb156dd9 None admin] PATH_INFO: `/v3/services` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:25.299538 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1389e3b2-9c50-43cc-8bce-235ecb156dd9 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:16:25.299841 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1389e3b2-9c50-43cc-8bce-235ecb156dd9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:25.300206 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bc1f68-104e-4ecb-8b87-dc8f8b506e46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:25.301819 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bc1f68-104e-4ecb-8b87-dc8f8b506e46 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:25.301938 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1389e3b2-9c50-43cc-8bce-235ecb156dd9 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:25.302427 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bc1f68-104e-4ecb-8b87-dc8f8b506e46 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:25.303083 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bc1f68-104e-4ecb-8b87-dc8f8b506e46 None admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:25.304332 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bc1f68-104e-4ecb-8b87-dc8f8b506e46 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:16:25.304858 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bc1f68-104e-4ecb-8b87-dc8f8b506e46 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:25.306760 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bc1f68-104e-4ecb-8b87-dc8f8b506e46 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:25.311697 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 438/897] 10.222.0.27 () {56 vars in 1126 bytes} [Tue Sep 13 15:16:25 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:16:25.312618 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1389e3b2-9c50-43cc-8bce-235ecb156dd9 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:25.329123 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 460/898] 10.222.0.27 () {56 vars in 1149 bytes} [Tue Sep 13 15:16:25 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:16:25.334755 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bc1f68-104e-4ecb-8b87-dc8f8b506e46 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:25.443942 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1389e3b2-9c50-43cc-8bce-235ecb156dd9 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:25.447174 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bc1f68-104e-4ecb-8b87-dc8f8b506e46 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:25.480652 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0469edf1-f892-4c3b-8eda-d6332c669441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:25.481262 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0469edf1-f892-4c3b-8eda-d6332c669441 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:25.481549 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0469edf1-f892-4c3b-8eda-d6332c669441 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:25.481651 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567b2391-1701-445c-8c09-b60bcc1bcec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:25.481908 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0469edf1-f892-4c3b-8eda-d6332c669441 None admin] PATH_INFO: `/v3/services` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:25.482211 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567b2391-1701-445c-8c09-b60bcc1bcec5 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:25.482474 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0469edf1-f892-4c3b-8eda-d6332c669441 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:16:25.482573 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567b2391-1701-445c-8c09-b60bcc1bcec5 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:25.482774 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567b2391-1701-445c-8c09-b60bcc1bcec5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:25.482871 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0469edf1-f892-4c3b-8eda-d6332c669441 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:25.484132 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0469edf1-f892-4c3b-8eda-d6332c669441 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:25.493916 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 439/899] 10.222.0.27 () {56 vars in 1126 bytes} [Tue Sep 13 15:16:25 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:16:25.493916 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0469edf1-f892-4c3b-8eda-d6332c669441 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:25.517277 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:25.552422 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:25.556798 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567b2391-1701-445c-8c09-b60bcc1bcec5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:25.558596 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567b2391-1701-445c-8c09-b60bcc1bcec5 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:25.605455 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0469edf1-f892-4c3b-8eda-d6332c669441 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:25.644974 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010d0ebe-7100-4415-97cc-4daf32bc4eb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:25.645617 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010d0ebe-7100-4415-97cc-4daf32bc4eb1 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:25.645929 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010d0ebe-7100-4415-97cc-4daf32bc4eb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:25.646207 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010d0ebe-7100-4415-97cc-4daf32bc4eb1 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:25.646788 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010d0ebe-7100-4415-97cc-4daf32bc4eb1 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:25.648157 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010d0ebe-7100-4415-97cc-4daf32bc4eb1 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:25.657416 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-010d0ebe-7100-4415-97cc-4daf32bc4eb1 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 13 15:16:25.657416 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:16:25.657416 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 15:16:25.657416 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 15:16:25.657416 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 15:16:25.657416 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 15:16:25.657416 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 15:16:25.657416 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 15:16:25.657416 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 13 15:16:25.657416 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Sep 13 15:16:25.657416 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 15:16:25.657416 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Sep 13 15:16:25.657416 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:16:25.657416 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:16:25.657416 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:16:25.657416 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:16:25.657416 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:16:25.658566 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:16:25.658566 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:16:25.658566 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:16:25.658566 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:16:25.658566 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:16:25.658566 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:16:25.658566 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 15:16:25.658566 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 15:16:25.658566 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 15:16:25.658566 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 15:16:25.658566 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:16:25.658566 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:16:25.658566 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:16:25.658566 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:16:25.658566 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:16:25.658566 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:16:25.659773 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:16:25.659773 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Sep 13 15:16:25.659773 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:16:25.659773 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:16:25.659773 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:16:25.659773 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:16:25.659773 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:16:25.659773 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:16:25.659773 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:16:25.659773 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:16:25.659773 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 15:16:25.659773 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 15:16:25.659773 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 13 15:16:25.659773 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Sep 13 15:16:25.663628 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 440/900] 10.222.0.27 () {56 vars in 1114 bytes} [Tue Sep 13 15:16:25 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:16:25.664493 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010d0ebe-7100-4415-97cc-4daf32bc4eb1 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:25.666423 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 461/901] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Sep 13 15:16:25 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 15:16:25.667447 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567b2391-1701-445c-8c09-b60bcc1bcec5 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:25.743234 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:25.777867 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010d0ebe-7100-4415-97cc-4daf32bc4eb1 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:25.788453 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567b2391-1701-445c-8c09-b60bcc1bcec5 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:25.795975 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:25.815665 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f49a78-50cd-4e45-a331-174db9df22c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:25.816418 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f49a78-50cd-4e45-a331-174db9df22c6 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:25.816700 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f49a78-50cd-4e45-a331-174db9df22c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:25.816976 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f49a78-50cd-4e45-a331-174db9df22c6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:25.817673 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f49a78-50cd-4e45-a331-174db9df22c6 None admin] RBAC: Adding query filter params (interface=public, service_id=c7da233875604cbca86ca40832db321f, region_id=RegionOne) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:16:25.818011 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f49a78-50cd-4e45-a331-174db9df22c6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:25.819635 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f49a78-50cd-4e45-a331-174db9df22c6 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:25.829248 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 441/902] 10.222.0.27 () {56 vars in 1251 bytes} [Tue Sep 13 15:16:25 2022] GET /identity/v3/endpoints?service_id=c7da233875604cbca86ca40832db321f&interface=public®ion_id=RegionOne => generated 194 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:16:25.829248 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f49a78-50cd-4e45-a331-174db9df22c6 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:25.830415 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e9f060-29bb-4c83-8f05-2a0bf6d5114c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:25.831090 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e9f060-29bb-4c83-8f05-2a0bf6d5114c None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:25.831375 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e9f060-29bb-4c83-8f05-2a0bf6d5114c None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:25.832173 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e9f060-29bb-4c83-8f05-2a0bf6d5114c None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:25.832842 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e9f060-29bb-4c83-8f05-2a0bf6d5114c None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:16:25.833100 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e9f060-29bb-4c83-8f05-2a0bf6d5114c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:25.834488 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e9f060-29bb-4c83-8f05-2a0bf6d5114c None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:25.844020 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 462/903] 10.222.0.27 () {56 vars in 1114 bytes} [Tue Sep 13 15:16:25 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:16:25.844020 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e9f060-29bb-4c83-8f05-2a0bf6d5114c None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:25.941400 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f49a78-50cd-4e45-a331-174db9df22c6 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:25.942631 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e9f060-29bb-4c83-8f05-2a0bf6d5114c None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:25.967683 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:25.977447 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ef29e2-638a-4349-8bff-4ebce0835ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:25.978118 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ef29e2-638a-4349-8bff-4ebce0835ee8 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:25.978400 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ef29e2-638a-4349-8bff-4ebce0835ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:25.978674 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ef29e2-638a-4349-8bff-4ebce0835ee8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:25.978948 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f368f8-91d4-4622-8b6e-42a168fcff5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:25.979559 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f368f8-91d4-4622-8b6e-42a168fcff5e None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:25.979844 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f368f8-91d4-4622-8b6e-42a168fcff5e None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:25.980126 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f368f8-91d4-4622-8b6e-42a168fcff5e None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:25.980905 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f368f8-91d4-4622-8b6e-42a168fcff5e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:25.982312 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f368f8-91d4-4622-8b6e-42a168fcff5e None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:25.990220 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ef29e2-638a-4349-8bff-4ebce0835ee8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:25.991669 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ef29e2-638a-4349-8bff-4ebce0835ee8 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:25.994130 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 463/904] 10.222.0.27 () {56 vars in 1087 bytes} [Tue Sep 13 15:16:25 2022] GET /identity/v3/services => generated 1497 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 15:16:25.995820 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f368f8-91d4-4622-8b6e-42a168fcff5e None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:26.009011 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-b1ef29e2-638a-4349-8bff-4ebce0835ee8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 15:16:26.009011 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:16:26.009011 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:16:26.009011 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:16:26.009011 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:16:26.009011 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:16:26.009011 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:16:26.009011 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:16:26.009011 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:16:26.009011 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:16:26.009011 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:16:26.009011 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:16:26.009011 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 15:16:26.009011 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 15:16:26.009011 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 15:16:26.009011 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 15:16:26.010309 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:16:26.010309 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:16:26.010309 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:16:26.010309 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:16:26.010309 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:16:26.010309 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:16:26.010309 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:16:26.010309 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Sep 13 15:16:26.010309 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:16:26.010309 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:16:26.010309 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:16:26.010309 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:16:26.010309 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:16:26.010309 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:16:26.010309 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:16:26.010309 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:16:26.010309 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 15:16:26.011570 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 15:16:26.011570 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 15:16:26.011570 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Sep 13 15:16:26.015387 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 442/905] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 13 15:16:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:16:26.016385 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ef29e2-638a-4349-8bff-4ebce0835ee8 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:26.058355 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:26.139091 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ef29e2-638a-4349-8bff-4ebce0835ee8 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:26.151433 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f368f8-91d4-4622-8b6e-42a168fcff5e None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:26.183259 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cd7b7a-80e6-4cd5-a2c3-247323c82fc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:26.183893 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cd7b7a-80e6-4cd5-a2c3-247323c82fc6 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:26.184178 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cd7b7a-80e6-4cd5-a2c3-247323c82fc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:26.184458 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cd7b7a-80e6-4cd5-a2c3-247323c82fc6 None admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:26.185111 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cd7b7a-80e6-4cd5-a2c3-247323c82fc6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:16:26.185422 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cd7b7a-80e6-4cd5-a2c3-247323c82fc6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:26.187673 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cd7b7a-80e6-4cd5-a2c3-247323c82fc6 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:26.201016 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33a1608-b063-48cf-b133-6bbe574c7299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:26.201219 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 443/906] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Sep 13 15:16:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:16:26.202176 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33a1608-b063-48cf-b133-6bbe574c7299 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:26.202589 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33a1608-b063-48cf-b133-6bbe574c7299 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:26.202933 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33a1608-b063-48cf-b133-6bbe574c7299 None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:26.203636 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33a1608-b063-48cf-b133-6bbe574c7299 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:16:26.204013 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33a1608-b063-48cf-b133-6bbe574c7299 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:26.205488 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33a1608-b063-48cf-b133-6bbe574c7299 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:26.206846 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cd7b7a-80e6-4cd5-a2c3-247323c82fc6 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:26.212376 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 464/907] 10.222.0.27 () {56 vars in 1114 bytes} [Tue Sep 13 15:16:25 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:16:26.218899 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33a1608-b063-48cf-b133-6bbe574c7299 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:26.294960 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:26.314161 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:26.324717 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cd7b7a-80e6-4cd5-a2c3-247323c82fc6 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:26.361047 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33a1608-b063-48cf-b133-6bbe574c7299 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:26.364138 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e1aa01-0d7f-4f09-a071-4b7a95aaece9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:26.365045 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e1aa01-0d7f-4f09-a071-4b7a95aaece9 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:26.365550 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e1aa01-0d7f-4f09-a071-4b7a95aaece9 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:26.366058 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e1aa01-0d7f-4f09-a071-4b7a95aaece9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:26.373790 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e1aa01-0d7f-4f09-a071-4b7a95aaece9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:26.375491 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e1aa01-0d7f-4f09-a071-4b7a95aaece9 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:26.389441 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-29e1aa01-0d7f-4f09-a071-4b7a95aaece9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 15:16:26.389441 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:16:26.389441 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:16:26.389441 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:16:26.389441 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:16:26.389441 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:16:26.389441 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:16:26.389441 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:16:26.389441 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:16:26.389441 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:16:26.389441 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:16:26.389441 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:16:26.389441 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 15:16:26.389441 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 15:16:26.389441 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 15:16:26.390418 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 15:16:26.390418 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:16:26.390418 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:16:26.390418 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:16:26.390418 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:16:26.390418 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:16:26.390418 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:16:26.390418 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:16:26.390418 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Sep 13 15:16:26.390418 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:16:26.390418 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:16:26.390418 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:16:26.390418 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:16:26.390418 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:16:26.390418 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:16:26.390418 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:16:26.390418 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:16:26.391323 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 15:16:26.391323 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 15:16:26.391323 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 15:16:26.391323 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 15:16:26.391323 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 15:16:26.391323 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 15:16:26.391323 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 15:16:26.391323 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Sep 13 15:16:26.394423 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 444/908] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Sep 13 15:16:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:16:26.399813 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e1aa01-0d7f-4f09-a071-4b7a95aaece9 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:26.403649 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89ccbc2-6526-447e-8f54-ce6abe4e0d35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:26.404276 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89ccbc2-6526-447e-8f54-ce6abe4e0d35 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:26.404561 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89ccbc2-6526-447e-8f54-ce6abe4e0d35 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:26.404841 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89ccbc2-6526-447e-8f54-ce6abe4e0d35 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:26.405548 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89ccbc2-6526-447e-8f54-ce6abe4e0d35 None admin] RBAC: Adding query filter params (interface=public, service_id=8dc8b0761cf240e9a8990476f4974184, region_id=RegionOne) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:16:26.405895 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89ccbc2-6526-447e-8f54-ce6abe4e0d35 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:26.407272 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89ccbc2-6526-447e-8f54-ce6abe4e0d35 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:26.417618 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 465/909] 10.222.0.27 () {56 vars in 1251 bytes} [Tue Sep 13 15:16:26 2022] GET /identity/v3/endpoints?service_id=8dc8b0761cf240e9a8990476f4974184&interface=public®ion_id=RegionOne => generated 194 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 15:16:26.418909 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89ccbc2-6526-447e-8f54-ce6abe4e0d35 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:26.519782 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e1aa01-0d7f-4f09-a071-4b7a95aaece9 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:26.544349 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89ccbc2-6526-447e-8f54-ce6abe4e0d35 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:26.562704 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030569c6-7584-4298-85a6-8fa857232cb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:26.563415 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030569c6-7584-4298-85a6-8fa857232cb3 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:26.563718 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030569c6-7584-4298-85a6-8fa857232cb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:26.563999 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030569c6-7584-4298-85a6-8fa857232cb3 None admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:26.564753 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030569c6-7584-4298-85a6-8fa857232cb3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:16:26.565006 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030569c6-7584-4298-85a6-8fa857232cb3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:26.566823 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030569c6-7584-4298-85a6-8fa857232cb3 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:26.570781 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:26.585736 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 445/910] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Sep 13 15:16:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:16:26.588039 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030569c6-7584-4298-85a6-8fa857232cb3 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:26.594006 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a265d61a-7a52-47d8-bb9a-e4d0a0f78699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:26.594625 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a265d61a-7a52-47d8-bb9a-e4d0a0f78699 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:26.594908 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a265d61a-7a52-47d8-bb9a-e4d0a0f78699 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:26.595184 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a265d61a-7a52-47d8-bb9a-e4d0a0f78699 None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:26.595796 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a265d61a-7a52-47d8-bb9a-e4d0a0f78699 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:26.597305 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a265d61a-7a52-47d8-bb9a-e4d0a0f78699 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:26.609745 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 466/911] 10.222.0.27 () {56 vars in 1087 bytes} [Tue Sep 13 15:16:26 2022] GET /identity/v3/services => generated 1497 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 15:16:26.614587 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:26.729760 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030569c6-7584-4298-85a6-8fa857232cb3 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:26.766801 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568a2bb8-0a9c-49f4-a955-a0bebab663e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:26.767681 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568a2bb8-0a9c-49f4-a955-a0bebab663e8 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:26.768145 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568a2bb8-0a9c-49f4-a955-a0bebab663e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:26.768624 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568a2bb8-0a9c-49f4-a955-a0bebab663e8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:26.769686 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568a2bb8-0a9c-49f4-a955-a0bebab663e8 None admin] RBAC: Adding query filter params (role.id=d2befaf77d3b4b15850920535a772db0, scope.project.id=3d6e00339cfa47d2a6fa8724c587035f, user.id=e97bcdb20f1e416ea41b99c226617faf) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:16:26.770336 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568a2bb8-0a9c-49f4-a955-a0bebab663e8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:26.772027 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568a2bb8-0a9c-49f4-a955-a0bebab663e8 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:26.779194 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 446/912] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Sep 13 15:16:26 2022] GET /identity/v3/role_assignments?user.id=e97bcdb20f1e416ea41b99c226617faf&scope.project.id=3d6e00339cfa47d2a6fa8724c587035f&role.id=d2befaf77d3b4b15850920535a772db0 => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:16:27.058802 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54597040-38b7-4b5c-88c8-c41d9620e74f None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:27.059323 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54597040-38b7-4b5c-88c8-c41d9620e74f None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:27.059400 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54597040-38b7-4b5c-88c8-c41d9620e74f None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:27.060848 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 467/913] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:16:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:16:27.067015 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641f82b2-30f3-45e3-a644-c83fbc9ffe73 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:27.067813 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641f82b2-30f3-45e3-a644-c83fbc9ffe73 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:27.068291 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641f82b2-30f3-45e3-a644-c83fbc9ffe73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:27.087297 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-641f82b2-30f3-45e3-a644-c83fbc9ffe73 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:16:27.088762 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-641f82b2-30f3-45e3-a644-c83fbc9ffe73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:16:27.156711 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 447/914] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:16:27 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 15:16:27.427590 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54597040-38b7-4b5c-88c8-c41d9620e74f None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:27.531781 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54597040-38b7-4b5c-88c8-c41d9620e74f None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:27.571615 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aef5271-880e-4baf-84c5-ea6ae136431c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:27.572647 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aef5271-880e-4baf-84c5-ea6ae136431c None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:27.573154 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aef5271-880e-4baf-84c5-ea6ae136431c None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:27.573626 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aef5271-880e-4baf-84c5-ea6ae136431c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:27.574468 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aef5271-880e-4baf-84c5-ea6ae136431c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:27.576121 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aef5271-880e-4baf-84c5-ea6ae136431c None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:27.586800 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-3aef5271-880e-4baf-84c5-ea6ae136431c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 15:16:27.586800 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:16:27.586800 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 15:16:27.586800 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 15:16:27.586800 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 15:16:27.586800 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 15:16:27.586800 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 15:16:27.586800 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 15:16:27.586800 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 15:16:27.586800 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Sep 13 15:16:27.586800 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 15:16:27.586800 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Sep 13 15:16:27.586800 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:16:27.586800 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:16:27.586800 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:16:27.586800 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:16:27.586800 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:16:27.587864 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:16:27.587864 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:16:27.587864 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:16:27.587864 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:16:27.587864 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:16:27.587864 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:16:27.587864 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 15:16:27.587864 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 15:16:27.587864 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 15:16:27.587864 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 15:16:27.587864 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:16:27.587864 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:16:27.587864 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:16:27.587864 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:16:27.587864 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:16:27.587864 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:16:27.588698 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:16:27.588698 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Sep 13 15:16:27.588698 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:16:27.588698 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:16:27.588698 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:16:27.588698 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:16:27.588698 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:16:27.588698 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:16:27.588698 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:16:27.588698 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:16:27.588698 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 15:16:27.588698 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 15:16:27.588698 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 15:16:27.588698 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Sep 13 15:16:27.591521 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 468/915] 10.222.0.27 () {56 vars in 1126 bytes} [Tue Sep 13 15:16:27 2022] GET /identity/v3/services/object-store => generated 93 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:16:27.598611 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641f82b2-30f3-45e3-a644-c83fbc9ffe73 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:27.630395 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:27.701589 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641f82b2-30f3-45e3-a644-c83fbc9ffe73 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:27.749567 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4e3c4e-977c-4c09-8b45-2bdee8abebe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:27.750218 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4e3c4e-977c-4c09-8b45-2bdee8abebe3 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:27.750499 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4e3c4e-977c-4c09-8b45-2bdee8abebe3 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:27.750775 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4e3c4e-977c-4c09-8b45-2bdee8abebe3 None admin] PATH_INFO: `/v3/services` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:27.751412 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4e3c4e-977c-4c09-8b45-2bdee8abebe3 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:16:27.751717 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4e3c4e-977c-4c09-8b45-2bdee8abebe3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:27.753087 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4e3c4e-977c-4c09-8b45-2bdee8abebe3 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:27.758744 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 448/916] 10.222.0.27 () {56 vars in 1122 bytes} [Tue Sep 13 15:16:27 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:16:27.764453 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aef5271-880e-4baf-84c5-ea6ae136431c None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:27.813952 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:27.875399 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aef5271-880e-4baf-84c5-ea6ae136431c None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:27.910751 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eefc61-2fbd-49ec-8454-3c8d118c1973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:27.911360 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eefc61-2fbd-49ec-8454-3c8d118c1973 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:27.911647 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eefc61-2fbd-49ec-8454-3c8d118c1973 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:27.911920 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eefc61-2fbd-49ec-8454-3c8d118c1973 None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:27.912550 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56eefc61-2fbd-49ec-8454-3c8d118c1973 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:16:27.912911 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56eefc61-2fbd-49ec-8454-3c8d118c1973 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:27.914363 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56eefc61-2fbd-49ec-8454-3c8d118c1973 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:27.919681 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 469/917] 10.222.0.27 () {56 vars in 1122 bytes} [Tue Sep 13 15:16:27 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:16:27.925858 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4e3c4e-977c-4c09-8b45-2bdee8abebe3 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:27.996110 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:28.027868 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4e3c4e-977c-4c09-8b45-2bdee8abebe3 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:28.062029 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0abc28a-2b3b-40f3-b1d1-3ca63400843f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:28.062821 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0abc28a-2b3b-40f3-b1d1-3ca63400843f None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:28.063103 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0abc28a-2b3b-40f3-b1d1-3ca63400843f None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:28.063376 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0abc28a-2b3b-40f3-b1d1-3ca63400843f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:28.064071 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0abc28a-2b3b-40f3-b1d1-3ca63400843f None admin] RBAC: Adding query filter params (interface=public, service_id=fb6f48622bd8485cb4ef5bc849010052, region_id=RegionOne) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:16:28.064381 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0abc28a-2b3b-40f3-b1d1-3ca63400843f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:28.066332 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0abc28a-2b3b-40f3-b1d1-3ca63400843f None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:28.071900 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 449/918] 10.222.0.27 () {56 vars in 1251 bytes} [Tue Sep 13 15:16:27 2022] GET /identity/v3/endpoints?service_id=fb6f48622bd8485cb4ef5bc849010052&interface=public®ion_id=RegionOne => generated 194 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:16:28.077727 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eefc61-2fbd-49ec-8454-3c8d118c1973 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:28.186110 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eefc61-2fbd-49ec-8454-3c8d118c1973 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:28.199296 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:28.225481 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4b9ac7-fc16-45b9-9768-f8b915d6374f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:28.226120 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4b9ac7-fc16-45b9-9768-f8b915d6374f None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:28.226400 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4b9ac7-fc16-45b9-9768-f8b915d6374f None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:28.226673 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4b9ac7-fc16-45b9-9768-f8b915d6374f None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:28.227282 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4b9ac7-fc16-45b9-9768-f8b915d6374f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:28.228752 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4b9ac7-fc16-45b9-9768-f8b915d6374f None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:28.237130 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 470/919] 10.222.0.27 () {56 vars in 1087 bytes} [Tue Sep 13 15:16:28 2022] GET /identity/v3/services => generated 1497 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 15:16:28.295570 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d975c24e-4f6a-4d18-bb52-fb2a97512330 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:28.295768 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d975c24e-4f6a-4d18-bb52-fb2a97512330 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:28.296036 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d975c24e-4f6a-4d18-bb52-fb2a97512330 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:28.297647 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 450/920] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:16:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:16:28.304178 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c0e2dd-977a-4c97-a2c5-a9c8a03ce8d8 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:28.304521 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c0e2dd-977a-4c97-a2c5-a9c8a03ce8d8 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:28.304736 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c0e2dd-977a-4c97-a2c5-a9c8a03ce8d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:28.325222 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-d2c0e2dd-977a-4c97-a2c5-a9c8a03ce8d8 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:16:28.326472 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-d2c0e2dd-977a-4c97-a2c5-a9c8a03ce8d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:16:28.402317 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 471/921] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:16:28 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 15:16:28.672575 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d975c24e-4f6a-4d18-bb52-fb2a97512330 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:28.791017 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d975c24e-4f6a-4d18-bb52-fb2a97512330 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:28.832182 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59127a77-8787-4f1d-a4c0-0f70e5edf13b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:28.832854 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59127a77-8787-4f1d-a4c0-0f70e5edf13b None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:28.833142 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59127a77-8787-4f1d-a4c0-0f70e5edf13b None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:28.833417 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59127a77-8787-4f1d-a4c0-0f70e5edf13b None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:28.834048 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59127a77-8787-4f1d-a4c0-0f70e5edf13b None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:28.835407 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59127a77-8787-4f1d-a4c0-0f70e5edf13b None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:28.838237 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:28.847480 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-59127a77-8787-4f1d-a4c0-0f70e5edf13b None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 13 15:16:28.847480 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:16:28.847480 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 15:16:28.847480 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 15:16:28.847480 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 15:16:28.847480 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 15:16:28.847480 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 15:16:28.847480 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 15:16:28.847480 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 13 15:16:28.847480 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Sep 13 15:16:28.847480 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 15:16:28.847480 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Sep 13 15:16:28.847480 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:16:28.847480 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:16:28.847480 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:16:28.847480 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:16:28.848453 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:16:28.848453 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:16:28.848453 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:16:28.848453 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:16:28.848453 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:16:28.848453 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:16:28.848453 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:16:28.848453 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 15:16:28.848453 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 15:16:28.848453 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 15:16:28.848453 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 15:16:28.848453 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:16:28.848453 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:16:28.848453 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:16:28.848453 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:16:28.848453 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:16:28.848453 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:16:28.849357 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:16:28.849357 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Sep 13 15:16:28.849357 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:16:28.849357 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:16:28.849357 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:16:28.849357 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:16:28.849357 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:16:28.849357 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:16:28.849357 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:16:28.849357 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:16:28.849357 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 15:16:28.849357 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 15:16:28.849357 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 13 15:16:28.849357 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Sep 13 15:16:28.849357 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 451/922] 10.222.0.27 () {56 vars in 1132 bytes} [Tue Sep 13 15:16:28 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:16:28.856569 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c0e2dd-977a-4c97-a2c5-a9c8a03ce8d8 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:28.916007 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09539eb8-2a04-4aff-aca6-1b7f80d4da25 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:28.916334 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09539eb8-2a04-4aff-aca6-1b7f80d4da25 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:28.917327 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09539eb8-2a04-4aff-aca6-1b7f80d4da25 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:28.918931 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 452/923] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:16:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 15:16:28.925810 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d02b231-1422-4ac5-85b1-ddb7b6dd0398 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:28.926126 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d02b231-1422-4ac5-85b1-ddb7b6dd0398 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:28.926465 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d02b231-1422-4ac5-85b1-ddb7b6dd0398 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:28.949300 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-6d02b231-1422-4ac5-85b1-ddb7b6dd0398 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:16:28.951255 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-6d02b231-1422-4ac5-85b1-ddb7b6dd0398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:16:28.969295 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c0e2dd-977a-4c97-a2c5-a9c8a03ce8d8 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:28.972858 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:29.008565 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d4643a-ed2d-4aa3-86fe-0d6307710b88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:29.009479 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d4643a-ed2d-4aa3-86fe-0d6307710b88 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:29.009959 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d4643a-ed2d-4aa3-86fe-0d6307710b88 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:29.010408 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d4643a-ed2d-4aa3-86fe-0d6307710b88 None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:29.011253 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d4643a-ed2d-4aa3-86fe-0d6307710b88 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:16:29.011739 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d4643a-ed2d-4aa3-86fe-0d6307710b88 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:29.013315 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d4643a-ed2d-4aa3-86fe-0d6307710b88 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:29.024012 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 472/924] 10.222.0.27 () {56 vars in 1126 bytes} [Tue Sep 13 15:16:28 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:16:29.025347 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d4643a-ed2d-4aa3-86fe-0d6307710b88 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:29.041870 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 453/925] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:16:28 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 15:16:29.144577 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d4643a-ed2d-4aa3-86fe-0d6307710b88 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:29.147353 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c93f1f-7072-498a-b49b-58ae10fad543 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:29.147764 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c93f1f-7072-498a-b49b-58ae10fad543 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:29.147920 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c93f1f-7072-498a-b49b-58ae10fad543 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:29.149648 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 454/926] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:16:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 15:16:29.155523 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc138f8-335a-4251-9774-a0841ec3d623 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:29.155523 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc138f8-335a-4251-9774-a0841ec3d623 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:29.155808 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc138f8-335a-4251-9774-a0841ec3d623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:29.175188 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-9bc138f8-335a-4251-9774-a0841ec3d623 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:16:29.176467 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-9bc138f8-335a-4251-9774-a0841ec3d623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:16:29.186400 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e346a099-5677-481f-80ec-be78e9342e7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:29.187278 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e346a099-5677-481f-80ec-be78e9342e7a None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:29.187733 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e346a099-5677-481f-80ec-be78e9342e7a None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:29.188188 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e346a099-5677-481f-80ec-be78e9342e7a None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:29.188990 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e346a099-5677-481f-80ec-be78e9342e7a None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:16:29.189514 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e346a099-5677-481f-80ec-be78e9342e7a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:29.191616 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e346a099-5677-481f-80ec-be78e9342e7a None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:29.197394 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 473/927] 10.222.0.27 () {56 vars in 1126 bytes} [Tue Sep 13 15:16:29 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:16:29.203145 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e346a099-5677-481f-80ec-be78e9342e7a None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:29.236352 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:29.253803 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 455/928] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:16:29 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 15:16:29.309402 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e346a099-5677-481f-80ec-be78e9342e7a None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:29.314965 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc138f8-335a-4251-9774-a0841ec3d623 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:29.345454 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58c7625-7813-480b-a8f1-19f7fd27355e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:29.346089 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58c7625-7813-480b-a8f1-19f7fd27355e None admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:29.346366 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58c7625-7813-480b-a8f1-19f7fd27355e None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:29.346638 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58c7625-7813-480b-a8f1-19f7fd27355e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:29.347641 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58c7625-7813-480b-a8f1-19f7fd27355e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:29.349027 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58c7625-7813-480b-a8f1-19f7fd27355e None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:29.371801 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 474/929] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 13 15:16:29 2022] POST /identity/v3/endpoints => generated 347 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 15:16:29.390214 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:29.435603 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc138f8-335a-4251-9774-a0841ec3d623 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:29.482292 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfcad7e-f42f-4a55-b7dd-8bb0f510ac06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:29.482950 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfcad7e-f42f-4a55-b7dd-8bb0f510ac06 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:29.483235 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfcad7e-f42f-4a55-b7dd-8bb0f510ac06 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:29.483515 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfcad7e-f42f-4a55-b7dd-8bb0f510ac06 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:29.484109 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfcad7e-f42f-4a55-b7dd-8bb0f510ac06 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:29.485489 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfcad7e-f42f-4a55-b7dd-8bb0f510ac06 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:29.495850 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-4bfcad7e-f42f-4a55-b7dd-8bb0f510ac06 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 13 15:16:29.495850 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:16:29.495850 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 15:16:29.495850 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 15:16:29.495850 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 15:16:29.495850 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 15:16:29.495850 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 15:16:29.495850 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 15:16:29.495850 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 13 15:16:29.495850 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Sep 13 15:16:29.495850 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 15:16:29.495850 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Sep 13 15:16:29.495850 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:16:29.495850 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:16:29.495850 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:16:29.495850 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:16:29.495850 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:16:29.496932 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:16:29.496932 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:16:29.496932 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:16:29.496932 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:16:29.496932 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:16:29.496932 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:16:29.496932 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 15:16:29.496932 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 15:16:29.496932 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 15:16:29.496932 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 15:16:29.496932 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:16:29.496932 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:16:29.496932 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:16:29.496932 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:16:29.496932 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:16:29.496932 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:16:29.498073 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:16:29.498073 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Sep 13 15:16:29.498073 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:16:29.498073 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:16:29.498073 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:16:29.498073 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:16:29.498073 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:16:29.498073 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:16:29.498073 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:16:29.498073 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:16:29.498073 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 15:16:29.498073 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 15:16:29.498073 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 13 15:16:29.498073 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Sep 13 15:16:29.498073 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 456/930] 10.222.0.27 () {56 vars in 1114 bytes} [Tue Sep 13 15:16:29 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:16:29.506203 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58c7625-7813-480b-a8f1-19f7fd27355e None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:29.540880 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfcad7e-f42f-4a55-b7dd-8bb0f510ac06 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:29.616754 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:29.633081 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58c7625-7813-480b-a8f1-19f7fd27355e None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:29.669564 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfcad7e-f42f-4a55-b7dd-8bb0f510ac06 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:29.672432 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711e542d-8452-493f-ab64-a32cfb4a1c73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:29.673247 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711e542d-8452-493f-ab64-a32cfb4a1c73 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:29.673679 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711e542d-8452-493f-ab64-a32cfb4a1c73 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:29.674120 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711e542d-8452-493f-ab64-a32cfb4a1c73 None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:29.675423 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711e542d-8452-493f-ab64-a32cfb4a1c73 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:16:29.675957 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711e542d-8452-493f-ab64-a32cfb4a1c73 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:29.677584 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711e542d-8452-493f-ab64-a32cfb4a1c73 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:29.683519 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 475/931] 10.222.0.27 () {56 vars in 1114 bytes} [Tue Sep 13 15:16:29 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:16:29.689301 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711e542d-8452-493f-ab64-a32cfb4a1c73 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:29.702095 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:29.719254 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1774e0c3-105f-4133-a61c-3b1ed3486672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:29.720244 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1774e0c3-105f-4133-a61c-3b1ed3486672 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:29.720788 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1774e0c3-105f-4133-a61c-3b1ed3486672 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:29.721302 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1774e0c3-105f-4133-a61c-3b1ed3486672 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:29.733142 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1774e0c3-105f-4133-a61c-3b1ed3486672 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 15:16:29.739476 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-1774e0c3-105f-4133-a61c-3b1ed3486672 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 13 15:16:29.739476 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:16:29.739476 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:16:29.739476 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:16:29.739476 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:16:29.739476 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:16:29.739476 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:16:29.739476 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:16:29.739476 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:16:29.739476 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:16:29.739476 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:16:29.739476 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:16:29.739476 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 15:16:29.739476 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 15:16:29.739476 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 15:16:29.739476 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 15:16:29.740432 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 15:16:29.740432 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 15:16:29.740432 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 15:16:29.740432 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 15:16:29.740432 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:16:29.740432 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:16:29.740432 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:16:29.740432 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:16:29.740432 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:16:29.740432 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:16:29.740432 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:16:29.740432 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Sep 13 15:16:29.740432 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:16:29.740432 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:16:29.740432 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:16:29.740432 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:16:29.741308 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:16:29.741308 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:16:29.741308 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:16:29.741308 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:16:29.741308 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 15:16:29.741308 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 15:16:29.741308 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 15:16:29.741308 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 15:16:29.741308 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 15:16:29.741308 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 15:16:29.741308 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 13 15:16:29.741308 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Sep 13 15:16:29.743949 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 457/932] 10.222.0.27 () {56 vars in 1120 bytes} [Tue Sep 13 15:16:29 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 15:16:29.749983 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1774e0c3-105f-4133-a61c-3b1ed3486672 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:29.823666 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711e542d-8452-493f-ab64-a32cfb4a1c73 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:29.867491 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1774e0c3-105f-4133-a61c-3b1ed3486672 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:29.869584 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecae0829-aeb1-41a7-8228-3d8fabd53e81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:29.870228 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecae0829-aeb1-41a7-8228-3d8fabd53e81 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:29.870509 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecae0829-aeb1-41a7-8228-3d8fabd53e81 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:29.870785 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecae0829-aeb1-41a7-8228-3d8fabd53e81 None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:29.872317 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecae0829-aeb1-41a7-8228-3d8fabd53e81 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:16:29.872630 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecae0829-aeb1-41a7-8228-3d8fabd53e81 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:29.874032 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecae0829-aeb1-41a7-8228-3d8fabd53e81 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:29.886446 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 476/933] 10.222.0.27 () {56 vars in 1114 bytes} [Tue Sep 13 15:16:29 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 15:16:29.888270 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecae0829-aeb1-41a7-8228-3d8fabd53e81 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:29.910735 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408e3b4c-24d7-438a-b6f6-51831f8855eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:29.911756 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408e3b4c-24d7-438a-b6f6-51831f8855eb None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:29.912247 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408e3b4c-24d7-438a-b6f6-51831f8855eb None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:29.912779 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408e3b4c-24d7-438a-b6f6-51831f8855eb None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:29.912946 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:29.913902 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408e3b4c-24d7-438a-b6f6-51831f8855eb None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:16:29.914463 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408e3b4c-24d7-438a-b6f6-51831f8855eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:29.916120 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408e3b4c-24d7-438a-b6f6-51831f8855eb None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:29.931553 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 458/934] 10.222.0.27 () {56 vars in 1115 bytes} [Tue Sep 13 15:16:29 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 15:16:29.932655 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408e3b4c-24d7-438a-b6f6-51831f8855eb None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:29.980959 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:30.026501 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecae0829-aeb1-41a7-8228-3d8fabd53e81 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:30.044440 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408e3b4c-24d7-438a-b6f6-51831f8855eb None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:30.076142 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad848d38-43b6-4b66-a0ba-9deabbe4ce18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:30.076957 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad848d38-43b6-4b66-a0ba-9deabbe4ce18 None admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:30.077345 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad848d38-43b6-4b66-a0ba-9deabbe4ce18 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:30.077745 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad848d38-43b6-4b66-a0ba-9deabbe4ce18 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:30.078663 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad848d38-43b6-4b66-a0ba-9deabbe4ce18 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:30.080116 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad848d38-43b6-4b66-a0ba-9deabbe4ce18 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:30.092853 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65411198-53f1-4afb-8d4f-90131763434e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:30.094037 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65411198-53f1-4afb-8d4f-90131763434e None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:30.094325 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65411198-53f1-4afb-8d4f-90131763434e None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:30.094622 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65411198-53f1-4afb-8d4f-90131763434e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:30.105281 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 477/935] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 13 15:16:29 2022] POST /identity/v3/endpoints => generated 346 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:16:30.117555 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65411198-53f1-4afb-8d4f-90131763434e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:30.119513 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65411198-53f1-4afb-8d4f-90131763434e None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:30.137165 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-65411198-53f1-4afb-8d4f-90131763434e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 15:16:30.137165 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:16:30.137165 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:16:30.137165 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:16:30.137165 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:16:30.137165 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:16:30.137165 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:16:30.137165 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:16:30.137165 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:16:30.137165 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:16:30.137165 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:16:30.137165 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:16:30.137165 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 15:16:30.137165 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 15:16:30.137165 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 15:16:30.137165 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 15:16:30.138204 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:16:30.138204 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:16:30.138204 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:16:30.138204 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:16:30.138204 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:16:30.138204 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:16:30.138204 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:16:30.138204 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Sep 13 15:16:30.138204 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:16:30.138204 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:16:30.138204 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:16:30.138204 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:16:30.138204 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:16:30.138204 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:16:30.138204 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:16:30.138204 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:16:30.138204 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 15:16:30.139105 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 15:16:30.139105 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 15:16:30.139105 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Sep 13 15:16:30.141459 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 459/936] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 13 15:16:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 15:16:30.148434 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad848d38-43b6-4b66-a0ba-9deabbe4ce18 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:30.234225 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:30.277878 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad848d38-43b6-4b66-a0ba-9deabbe4ce18 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:30.315940 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f54c1e2-d4cc-4e43-af6e-af3b270afe23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:30.316557 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f54c1e2-d4cc-4e43-af6e-af3b270afe23 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:30.316842 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f54c1e2-d4cc-4e43-af6e-af3b270afe23 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:30.317120 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f54c1e2-d4cc-4e43-af6e-af3b270afe23 None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:30.317807 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f54c1e2-d4cc-4e43-af6e-af3b270afe23 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:16:30.318118 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f54c1e2-d4cc-4e43-af6e-af3b270afe23 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:30.319833 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f54c1e2-d4cc-4e43-af6e-af3b270afe23 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:30.333452 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 478/937] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Sep 13 15:16:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:16:30.339622 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65411198-53f1-4afb-8d4f-90131763434e None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:30.446033 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:30.454683 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65411198-53f1-4afb-8d4f-90131763434e None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:30.471380 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d62082-8b5c-463a-9aa1-1db7f62e8fa3 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:30.471664 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d62082-8b5c-463a-9aa1-1db7f62e8fa3 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:30.472014 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d62082-8b5c-463a-9aa1-1db7f62e8fa3 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:30.473595 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 479/938] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:16:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 15:16:30.478532 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571309e2-8b59-4427-b45d-f9707a0aba11 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:30.478817 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571309e2-8b59-4427-b45d-f9707a0aba11 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:30.479093 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571309e2-8b59-4427-b45d-f9707a0aba11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:30.495467 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152e3b74-10ef-4fc0-86c9-094d89127578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:30.496786 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-571309e2-8b59-4427-b45d-f9707a0aba11 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:16:30.497130 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152e3b74-10ef-4fc0-86c9-094d89127578 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:30.497831 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152e3b74-10ef-4fc0-86c9-094d89127578 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:30.497991 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-571309e2-8b59-4427-b45d-f9707a0aba11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:16:30.498636 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152e3b74-10ef-4fc0-86c9-094d89127578 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:30.513946 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152e3b74-10ef-4fc0-86c9-094d89127578 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:30.515708 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152e3b74-10ef-4fc0-86c9-094d89127578 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:30.531047 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-152e3b74-10ef-4fc0-86c9-094d89127578 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 13 15:16:30.531047 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:16:30.531047 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:16:30.531047 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:16:30.531047 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:16:30.531047 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:16:30.531047 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:16:30.531047 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:16:30.531047 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:16:30.531047 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:16:30.531047 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:16:30.531047 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:16:30.531047 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 15:16:30.531047 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 15:16:30.531047 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 15:16:30.531047 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 15:16:30.532185 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:16:30.532185 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:16:30.532185 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 15:16:30.532185 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 15:16:30.532185 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 15:16:30.532185 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 15:16:30.532185 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:16:30.532185 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:16:30.532185 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:16:30.532185 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:16:30.532185 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:16:30.532185 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Sep 13 15:16:30.532185 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:16:30.532185 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:16:30.532185 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:16:30.532185 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:16:30.532185 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:16:30.532185 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:16:30.533104 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:16:30.533104 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:16:30.533104 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 15:16:30.533104 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 15:16:30.533104 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 15:16:30.533104 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 15:16:30.533104 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 15:16:30.533104 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 15:16:30.533104 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 13 15:16:30.533104 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Sep 13 15:16:30.533104 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 460/939] 10.222.0.27 () {56 vars in 1117 bytes} [Tue Sep 13 15:16:30 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:16:30.538379 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152e3b74-10ef-4fc0-86c9-094d89127578 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:30.585729 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 480/940] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:16:30 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 15:16:30.656122 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152e3b74-10ef-4fc0-86c9-094d89127578 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:30.692547 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61079995-f886-4ece-8891-18fe17030a7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:30.693166 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61079995-f886-4ece-8891-18fe17030a7e None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:30.693727 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61079995-f886-4ece-8891-18fe17030a7e None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:30.694012 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61079995-f886-4ece-8891-18fe17030a7e None admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:30.694752 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61079995-f886-4ece-8891-18fe17030a7e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:16:30.695064 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61079995-f886-4ece-8891-18fe17030a7e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:30.696494 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61079995-f886-4ece-8891-18fe17030a7e None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:30.716151 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 461/941] 10.222.0.27 () {56 vars in 1149 bytes} [Tue Sep 13 15:16:30 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 15:16:30.722509 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571309e2-8b59-4427-b45d-f9707a0aba11 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:30.788871 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:30.829218 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571309e2-8b59-4427-b45d-f9707a0aba11 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:30.866122 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76843a2-dbf1-468e-b04e-9e56d61d1860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:30.866762 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76843a2-dbf1-468e-b04e-9e56d61d1860 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:30.867046 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76843a2-dbf1-468e-b04e-9e56d61d1860 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:30.867322 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76843a2-dbf1-468e-b04e-9e56d61d1860 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:30.876610 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61079995-f886-4ece-8891-18fe17030a7e None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:30.880700 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76843a2-dbf1-468e-b04e-9e56d61d1860 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:30.883022 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76843a2-dbf1-468e-b04e-9e56d61d1860 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:30.903618 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-e76843a2-dbf1-468e-b04e-9e56d61d1860 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 15:16:30.903618 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:16:30.903618 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:16:30.903618 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:16:30.903618 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:16:30.903618 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:16:30.903618 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:16:30.903618 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:16:30.903618 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:16:30.903618 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:16:30.903618 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:16:30.903618 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:16:30.903618 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 15:16:30.903618 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 15:16:30.903618 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 15:16:30.903618 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 15:16:30.904588 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:16:30.904588 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:16:30.904588 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:16:30.904588 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:16:30.904588 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:16:30.904588 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:16:30.904588 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:16:30.904588 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Sep 13 15:16:30.904588 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:16:30.904588 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:16:30.904588 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:16:30.904588 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:16:30.904588 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:16:30.904588 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:16:30.904588 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:16:30.904588 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:16:30.904588 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 15:16:30.905478 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 15:16:30.905478 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 15:16:30.905478 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Sep 13 15:16:30.905478 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 481/942] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 13 15:16:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:16:30.910227 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:30.911297 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76843a2-dbf1-468e-b04e-9e56d61d1860 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:31.001504 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61079995-f886-4ece-8891-18fe17030a7e None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:31.030263 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76843a2-dbf1-468e-b04e-9e56d61d1860 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:31.043117 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875c2765-8733-4426-97bd-08418b817968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:31.043681 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875c2765-8733-4426-97bd-08418b817968 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:31.043966 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875c2765-8733-4426-97bd-08418b817968 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:31.044245 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875c2765-8733-4426-97bd-08418b817968 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:31.044636 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:31.044834 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875c2765-8733-4426-97bd-08418b817968 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:31.047054 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875c2765-8733-4426-97bd-08418b817968 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:31.059502 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-875c2765-8733-4426-97bd-08418b817968 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 15:16:31.059502 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:16:31.059502 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 15:16:31.059502 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 15:16:31.059502 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 15:16:31.059502 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 15:16:31.059502 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 15:16:31.059502 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 15:16:31.059502 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 15:16:31.059502 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Sep 13 15:16:31.059502 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 15:16:31.059502 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Sep 13 15:16:31.059502 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:16:31.059502 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:16:31.059502 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:16:31.059502 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:16:31.059502 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:16:31.060492 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:16:31.060492 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:16:31.060492 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:16:31.060492 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:16:31.060492 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:16:31.060492 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:16:31.060492 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 15:16:31.060492 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 15:16:31.060492 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 15:16:31.060492 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 15:16:31.060492 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:16:31.060492 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:16:31.060492 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:16:31.060492 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:16:31.060492 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:16:31.060492 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:16:31.066820 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:16:31.066820 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Sep 13 15:16:31.066820 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:16:31.066820 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:16:31.066820 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:16:31.066820 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:16:31.066820 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:16:31.066820 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:16:31.066820 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:16:31.066820 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:16:31.066820 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 15:16:31.066820 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 15:16:31.066820 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 15:16:31.066820 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Sep 13 15:16:31.066820 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 462/943] 10.222.0.27 () {56 vars in 1126 bytes} [Tue Sep 13 15:16:30 2022] GET /identity/v3/services/object-store => generated 93 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 15:16:31.067629 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875c2765-8733-4426-97bd-08418b817968 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:31.081012 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40611e88-39c5-4f56-bb1f-e50a80d50153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:31.082828 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40611e88-39c5-4f56-bb1f-e50a80d50153 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:31.083315 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40611e88-39c5-4f56-bb1f-e50a80d50153 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:31.083804 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40611e88-39c5-4f56-bb1f-e50a80d50153 None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:31.084758 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40611e88-39c5-4f56-bb1f-e50a80d50153 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:16:31.085258 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40611e88-39c5-4f56-bb1f-e50a80d50153 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:31.087030 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40611e88-39c5-4f56-bb1f-e50a80d50153 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:31.106547 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 482/944] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Sep 13 15:16:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:16:31.107937 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40611e88-39c5-4f56-bb1f-e50a80d50153 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:31.157113 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:31.187709 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875c2765-8733-4426-97bd-08418b817968 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:31.230824 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eeeb198-c199-4840-8d51-b690294389a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:31.232020 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeeb198-c199-4840-8d51-b690294389a4 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:31.232591 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeeb198-c199-4840-8d51-b690294389a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:31.233081 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeeb198-c199-4840-8d51-b690294389a4 None admin] PATH_INFO: `/v3/services` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:31.234030 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eeeb198-c199-4840-8d51-b690294389a4 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:16:31.234564 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eeeb198-c199-4840-8d51-b690294389a4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:31.236083 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40611e88-39c5-4f56-bb1f-e50a80d50153 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:31.236646 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eeeb198-c199-4840-8d51-b690294389a4 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:31.248327 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 463/945] 10.222.0.27 () {56 vars in 1122 bytes} [Tue Sep 13 15:16:31 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:16:31.248982 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eeeb198-c199-4840-8d51-b690294389a4 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:31.282391 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee9f701-2540-4977-90da-f7e310692ae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:31.283274 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee9f701-2540-4977-90da-f7e310692ae6 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:31.283562 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee9f701-2540-4977-90da-f7e310692ae6 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:31.283833 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee9f701-2540-4977-90da-f7e310692ae6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:31.292641 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee9f701-2540-4977-90da-f7e310692ae6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:31.294340 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee9f701-2540-4977-90da-f7e310692ae6 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:31.308910 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-2ee9f701-2540-4977-90da-f7e310692ae6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 15:16:31.308910 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:16:31.308910 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:16:31.308910 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:16:31.308910 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:16:31.308910 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:16:31.308910 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:16:31.308910 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:16:31.308910 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:16:31.308910 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:16:31.308910 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:16:31.308910 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:16:31.308910 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 15:16:31.308910 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 15:16:31.308910 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 15:16:31.309900 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 15:16:31.309900 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:16:31.309900 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:16:31.309900 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:16:31.309900 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:16:31.309900 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:16:31.309900 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:16:31.309900 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:16:31.309900 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Sep 13 15:16:31.309900 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:16:31.309900 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:16:31.309900 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:16:31.309900 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:16:31.309900 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:16:31.309900 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:16:31.309900 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:16:31.309900 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:16:31.310786 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 15:16:31.310786 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 15:16:31.310786 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 15:16:31.310786 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 15:16:31.310786 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 15:16:31.310786 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 15:16:31.310786 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 15:16:31.310786 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Sep 13 15:16:31.313845 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 483/946] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Sep 13 15:16:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:16:31.318917 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee9f701-2540-4977-90da-f7e310692ae6 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:31.357105 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:31.379399 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eeeb198-c199-4840-8d51-b690294389a4 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:31.419683 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5896ba-e140-4532-87c6-041ec57d5d61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:31.420649 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5896ba-e140-4532-87c6-041ec57d5d61 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:31.421358 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5896ba-e140-4532-87c6-041ec57d5d61 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:31.422257 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5896ba-e140-4532-87c6-041ec57d5d61 None admin] PATH_INFO: `/v3/services` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:31.423390 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5896ba-e140-4532-87c6-041ec57d5d61 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:16:31.423910 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5896ba-e140-4532-87c6-041ec57d5d61 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:31.426041 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5896ba-e140-4532-87c6-041ec57d5d61 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:31.436723 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 464/947] 10.222.0.27 () {56 vars in 1122 bytes} [Tue Sep 13 15:16:31 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:16:31.437514 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5896ba-e140-4532-87c6-041ec57d5d61 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:31.445533 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:31.453004 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee9f701-2540-4977-90da-f7e310692ae6 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:31.492386 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba18219-5170-40a9-b2c3-a92e33397be7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:31.492994 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba18219-5170-40a9-b2c3-a92e33397be7 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:31.493271 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba18219-5170-40a9-b2c3-a92e33397be7 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:31.493540 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba18219-5170-40a9-b2c3-a92e33397be7 None admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:31.494268 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba18219-5170-40a9-b2c3-a92e33397be7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:16:31.494573 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba18219-5170-40a9-b2c3-a92e33397be7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:31.496106 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba18219-5170-40a9-b2c3-a92e33397be7 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:31.513507 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 484/948] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Sep 13 15:16:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 15:16:31.517297 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba18219-5170-40a9-b2c3-a92e33397be7 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:31.571026 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5896ba-e140-4532-87c6-041ec57d5d61 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:31.612948 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a7c37c-4a61-4810-a706-f2b051d7f173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:31.613773 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a7c37c-4a61-4810-a706-f2b051d7f173 None admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:31.614058 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a7c37c-4a61-4810-a706-f2b051d7f173 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:31.614684 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a7c37c-4a61-4810-a706-f2b051d7f173 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:31.615381 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a7c37c-4a61-4810-a706-f2b051d7f173 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:31.616908 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a7c37c-4a61-4810-a706-f2b051d7f173 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:31.627578 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:31.639882 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba18219-5170-40a9-b2c3-a92e33397be7 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:31.647285 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 465/949] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 13 15:16:31 2022] POST /identity/v3/endpoints => generated 349 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 15:16:31.655406 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b077380-1c44-4f80-a857-9e0257c91cf3 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:31.655754 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b077380-1c44-4f80-a857-9e0257c91cf3 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:31.655971 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b077380-1c44-4f80-a857-9e0257c91cf3 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:31.657648 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 466/950] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:16:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:16:31.663669 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b67d84-c9e5-4ea0-b22d-6928d3d179ba None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:31.663920 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b67d84-c9e5-4ea0-b22d-6928d3d179ba None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:31.664157 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b67d84-c9e5-4ea0-b22d-6928d3d179ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:31.685212 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-b9b67d84-c9e5-4ea0-b22d-6928d3d179ba None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:16:31.686451 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-b9b67d84-c9e5-4ea0-b22d-6928d3d179ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:16:31.696906 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c093e15-dfb7-47f5-b644-840a0ba99568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:31.698052 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c093e15-dfb7-47f5-b644-840a0ba99568 None admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:31.698715 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c093e15-dfb7-47f5-b644-840a0ba99568 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:31.699222 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c093e15-dfb7-47f5-b644-840a0ba99568 None admin] PATH_INFO: `/v3/projects/3d6e00339cfa47d2a6fa8724c587035f/users/e97bcdb20f1e416ea41b99c226617faf/roles/d2befaf77d3b4b15850920535a772db0` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:31.701973 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c093e15-dfb7-47f5-b644-840a0ba99568 None admin] RBAC: Authorizing `identity:create_grant(project_id=3d6e00339cfa47d2a6fa8724c587035f, user_id=e97bcdb20f1e416ea41b99c226617faf, role_id=d2befaf77d3b4b15850920535a772db0)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:31.703846 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c093e15-dfb7-47f5-b644-840a0ba99568 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:31.734901 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 485/951] 10.222.0.27 () {58 vars in 1439 bytes} [Tue Sep 13 15:16:31 2022] PUT /identity/v3/projects/3d6e00339cfa47d2a6fa8724c587035f/users/e97bcdb20f1e416ea41b99c226617faf/roles/d2befaf77d3b4b15850920535a772db0 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:16:31.778202 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:31.794527 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 467/952] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:16:31 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 15:16:32.068123 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c093e15-dfb7-47f5-b644-840a0ba99568 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:32.178022 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c093e15-dfb7-47f5-b644-840a0ba99568 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:32.214695 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e9697f-785d-4403-b0d2-47a29d478bcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:32.215678 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e9697f-785d-4403-b0d2-47a29d478bcc None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:32.216190 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e9697f-785d-4403-b0d2-47a29d478bcc None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:32.216664 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e9697f-785d-4403-b0d2-47a29d478bcc None admin] PATH_INFO: `/v3/services/compute` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:32.217465 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e9697f-785d-4403-b0d2-47a29d478bcc None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:32.219060 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e9697f-785d-4403-b0d2-47a29d478bcc None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:32.229064 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-f2e9697f-785d-4403-b0d2-47a29d478bcc None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 13 15:16:32.229064 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:16:32.229064 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 15:16:32.229064 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 15:16:32.229064 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 15:16:32.229064 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 15:16:32.229064 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 15:16:32.229064 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 15:16:32.229064 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 13 15:16:32.229064 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Sep 13 15:16:32.229064 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 15:16:32.229064 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Sep 13 15:16:32.229064 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:16:32.229064 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:16:32.229064 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:16:32.229064 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:16:32.229064 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:16:32.230204 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:16:32.230204 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:16:32.230204 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:16:32.230204 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:16:32.230204 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:16:32.230204 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:16:32.230204 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 15:16:32.230204 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 15:16:32.230204 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 15:16:32.230204 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 15:16:32.230204 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:16:32.230204 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:16:32.230204 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:16:32.230204 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:16:32.230204 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:16:32.230204 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:16:32.231061 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:16:32.231061 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Sep 13 15:16:32.231061 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:16:32.231061 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:16:32.231061 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:16:32.231061 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:16:32.231061 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:16:32.231061 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:16:32.231061 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:16:32.231061 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:16:32.231061 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 15:16:32.231061 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 15:16:32.231061 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 13 15:16:32.231061 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Sep 13 15:16:32.238067 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 486/953] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Sep 13 15:16:32 2022] GET /identity/v3/services/compute => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:16:32.241424 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b67d84-c9e5-4ea0-b22d-6928d3d179ba None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:32.353450 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b67d84-c9e5-4ea0-b22d-6928d3d179ba None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:32.396242 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bfe4db-a18b-453e-938d-033088b8f119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:32.397719 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bfe4db-a18b-453e-938d-033088b8f119 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:32.398209 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bfe4db-a18b-453e-938d-033088b8f119 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:32.398685 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bfe4db-a18b-453e-938d-033088b8f119 None admin] PATH_INFO: `/v3/services` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:32.399519 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bfe4db-a18b-453e-938d-033088b8f119 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:16:32.400026 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bfe4db-a18b-453e-938d-033088b8f119 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:32.401590 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bfe4db-a18b-453e-938d-033088b8f119 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:32.407366 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 468/954] 10.222.0.27 () {56 vars in 1112 bytes} [Tue Sep 13 15:16:32 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:16:32.414130 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e9697f-785d-4403-b0d2-47a29d478bcc None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:32.428926 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:32.502194 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f07c3d-fb97-4b5d-966d-a22791e07432 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:32.502880 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f07c3d-fb97-4b5d-966d-a22791e07432 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:32.504517 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f07c3d-fb97-4b5d-966d-a22791e07432 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:32.506783 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 469/955] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:16:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:16:32.514127 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadea9d2-fd23-4d17-8312-f9a5bbd2ce58 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:32.514724 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadea9d2-fd23-4d17-8312-f9a5bbd2ce58 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:32.515203 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadea9d2-fd23-4d17-8312-f9a5bbd2ce58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:32.535712 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-dadea9d2-fd23-4d17-8312-f9a5bbd2ce58 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:16:32.536594 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e9697f-785d-4403-b0d2-47a29d478bcc None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:32.537568 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-dadea9d2-fd23-4d17-8312-f9a5bbd2ce58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:16:32.574794 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd0b2ba-6616-430f-8a39-fb3900db27f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:32.575424 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd0b2ba-6616-430f-8a39-fb3900db27f5 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:32.575764 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd0b2ba-6616-430f-8a39-fb3900db27f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:32.576215 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd0b2ba-6616-430f-8a39-fb3900db27f5 None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:32.577736 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd0b2ba-6616-430f-8a39-fb3900db27f5 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:16:32.577736 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd0b2ba-6616-430f-8a39-fb3900db27f5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:32.579764 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd0b2ba-6616-430f-8a39-fb3900db27f5 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:32.593732 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 487/956] 10.222.0.27 () {56 vars in 1112 bytes} [Tue Sep 13 15:16:32 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:16:32.602480 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:32.634210 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 470/957] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:16:32 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 15:16:32.921206 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd0b2ba-6616-430f-8a39-fb3900db27f5 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:33.005807 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:33.036350 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd0b2ba-6616-430f-8a39-fb3900db27f5 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:33.075774 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e621f17-cf46-492b-894c-9bf81a5a7855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:33.076403 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e621f17-cf46-492b-894c-9bf81a5a7855 None admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:33.076688 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e621f17-cf46-492b-894c-9bf81a5a7855 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:33.076964 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e621f17-cf46-492b-894c-9bf81a5a7855 None admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:33.077621 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e621f17-cf46-492b-894c-9bf81a5a7855 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:33.079854 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e621f17-cf46-492b-894c-9bf81a5a7855 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:33.083769 dv-cinder-857434-2-smb devstack@keystone.service[81449]: WARNING keystone.server.flask.common [None req-2e621f17-cf46-492b-894c-9bf81a5a7855 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 13 15:16:33.104937 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.sql.core [None req-2e621f17-cf46-492b-894c-9bf81a5a7855 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 13 15:16:33.104937 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 13 15:16:33.104937 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [parameters: {'id': 'b8529540e1d74927938c272a91c083d8', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 13 15:16:33.104937 dv-cinder-857434-2-smb devstack@keystone.service[81449]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81449) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 13 15:16:33.116929 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-2e621f17-cf46-492b-894c-9bf81a5a7855 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id b8529540e1d74927938c272a91c083d8.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id b8529540e1d74927938c272a91c083d8. Sep 13 15:16:33.116929 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:16:33.116929 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 13 15:16:33.116929 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 13 15:16:33.116929 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 13 15:16:33.116929 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 13 15:16:33.116929 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 13 15:16:33.116929 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application result = self._query(query) Sep 13 15:16:33.116929 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 13 15:16:33.116929 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application conn.query(q) Sep 13 15:16:33.116929 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 13 15:16:33.116929 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 13 15:16:33.116929 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 13 15:16:33.118417 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application result.read() Sep 13 15:16:33.118417 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 13 15:16:33.118417 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 13 15:16:33.118417 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 13 15:16:33.118417 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 13 15:16:33.118417 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 13 15:16:33.118417 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 13 15:16:33.118417 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 13 15:16:33.118417 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 13 15:16:33.118417 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 13 15:16:33.118417 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Sep 13 15:16:33.118417 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 13 15:16:33.118417 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Sep 13 15:16:33.118417 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:16:33.118417 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 13 15:16:33.118417 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 13 15:16:33.118417 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Sep 13 15:16:33.118417 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return project_ref.to_dict() Sep 13 15:16:33.119541 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 13 15:16:33.119541 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application next(self.gen) Sep 13 15:16:33.119541 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 13 15:16:33.119541 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application yield resource Sep 13 15:16:33.119541 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 13 15:16:33.119541 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application next(self.gen) Sep 13 15:16:33.119541 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 13 15:16:33.119541 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self.session.rollback() Sep 13 15:16:33.119541 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 13 15:16:33.119541 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self.force_reraise() Sep 13 15:16:33.119541 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 13 15:16:33.119541 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise self.value Sep 13 15:16:33.119541 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 13 15:16:33.119541 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 13 15:16:33.119541 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 13 15:16:33.119541 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application session.commit() Sep 13 15:16:33.119541 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 13 15:16:33.120442 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 13 15:16:33.120442 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 13 15:16:33.120442 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self._prepare_impl() Sep 13 15:16:33.120442 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 13 15:16:33.120442 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self.session.flush() Sep 13 15:16:33.120442 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 13 15:16:33.120442 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self._flush(objects) Sep 13 15:16:33.120442 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 13 15:16:33.120442 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 13 15:16:33.120442 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 13 15:16:33.120442 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application compat.raise_( Sep 13 15:16:33.120442 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 13 15:16:33.120442 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception Sep 13 15:16:33.120442 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 13 15:16:33.120442 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application flush_context.execute() Sep 13 15:16:33.120442 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 13 15:16:33.120442 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rec.execute(self) Sep 13 15:16:33.121339 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 13 15:16:33.121339 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 13 15:16:33.121339 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 13 15:16:33.121339 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 13 15:16:33.121339 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 13 15:16:33.121339 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 13 15:16:33.121339 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 13 15:16:33.121339 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 13 15:16:33.121339 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 13 15:16:33.121339 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 13 15:16:33.121339 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 13 15:16:33.121339 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 13 15:16:33.121339 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 13 15:16:33.121339 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 13 15:16:33.121339 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 13 15:16:33.123351 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 13 15:16:33.123351 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 13 15:16:33.123351 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception Sep 13 15:16:33.123351 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 13 15:16:33.123351 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 13 15:16:33.123351 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 13 15:16:33.123351 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 13 15:16:33.123351 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 13 15:16:33.123351 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application result = self._query(query) Sep 13 15:16:33.123351 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 13 15:16:33.123351 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application conn.query(q) Sep 13 15:16:33.123351 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 13 15:16:33.123351 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 13 15:16:33.123351 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 13 15:16:33.123351 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application result.read() Sep 13 15:16:33.123351 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 13 15:16:33.123351 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 13 15:16:33.124617 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 13 15:16:33.124617 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 13 15:16:33.124617 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 13 15:16:33.124617 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 13 15:16:33.124617 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 13 15:16:33.124617 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 13 15:16:33.124617 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 13 15:16:33.124617 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 13 15:16:33.124617 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [parameters: {'id': 'b8529540e1d74927938c272a91c083d8', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 13 15:16:33.124617 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 13 15:16:33.124617 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Sep 13 15:16:33.124617 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 15:16:33.124617 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Sep 13 15:16:33.124617 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:16:33.124617 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Sep 13 15:16:33.125751 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Sep 13 15:16:33.125751 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 13 15:16:33.125751 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 13 15:16:33.125751 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Sep 13 15:16:33.125751 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Sep 13 15:16:33.125751 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 15:16:33.125751 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Sep 13 15:16:33.125751 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:16:33.125751 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:16:33.125751 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:16:33.125751 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:16:33.125751 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:16:33.125751 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:16:33.125751 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:16:33.125751 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:16:33.125751 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:16:33.125751 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:16:33.132244 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:16:33.132244 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Sep 13 15:16:33.132244 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Sep 13 15:16:33.132244 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:16:33.132244 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:16:33.132244 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Sep 13 15:16:33.132244 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.Conflict( Sep 13 15:16:33.132244 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id b8529540e1d74927938c272a91c083d8. Sep 13 15:16:33.132244 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Sep 13 15:16:33.132244 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 488/958] 10.222.0.27 () {60 vars in 1140 bytes} [Tue Sep 13 15:16:32 2022] POST /identity/v3/projects => generated 262 bytes in 198 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:16:33.137342 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadea9d2-fd23-4d17-8312-f9a5bbd2ce58 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:33.241957 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadea9d2-fd23-4d17-8312-f9a5bbd2ce58 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:33.278482 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cf5d84-8e78-4bf9-b3f6-4bc32f5a2d99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:33.279458 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cf5d84-8e78-4bf9-b3f6-4bc32f5a2d99 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:33.279941 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cf5d84-8e78-4bf9-b3f6-4bc32f5a2d99 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:33.280417 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cf5d84-8e78-4bf9-b3f6-4bc32f5a2d99 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:33.287405 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cf5d84-8e78-4bf9-b3f6-4bc32f5a2d99 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:33.289083 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cf5d84-8e78-4bf9-b3f6-4bc32f5a2d99 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:33.300940 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-17cf5d84-8e78-4bf9-b3f6-4bc32f5a2d99 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 15:16:33.300940 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:16:33.300940 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:16:33.300940 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:16:33.300940 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:16:33.300940 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:16:33.300940 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:16:33.300940 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:16:33.300940 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:16:33.300940 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:16:33.300940 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:16:33.300940 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:16:33.300940 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 15:16:33.300940 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 15:16:33.300940 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 15:16:33.301905 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 15:16:33.301905 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:16:33.301905 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:16:33.301905 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:16:33.301905 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:16:33.301905 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:16:33.301905 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:16:33.301905 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:16:33.301905 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Sep 13 15:16:33.301905 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:16:33.301905 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:16:33.301905 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:16:33.301905 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:16:33.301905 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:16:33.301905 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:16:33.301905 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:16:33.301905 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:16:33.302862 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 15:16:33.302862 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 15:16:33.302862 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 15:16:33.302862 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 15:16:33.302862 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 15:16:33.302862 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 15:16:33.302862 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 15:16:33.302862 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Sep 13 15:16:33.305122 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 471/959] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Sep 13 15:16:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:16:33.311273 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e621f17-cf46-492b-894c-9bf81a5a7855 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:33.419368 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e621f17-cf46-492b-894c-9bf81a5a7855 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:33.449608 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:33.457018 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97466d57-4518-4f03-8074-7824183c7fb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:33.458080 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97466d57-4518-4f03-8074-7824183c7fb5 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:33.458580 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97466d57-4518-4f03-8074-7824183c7fb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:33.459165 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97466d57-4518-4f03-8074-7824183c7fb5 None admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:33.460037 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97466d57-4518-4f03-8074-7824183c7fb5 None admin] RBAC: Adding query filter params (name=service) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:16:33.460848 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97466d57-4518-4f03-8074-7824183c7fb5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:33.462766 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97466d57-4518-4f03-8074-7824183c7fb5 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:33.484461 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 489/960] 10.222.0.27 () {56 vars in 1112 bytes} [Tue Sep 13 15:16:33 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:16:34.037500 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638b8712-8cf5-4781-b2a7-8a714318d280 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:34.038025 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638b8712-8cf5-4781-b2a7-8a714318d280 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:34.038025 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638b8712-8cf5-4781-b2a7-8a714318d280 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:34.039558 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 472/961] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:16:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:16:34.044968 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea233ad-195c-45a1-bde3-3c379c4b10fd None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:34.045259 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea233ad-195c-45a1-bde3-3c379c4b10fd None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:34.045534 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea233ad-195c-45a1-bde3-3c379c4b10fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:34.065067 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-3ea233ad-195c-45a1-bde3-3c379c4b10fd None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:16:34.067071 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-3ea233ad-195c-45a1-bde3-3c379c4b10fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:16:34.115352 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ba1edd-64ac-495a-9325-12f24b45968c None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:34.115661 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ba1edd-64ac-495a-9325-12f24b45968c None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:34.115907 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ba1edd-64ac-495a-9325-12f24b45968c None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:34.117365 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 473/962] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:16:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 15:16:34.123898 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4e4f9e-1268-47d8-8157-cb88bd0134d6 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:34.124186 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4e4f9e-1268-47d8-8157-cb88bd0134d6 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:34.124492 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4e4f9e-1268-47d8-8157-cb88bd0134d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:34.146840 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-bb4e4f9e-1268-47d8-8157-cb88bd0134d6 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:16:34.148074 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-bb4e4f9e-1268-47d8-8157-cb88bd0134d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:16:34.149321 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 490/963] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:16:34 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 15:16:34.190026 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:34.223052 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 474/964] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:16:34 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 15:16:34.432729 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea233ad-195c-45a1-bde3-3c379c4b10fd None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:34.503238 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4e4f9e-1268-47d8-8157-cb88bd0134d6 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:34.546324 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea233ad-195c-45a1-bde3-3c379c4b10fd None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:34.570126 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:34.585011 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c319fb43-03e4-479a-817c-2fa225e18fa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:34.585990 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c319fb43-03e4-479a-817c-2fa225e18fa6 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:34.586468 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c319fb43-03e4-479a-817c-2fa225e18fa6 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:34.586964 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c319fb43-03e4-479a-817c-2fa225e18fa6 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:34.587738 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c319fb43-03e4-479a-817c-2fa225e18fa6 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:34.589450 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c319fb43-03e4-479a-817c-2fa225e18fa6 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:34.599758 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-c319fb43-03e4-479a-817c-2fa225e18fa6 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 15:16:34.599758 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:16:34.599758 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 15:16:34.599758 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 15:16:34.599758 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 15:16:34.599758 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 15:16:34.599758 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 15:16:34.599758 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 15:16:34.599758 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 15:16:34.599758 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Sep 13 15:16:34.599758 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 15:16:34.599758 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Sep 13 15:16:34.599758 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:16:34.599758 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:16:34.599758 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:16:34.599758 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:16:34.599758 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:16:34.600798 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:16:34.600798 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:16:34.600798 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:16:34.600798 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:16:34.600798 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:16:34.600798 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:16:34.600798 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 15:16:34.600798 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 15:16:34.600798 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 15:16:34.600798 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 15:16:34.600798 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:16:34.600798 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:16:34.600798 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:16:34.600798 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:16:34.600798 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:16:34.600798 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:16:34.601624 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:16:34.601624 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Sep 13 15:16:34.601624 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:16:34.601624 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:16:34.601624 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:16:34.601624 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:16:34.601624 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:16:34.601624 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:16:34.601624 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:16:34.601624 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:16:34.601624 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 15:16:34.601624 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 15:16:34.601624 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 15:16:34.601624 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Sep 13 15:16:34.609290 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 491/965] 10.222.0.27 () {56 vars in 1126 bytes} [Tue Sep 13 15:16:34 2022] GET /identity/v3/services/object-store => generated 93 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:16:34.610484 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c319fb43-03e4-479a-817c-2fa225e18fa6 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:34.617667 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4e4f9e-1268-47d8-8157-cb88bd0134d6 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:34.661373 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a354f619-b463-4036-8ba5-beb67c2d4b51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:34.662052 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a354f619-b463-4036-8ba5-beb67c2d4b51 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:34.662346 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a354f619-b463-4036-8ba5-beb67c2d4b51 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:34.662909 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a354f619-b463-4036-8ba5-beb67c2d4b51 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:34.677365 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a354f619-b463-4036-8ba5-beb67c2d4b51 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 15:16:34.684099 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-a354f619-b463-4036-8ba5-beb67c2d4b51 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 13 15:16:34.684099 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:16:34.684099 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:16:34.684099 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:16:34.684099 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:16:34.684099 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:16:34.684099 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:16:34.684099 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:16:34.684099 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:16:34.684099 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:16:34.684099 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:16:34.684099 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:16:34.684099 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 15:16:34.684099 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 15:16:34.684099 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 15:16:34.684099 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 15:16:34.685022 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 15:16:34.685022 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 15:16:34.685022 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 15:16:34.685022 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 15:16:34.685022 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:16:34.685022 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:16:34.685022 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:16:34.685022 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:16:34.685022 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:16:34.685022 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:16:34.685022 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:16:34.685022 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Sep 13 15:16:34.685022 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:16:34.685022 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:16:34.685022 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:16:34.685022 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:16:34.690900 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:16:34.690900 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:16:34.690900 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:16:34.690900 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:16:34.690900 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 15:16:34.690900 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 15:16:34.690900 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 15:16:34.690900 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 15:16:34.690900 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 15:16:34.690900 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 15:16:34.690900 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 13 15:16:34.690900 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Sep 13 15:16:34.690900 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 475/966] 10.222.0.27 () {56 vars in 1120 bytes} [Tue Sep 13 15:16:34 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:16:34.694808 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a354f619-b463-4036-8ba5-beb67c2d4b51 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:34.727630 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c319fb43-03e4-479a-817c-2fa225e18fa6 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:34.737560 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:34.767231 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6055ef8b-81b6-40cb-b216-8a24989d5776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:34.767843 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6055ef8b-81b6-40cb-b216-8a24989d5776 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:34.769013 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6055ef8b-81b6-40cb-b216-8a24989d5776 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:34.769013 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6055ef8b-81b6-40cb-b216-8a24989d5776 None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:34.769763 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6055ef8b-81b6-40cb-b216-8a24989d5776 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:16:34.770077 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6055ef8b-81b6-40cb-b216-8a24989d5776 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:34.771546 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6055ef8b-81b6-40cb-b216-8a24989d5776 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:34.781733 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 492/967] 10.222.0.27 () {56 vars in 1122 bytes} [Tue Sep 13 15:16:34 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:16:34.783091 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6055ef8b-81b6-40cb-b216-8a24989d5776 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:34.839166 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a354f619-b463-4036-8ba5-beb67c2d4b51 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:34.843116 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:34.889048 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adeee96-9c98-4f3f-b357-f6477aaa2a5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:34.890203 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adeee96-9c98-4f3f-b357-f6477aaa2a5f None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:34.890631 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adeee96-9c98-4f3f-b357-f6477aaa2a5f None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:34.891303 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adeee96-9c98-4f3f-b357-f6477aaa2a5f None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:34.892550 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adeee96-9c98-4f3f-b357-f6477aaa2a5f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:16:34.893244 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adeee96-9c98-4f3f-b357-f6477aaa2a5f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:34.895948 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adeee96-9c98-4f3f-b357-f6477aaa2a5f None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:34.901273 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6055ef8b-81b6-40cb-b216-8a24989d5776 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:34.907260 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 476/968] 10.222.0.27 () {56 vars in 1115 bytes} [Tue Sep 13 15:16:34 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 15:16:34.913038 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adeee96-9c98-4f3f-b357-f6477aaa2a5f None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:34.949010 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7423f7-8aeb-4f0a-9fcc-f28cc944c430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:34.949540 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7423f7-8aeb-4f0a-9fcc-f28cc944c430 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:34.949859 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7423f7-8aeb-4f0a-9fcc-f28cc944c430 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:34.950138 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7423f7-8aeb-4f0a-9fcc-f28cc944c430 None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:34.950776 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7423f7-8aeb-4f0a-9fcc-f28cc944c430 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:16:34.951081 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7423f7-8aeb-4f0a-9fcc-f28cc944c430 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:34.952446 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7423f7-8aeb-4f0a-9fcc-f28cc944c430 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:34.962898 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 493/969] 10.222.0.27 () {56 vars in 1122 bytes} [Tue Sep 13 15:16:34 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:16:34.962898 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b64fb4-c196-4b4f-8593-36d8bddb97ee None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:34.962898 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b64fb4-c196-4b4f-8593-36d8bddb97ee None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:34.962898 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b64fb4-c196-4b4f-8593-36d8bddb97ee None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:34.962898 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 494/970] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:16:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:16:34.966140 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b64fb4-c196-4b4f-8593-36d8bddb97ee None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:35.023886 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:35.031405 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adeee96-9c98-4f3f-b357-f6477aaa2a5f None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:35.066773 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b64fb4-c196-4b4f-8593-36d8bddb97ee None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:35.068523 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ff4eba-79eb-48b7-8c53-063df63896b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:35.069156 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ff4eba-79eb-48b7-8c53-063df63896b7 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:35.069446 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ff4eba-79eb-48b7-8c53-063df63896b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:35.069747 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ff4eba-79eb-48b7-8c53-063df63896b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:35.080051 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:35.080645 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ff4eba-79eb-48b7-8c53-063df63896b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:35.082266 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ff4eba-79eb-48b7-8c53-063df63896b7 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:35.097766 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-e2ff4eba-79eb-48b7-8c53-063df63896b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 15:16:35.097766 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:16:35.097766 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:16:35.097766 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:16:35.097766 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:16:35.097766 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:16:35.097766 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:16:35.097766 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:16:35.097766 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:16:35.097766 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:16:35.097766 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:16:35.097766 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:16:35.097766 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 15:16:35.097766 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 15:16:35.097766 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 15:16:35.097766 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 15:16:35.098819 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:16:35.098819 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:16:35.098819 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:16:35.098819 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:16:35.098819 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:16:35.098819 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:16:35.098819 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:16:35.098819 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Sep 13 15:16:35.098819 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:16:35.098819 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:16:35.098819 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:16:35.098819 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:16:35.098819 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:16:35.098819 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:16:35.098819 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:16:35.098819 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:16:35.098819 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 15:16:35.099731 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 15:16:35.099731 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 15:16:35.099731 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Sep 13 15:16:35.099731 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 477/971] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 13 15:16:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 15:16:35.100528 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e080da47-c84e-4c81-97b4-9e8733afaf96 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:35.100528 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e080da47-c84e-4c81-97b4-9e8733afaf96 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:35.100685 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e080da47-c84e-4c81-97b4-9e8733afaf96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:35.109047 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c91b07-162b-4074-bf7a-b8fa7d48a02e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:35.109663 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c91b07-162b-4074-bf7a-b8fa7d48a02e None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:35.109976 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c91b07-162b-4074-bf7a-b8fa7d48a02e None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:35.110261 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c91b07-162b-4074-bf7a-b8fa7d48a02e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:35.110971 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c91b07-162b-4074-bf7a-b8fa7d48a02e None admin] RBAC: Adding query filter params (interface=admin, service_id=fb6f48622bd8485cb4ef5bc849010052, region_id=RegionOne) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:16:35.111283 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c91b07-162b-4074-bf7a-b8fa7d48a02e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:35.112874 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c91b07-162b-4074-bf7a-b8fa7d48a02e None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:35.123360 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 495/972] 10.222.0.27 () {56 vars in 1249 bytes} [Tue Sep 13 15:16:34 2022] GET /identity/v3/endpoints?service_id=fb6f48622bd8485cb4ef5bc849010052&interface=admin®ion_id=RegionOne => generated 193 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:16:35.123360 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c91b07-162b-4074-bf7a-b8fa7d48a02e None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:35.124672 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-e080da47-c84e-4c81-97b4-9e8733afaf96 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:16:35.125936 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-e080da47-c84e-4c81-97b4-9e8733afaf96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:16:35.197142 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 478/973] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:16:35 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 15:16:35.198352 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e080da47-c84e-4c81-97b4-9e8733afaf96 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:35.240508 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c91b07-162b-4074-bf7a-b8fa7d48a02e None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:35.275434 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3797d1e6-b0b6-4415-b97f-55616a90bfcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:35.276064 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3797d1e6-b0b6-4415-b97f-55616a90bfcd None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:35.276342 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3797d1e6-b0b6-4415-b97f-55616a90bfcd None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:35.276624 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3797d1e6-b0b6-4415-b97f-55616a90bfcd None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:35.277248 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3797d1e6-b0b6-4415-b97f-55616a90bfcd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:16:35.277552 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3797d1e6-b0b6-4415-b97f-55616a90bfcd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:35.279068 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3797d1e6-b0b6-4415-b97f-55616a90bfcd None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:35.288718 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:35.297622 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 496/974] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Sep 13 15:16:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:16:35.298549 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3797d1e6-b0b6-4415-b97f-55616a90bfcd None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:35.317211 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e080da47-c84e-4c81-97b4-9e8733afaf96 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:35.337335 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:35.359950 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7257be6-0818-49db-8cfa-c8b266de4e4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:35.361050 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7257be6-0818-49db-8cfa-c8b266de4e4c None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:35.361536 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7257be6-0818-49db-8cfa-c8b266de4e4c None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:35.362694 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7257be6-0818-49db-8cfa-c8b266de4e4c None admin] PATH_INFO: `/v3/services` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:35.363516 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7257be6-0818-49db-8cfa-c8b266de4e4c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:35.365791 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7257be6-0818-49db-8cfa-c8b266de4e4c None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:35.381747 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 479/975] 10.222.0.27 () {56 vars in 1087 bytes} [Tue Sep 13 15:16:35 2022] GET /identity/v3/services => generated 1497 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 15:16:35.420158 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3797d1e6-b0b6-4415-b97f-55616a90bfcd None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:35.460328 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b996f632-9a12-407c-b311-41c63b07b638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:35.461029 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b996f632-9a12-407c-b311-41c63b07b638 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:35.461271 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b996f632-9a12-407c-b311-41c63b07b638 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:35.461578 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b996f632-9a12-407c-b311-41c63b07b638 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:35.470025 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b996f632-9a12-407c-b311-41c63b07b638 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:35.471567 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b996f632-9a12-407c-b311-41c63b07b638 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:35.475959 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7257be6-0818-49db-8cfa-c8b266de4e4c None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:35.486578 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-b996f632-9a12-407c-b311-41c63b07b638 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 13 15:16:35.486578 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:16:35.486578 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:16:35.486578 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:16:35.486578 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:16:35.486578 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:16:35.486578 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:16:35.486578 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:16:35.486578 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:16:35.486578 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:16:35.486578 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:16:35.486578 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:16:35.486578 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 15:16:35.486578 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 15:16:35.486578 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 15:16:35.486578 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 15:16:35.488195 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:16:35.488195 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:16:35.488195 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 15:16:35.488195 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 15:16:35.488195 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 15:16:35.488195 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 15:16:35.488195 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:16:35.488195 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:16:35.488195 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:16:35.488195 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:16:35.488195 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:16:35.488195 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Sep 13 15:16:35.488195 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:16:35.488195 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:16:35.488195 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:16:35.488195 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:16:35.488195 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:16:35.488195 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:16:35.489685 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:16:35.489685 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:16:35.489685 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 15:16:35.489685 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 15:16:35.489685 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 15:16:35.489685 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 15:16:35.489685 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 15:16:35.489685 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 15:16:35.489685 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 13 15:16:35.489685 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Sep 13 15:16:35.489685 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 497/976] 10.222.0.27 () {56 vars in 1117 bytes} [Tue Sep 13 15:16:35 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:16:35.494845 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b996f632-9a12-407c-b311-41c63b07b638 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:35.605535 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7257be6-0818-49db-8cfa-c8b266de4e4c None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:35.608923 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:35.619291 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b996f632-9a12-407c-b311-41c63b07b638 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:35.653346 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9da3aa-31ba-4e9e-a271-307dda9bc41f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:35.654685 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9da3aa-31ba-4e9e-a271-307dda9bc41f None admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:35.655203 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9da3aa-31ba-4e9e-a271-307dda9bc41f None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:35.655696 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9da3aa-31ba-4e9e-a271-307dda9bc41f None admin] PATH_INFO: `/v3/services` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:35.656697 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9da3aa-31ba-4e9e-a271-307dda9bc41f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:35.659086 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9da3aa-31ba-4e9e-a271-307dda9bc41f None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:35.669478 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aae4bb2-7ea0-4678-8478-6a933490d8bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:35.670233 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aae4bb2-7ea0-4678-8478-6a933490d8bd None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:35.670572 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aae4bb2-7ea0-4678-8478-6a933490d8bd None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:35.670917 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aae4bb2-7ea0-4678-8478-6a933490d8bd None admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:35.671795 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aae4bb2-7ea0-4678-8478-6a933490d8bd None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:16:35.672364 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aae4bb2-7ea0-4678-8478-6a933490d8bd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:35.674160 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aae4bb2-7ea0-4678-8478-6a933490d8bd None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:35.680874 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 480/977] 10.222.0.27 () {60 vars in 1141 bytes} [Tue Sep 13 15:16:35 2022] POST /identity/v3/services => generated 242 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:16:35.703772 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 498/978] 10.222.0.27 () {56 vars in 1149 bytes} [Tue Sep 13 15:16:35 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 15:16:35.710426 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9da3aa-31ba-4e9e-a271-307dda9bc41f None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:35.723160 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:35.762627 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23b00e4-0fe9-4e8b-a6e1-261a843e12a9 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:35.763297 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23b00e4-0fe9-4e8b-a6e1-261a843e12a9 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:35.763781 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23b00e4-0fe9-4e8b-a6e1-261a843e12a9 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:35.765689 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 499/979] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:16:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 15:16:35.772774 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a487c02c-026f-42c9-91ca-1c30ed17c09e None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:35.777391 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a487c02c-026f-42c9-91ca-1c30ed17c09e None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:35.777391 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a487c02c-026f-42c9-91ca-1c30ed17c09e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:35.798315 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-a487c02c-026f-42c9-91ca-1c30ed17c09e None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:16:35.800243 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-a487c02c-026f-42c9-91ca-1c30ed17c09e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:16:35.837784 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9da3aa-31ba-4e9e-a271-307dda9bc41f None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:35.880250 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d398e486-f700-4fd9-8d25-2683ff3749b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:35.880795 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d398e486-f700-4fd9-8d25-2683ff3749b3 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:35.881154 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d398e486-f700-4fd9-8d25-2683ff3749b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:35.881505 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d398e486-f700-4fd9-8d25-2683ff3749b3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:35.897160 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 500/980] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:16:35 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 15:16:35.964295 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:35.967502 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d398e486-f700-4fd9-8d25-2683ff3749b3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:35.968952 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d398e486-f700-4fd9-8d25-2683ff3749b3 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:36.074718 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 481/981] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Sep 13 15:16:35 2022] GET /identity/v3/auth/tokens => generated 1570 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 15:16:36.080998 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a487c02c-026f-42c9-91ca-1c30ed17c09e None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:36.168343 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d398e486-f700-4fd9-8d25-2683ff3749b3 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:36.172600 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:36.192569 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a487c02c-026f-42c9-91ca-1c30ed17c09e None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:36.231406 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41f8909-16df-4cee-982c-1928e0274a3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:36.232106 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41f8909-16df-4cee-982c-1928e0274a3a None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:36.232395 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41f8909-16df-4cee-982c-1928e0274a3a None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:36.232673 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41f8909-16df-4cee-982c-1928e0274a3a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:36.245596 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41f8909-16df-4cee-982c-1928e0274a3a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:36.247158 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41f8909-16df-4cee-982c-1928e0274a3a None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:36.264780 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-b41f8909-16df-4cee-982c-1928e0274a3a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 15:16:36.264780 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:16:36.264780 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:16:36.264780 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:16:36.264780 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:16:36.264780 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:16:36.264780 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:16:36.264780 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:16:36.264780 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:16:36.264780 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:16:36.264780 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:16:36.264780 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:16:36.264780 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 15:16:36.264780 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 15:16:36.264780 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 15:16:36.264780 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 15:16:36.266090 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:16:36.266090 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:16:36.266090 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:16:36.266090 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:16:36.266090 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:16:36.266090 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:16:36.266090 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:16:36.266090 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Sep 13 15:16:36.266090 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:16:36.266090 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:16:36.266090 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:16:36.266090 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:16:36.266090 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:16:36.266090 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:16:36.266090 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:16:36.266090 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:16:36.266090 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 15:16:36.266984 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 15:16:36.266984 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 15:16:36.266984 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Sep 13 15:16:36.270790 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 501/982] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 13 15:16:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:16:36.272115 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41f8909-16df-4cee-982c-1928e0274a3a None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:36.296128 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:36.305417 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d398e486-f700-4fd9-8d25-2683ff3749b3 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:36.345138 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9bbf46-c651-4a99-98fa-139d73f0bebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:36.345868 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9bbf46-c651-4a99-98fa-139d73f0bebe None admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:36.346158 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9bbf46-c651-4a99-98fa-139d73f0bebe None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:36.346843 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9bbf46-c651-4a99-98fa-139d73f0bebe None admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:36.347552 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9bbf46-c651-4a99-98fa-139d73f0bebe None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:36.349297 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9bbf46-c651-4a99-98fa-139d73f0bebe None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:36.352150 dv-cinder-857434-2-smb devstack@keystone.service[81450]: WARNING keystone.server.flask.common [None req-bf9bbf46-c651-4a99-98fa-139d73f0bebe None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 13 15:16:36.371758 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.sql.core [None req-bf9bbf46-c651-4a99-98fa-139d73f0bebe None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 13 15:16:36.371758 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 13 15:16:36.371758 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [parameters: {'user_id': '3a8b0bafc36d40c299d6add5a3565013', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 13 15:16:36.371758 dv-cinder-857434-2-smb devstack@keystone.service[81450]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81450) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 13 15:16:36.392637 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-bf9bbf46-c651-4a99-98fa-139d73f0bebe None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 13 15:16:36.392637 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:16:36.392637 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 13 15:16:36.392637 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 13 15:16:36.392637 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 13 15:16:36.392637 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 13 15:16:36.392637 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 13 15:16:36.392637 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application result = self._query(query) Sep 13 15:16:36.392637 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 13 15:16:36.392637 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application conn.query(q) Sep 13 15:16:36.392637 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 13 15:16:36.392637 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 13 15:16:36.392637 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 13 15:16:36.392637 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application result.read() Sep 13 15:16:36.392637 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 13 15:16:36.393765 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 13 15:16:36.393765 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 13 15:16:36.393765 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 13 15:16:36.393765 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 13 15:16:36.393765 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 13 15:16:36.393765 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 13 15:16:36.393765 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 13 15:16:36.393765 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 13 15:16:36.393765 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Sep 13 15:16:36.393765 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 13 15:16:36.393765 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Sep 13 15:16:36.393765 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:16:36.393765 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 13 15:16:36.393765 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 13 15:16:36.393765 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Sep 13 15:16:36.393765 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Sep 13 15:16:36.393765 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 13 15:16:36.393765 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application next(self.gen) Sep 13 15:16:36.394726 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 13 15:16:36.394726 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application yield resource Sep 13 15:16:36.394726 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 13 15:16:36.394726 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application next(self.gen) Sep 13 15:16:36.394726 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 13 15:16:36.394726 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application self.session.rollback() Sep 13 15:16:36.394726 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 13 15:16:36.394726 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application self.force_reraise() Sep 13 15:16:36.394726 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 13 15:16:36.394726 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise self.value Sep 13 15:16:36.394726 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 13 15:16:36.394726 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 13 15:16:36.394726 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 13 15:16:36.394726 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application session.commit() Sep 13 15:16:36.394726 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 13 15:16:36.394726 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 13 15:16:36.394726 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 13 15:16:36.395608 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application self._prepare_impl() Sep 13 15:16:36.395608 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 13 15:16:36.395608 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application self.session.flush() Sep 13 15:16:36.395608 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 13 15:16:36.395608 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application self._flush(objects) Sep 13 15:16:36.395608 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 13 15:16:36.395608 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 13 15:16:36.395608 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 13 15:16:36.395608 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application compat.raise_( Sep 13 15:16:36.395608 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 13 15:16:36.395608 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception Sep 13 15:16:36.395608 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 13 15:16:36.395608 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application flush_context.execute() Sep 13 15:16:36.395608 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 13 15:16:36.395608 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rec.execute(self) Sep 13 15:16:36.395608 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 13 15:16:36.395608 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 13 15:16:36.396482 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 13 15:16:36.396482 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 13 15:16:36.396482 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 13 15:16:36.396482 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application result = connection._execute_20( Sep 13 15:16:36.396482 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 13 15:16:36.396482 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 13 15:16:36.396482 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 13 15:16:36.396482 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 13 15:16:36.396482 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 13 15:16:36.396482 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 13 15:16:36.396482 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 13 15:16:36.396482 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 13 15:16:36.396482 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 13 15:16:36.396482 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 13 15:16:36.396482 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 13 15:16:36.396482 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception Sep 13 15:16:36.397327 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 13 15:16:36.397327 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 13 15:16:36.397327 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 13 15:16:36.397327 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 13 15:16:36.397327 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 13 15:16:36.397327 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application result = self._query(query) Sep 13 15:16:36.397327 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 13 15:16:36.397327 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application conn.query(q) Sep 13 15:16:36.397327 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 13 15:16:36.397327 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 13 15:16:36.397327 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 13 15:16:36.397327 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application result.read() Sep 13 15:16:36.397327 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 13 15:16:36.397327 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 13 15:16:36.397327 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 13 15:16:36.397327 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 13 15:16:36.398461 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 13 15:16:36.398461 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 13 15:16:36.398461 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 13 15:16:36.398461 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 13 15:16:36.398461 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 13 15:16:36.398461 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 13 15:16:36.398461 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [parameters: {'user_id': '3a8b0bafc36d40c299d6add5a3565013', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 13 15:16:36.398461 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 13 15:16:36.398461 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Sep 13 15:16:36.398461 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 15:16:36.398461 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Sep 13 15:16:36.398461 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:16:36.398461 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:16:36.398461 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:16:36.398461 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:16:36.399435 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:16:36.399435 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:16:36.399435 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:16:36.399435 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:16:36.399435 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:16:36.399435 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:16:36.399435 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:16:36.399435 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Sep 13 15:16:36.399435 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Sep 13 15:16:36.399435 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:16:36.399435 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:16:36.399435 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 15:16:36.399435 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 15:16:36.399435 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 15:16:36.399435 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 15:16:36.399435 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Sep 13 15:16:36.399435 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Sep 13 15:16:36.400547 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Sep 13 15:16:36.400547 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Sep 13 15:16:36.400547 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 13 15:16:36.400547 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 13 15:16:36.400547 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 13 15:16:36.400547 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Sep 13 15:16:36.400547 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 482/983] 10.222.0.27 () {60 vars in 1131 bytes} [Tue Sep 13 15:16:36 2022] POST /identity/v3/users => generated 160 bytes in 227 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Sep 13 15:16:36.407606 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41f8909-16df-4cee-982c-1928e0274a3a None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:36.407814 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9bbf46-c651-4a99-98fa-139d73f0bebe None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:36.447821 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d0017d-0918-4b46-8e79-5c479f0744df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:36.448802 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d0017d-0918-4b46-8e79-5c479f0744df None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:36.449327 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d0017d-0918-4b46-8e79-5c479f0744df None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:36.449863 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d0017d-0918-4b46-8e79-5c479f0744df None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:36.450715 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d0017d-0918-4b46-8e79-5c479f0744df None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:16:36.451225 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d0017d-0918-4b46-8e79-5c479f0744df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:36.452813 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d0017d-0918-4b46-8e79-5c479f0744df None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:36.455641 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:36.470492 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 502/984] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Sep 13 15:16:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 15:16:36.476271 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d0017d-0918-4b46-8e79-5c479f0744df None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:36.532987 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9bbf46-c651-4a99-98fa-139d73f0bebe None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:36.574402 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c45b9a-7f76-4390-8cee-7df20dd9cb91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:36.575031 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c45b9a-7f76-4390-8cee-7df20dd9cb91 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:36.575315 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c45b9a-7f76-4390-8cee-7df20dd9cb91 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:36.575594 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c45b9a-7f76-4390-8cee-7df20dd9cb91 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:36.586899 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c45b9a-7f76-4390-8cee-7df20dd9cb91 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:36.588849 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c45b9a-7f76-4390-8cee-7df20dd9cb91 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:36.600293 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d0017d-0918-4b46-8e79-5c479f0744df None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:36.602121 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-75c45b9a-7f76-4390-8cee-7df20dd9cb91 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 13 15:16:36.602121 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:16:36.602121 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:16:36.602121 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:16:36.602121 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:16:36.602121 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:16:36.602121 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:16:36.602121 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:16:36.602121 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:16:36.602121 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:16:36.602121 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:16:36.602121 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:16:36.602121 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 15:16:36.602121 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 15:16:36.602121 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 15:16:36.602121 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 15:16:36.603065 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:16:36.603065 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:16:36.603065 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 15:16:36.603065 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 15:16:36.603065 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 15:16:36.603065 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 15:16:36.603065 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:16:36.603065 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:16:36.603065 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:16:36.603065 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:16:36.603065 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:16:36.603065 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Sep 13 15:16:36.603065 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:16:36.603065 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:16:36.603065 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:16:36.603065 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:16:36.603065 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:16:36.603065 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:16:36.604017 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:16:36.604017 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:16:36.604017 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 15:16:36.604017 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 15:16:36.604017 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 15:16:36.604017 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 15:16:36.604017 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 15:16:36.604017 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 15:16:36.604017 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 13 15:16:36.604017 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Sep 13 15:16:36.604017 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 483/985] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Sep 13 15:16:36 2022] GET /identity/v3/users/cinder => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:16:36.608856 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c45b9a-7f76-4390-8cee-7df20dd9cb91 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:36.636674 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:36.652721 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb69eebc-face-47f5-af95-0017f887458f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:36.659359 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb69eebc-face-47f5-af95-0017f887458f None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:36.660012 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb69eebc-face-47f5-af95-0017f887458f None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:36.660628 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb69eebc-face-47f5-af95-0017f887458f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:36.670713 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb69eebc-face-47f5-af95-0017f887458f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:36.672409 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb69eebc-face-47f5-af95-0017f887458f None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:36.688808 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-eb69eebc-face-47f5-af95-0017f887458f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 15:16:36.688808 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:16:36.688808 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:16:36.688808 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:16:36.688808 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:16:36.688808 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:16:36.688808 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:16:36.688808 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:16:36.688808 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:16:36.688808 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:16:36.688808 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:16:36.688808 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:16:36.688808 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 15:16:36.688808 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 15:16:36.688808 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 15:16:36.689828 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 15:16:36.689828 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:16:36.689828 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:16:36.689828 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:16:36.689828 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:16:36.689828 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:16:36.689828 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:16:36.689828 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:16:36.689828 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Sep 13 15:16:36.689828 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:16:36.689828 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:16:36.689828 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:16:36.689828 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:16:36.689828 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:16:36.689828 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:16:36.689828 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:16:36.689828 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:16:36.691767 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 15:16:36.691767 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 15:16:36.691767 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 15:16:36.691767 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 15:16:36.691767 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 15:16:36.691767 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 15:16:36.691767 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 15:16:36.691767 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Sep 13 15:16:36.694090 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 503/986] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Sep 13 15:16:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 15:16:36.703168 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb69eebc-face-47f5-af95-0017f887458f None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:36.743890 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c45b9a-7f76-4390-8cee-7df20dd9cb91 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:36.771689 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:36.790049 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f7d3ee-1ede-4907-9ff2-49b1fd12b7ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:36.790660 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f7d3ee-1ede-4907-9ff2-49b1fd12b7ea None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:36.790939 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f7d3ee-1ede-4907-9ff2-49b1fd12b7ea None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:36.791209 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f7d3ee-1ede-4907-9ff2-49b1fd12b7ea None admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:36.791904 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f7d3ee-1ede-4907-9ff2-49b1fd12b7ea None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:16:36.792206 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f7d3ee-1ede-4907-9ff2-49b1fd12b7ea None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:36.793678 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f7d3ee-1ede-4907-9ff2-49b1fd12b7ea None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:36.825348 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb69eebc-face-47f5-af95-0017f887458f None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:36.833828 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 484/987] 10.222.0.27 () {56 vars in 1101 bytes} [Tue Sep 13 15:16:36 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 15:16:36.865133 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a172f5-a4c9-4a45-96fa-347317063299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:36.866067 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a172f5-a4c9-4a45-96fa-347317063299 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:36.866517 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a172f5-a4c9-4a45-96fa-347317063299 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:36.866945 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a172f5-a4c9-4a45-96fa-347317063299 None admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:36.867812 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a172f5-a4c9-4a45-96fa-347317063299 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:16:36.868283 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a172f5-a4c9-4a45-96fa-347317063299 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:36.870008 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a172f5-a4c9-4a45-96fa-347317063299 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:36.888928 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 504/988] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Sep 13 15:16:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 15:16:36.890639 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f7d3ee-1ede-4907-9ff2-49b1fd12b7ea None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:36.981916 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:37.008270 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f7d3ee-1ede-4907-9ff2-49b1fd12b7ea None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:37.044392 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35002fab-5dd3-4527-9fe7-27f45c908c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:37.045283 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35002fab-5dd3-4527-9fe7-27f45c908c3a None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:37.045741 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35002fab-5dd3-4527-9fe7-27f45c908c3a None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:37.046199 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35002fab-5dd3-4527-9fe7-27f45c908c3a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:37.047082 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35002fab-5dd3-4527-9fe7-27f45c908c3a None admin] RBAC: Adding query filter params (role.id=d2befaf77d3b4b15850920535a772db0, scope.project.id=3d6e00339cfa47d2a6fa8724c587035f, user.id=e97bcdb20f1e416ea41b99c226617faf) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:16:37.047547 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35002fab-5dd3-4527-9fe7-27f45c908c3a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:37.049134 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35002fab-5dd3-4527-9fe7-27f45c908c3a None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:37.056594 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 485/989] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Sep 13 15:16:36 2022] GET /identity/v3/role_assignments?user.id=e97bcdb20f1e416ea41b99c226617faf&scope.project.id=3d6e00339cfa47d2a6fa8724c587035f&role.id=d2befaf77d3b4b15850920535a772db0 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:16:37.680546 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29855bd7-9b3c-4f27-9437-1791b9924f77 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:37.681070 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29855bd7-9b3c-4f27-9437-1791b9924f77 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:37.681070 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29855bd7-9b3c-4f27-9437-1791b9924f77 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:37.682636 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 505/990] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:16:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:16:37.687719 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4e54b9-0b52-4e5f-a6af-39353a0fb466 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:37.688138 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4e54b9-0b52-4e5f-a6af-39353a0fb466 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:37.688279 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4e54b9-0b52-4e5f-a6af-39353a0fb466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:37.707617 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-4f4e54b9-0b52-4e5f-a6af-39353a0fb466 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:16:37.709853 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-4f4e54b9-0b52-4e5f-a6af-39353a0fb466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:16:37.784934 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 486/991] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:16:37 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 15:16:38.043439 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38a6a05-2f3e-4806-84fd-f7b505ddb7cb None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:38.043626 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38a6a05-2f3e-4806-84fd-f7b505ddb7cb None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:38.043895 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38a6a05-2f3e-4806-84fd-f7b505ddb7cb None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:38.045375 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 506/992] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:16:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:16:38.050717 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb99099-0fd7-4f85-8be5-081ab31498bf None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:38.051006 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb99099-0fd7-4f85-8be5-081ab31498bf None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:38.051275 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb99099-0fd7-4f85-8be5-081ab31498bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:38.055630 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38a6a05-2f3e-4806-84fd-f7b505ddb7cb None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:38.071792 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-1fb99099-0fd7-4f85-8be5-081ab31498bf None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:16:38.072974 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-1fb99099-0fd7-4f85-8be5-081ab31498bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:16:38.147489 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 487/993] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:16:38 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 15:16:38.168876 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38a6a05-2f3e-4806-84fd-f7b505ddb7cb None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:38.186841 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:38.206176 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c809bebb-d91b-44b3-b409-255f671ed9c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:38.206806 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c809bebb-d91b-44b3-b409-255f671ed9c8 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:38.207090 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c809bebb-d91b-44b3-b409-255f671ed9c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:38.207368 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c809bebb-d91b-44b3-b409-255f671ed9c8 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:38.207953 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c809bebb-d91b-44b3-b409-255f671ed9c8 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:38.209319 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c809bebb-d91b-44b3-b409-255f671ed9c8 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:38.218350 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-c809bebb-d91b-44b3-b409-255f671ed9c8 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 15:16:38.218350 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:16:38.218350 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 15:16:38.218350 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 15:16:38.218350 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 15:16:38.218350 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 15:16:38.218350 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 15:16:38.218350 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 15:16:38.218350 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 15:16:38.218350 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Sep 13 15:16:38.218350 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 15:16:38.218350 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Sep 13 15:16:38.218350 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:16:38.218350 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:16:38.218350 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:16:38.218350 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:16:38.218350 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:16:38.219356 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:16:38.219356 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:16:38.219356 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:16:38.219356 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:16:38.219356 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:16:38.219356 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:16:38.219356 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 15:16:38.219356 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 15:16:38.219356 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 15:16:38.219356 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 15:16:38.219356 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:16:38.219356 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:16:38.219356 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:16:38.219356 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:16:38.219356 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:16:38.219356 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:16:38.220227 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:16:38.220227 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Sep 13 15:16:38.220227 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:16:38.220227 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:16:38.220227 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:16:38.220227 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:16:38.220227 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:16:38.220227 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:16:38.220227 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:16:38.220227 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:16:38.220227 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 15:16:38.220227 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 15:16:38.220227 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 15:16:38.220227 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Sep 13 15:16:38.220227 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 507/994] 10.222.0.27 () {56 vars in 1126 bytes} [Tue Sep 13 15:16:38 2022] GET /identity/v3/services/object-store => generated 93 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 15:16:38.226189 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb99099-0fd7-4f85-8be5-081ab31498bf None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:38.228710 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:38.329994 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb99099-0fd7-4f85-8be5-081ab31498bf None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:38.364455 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679acb5d-06a6-4ff3-b405-033c14cec38b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:38.365061 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679acb5d-06a6-4ff3-b405-033c14cec38b None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:38.365348 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679acb5d-06a6-4ff3-b405-033c14cec38b None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:38.365625 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679acb5d-06a6-4ff3-b405-033c14cec38b None admin] PATH_INFO: `/v3/services` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:38.366285 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679acb5d-06a6-4ff3-b405-033c14cec38b None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:16:38.366589 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679acb5d-06a6-4ff3-b405-033c14cec38b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:38.367946 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679acb5d-06a6-4ff3-b405-033c14cec38b None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:38.372929 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 488/995] 10.222.0.27 () {56 vars in 1122 bytes} [Tue Sep 13 15:16:38 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:16:38.378784 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c809bebb-d91b-44b3-b409-255f671ed9c8 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:38.423627 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679acb5d-06a6-4ff3-b405-033c14cec38b None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:38.482599 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c809bebb-d91b-44b3-b409-255f671ed9c8 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:38.495710 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:38.518085 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f9568c-c621-478b-926f-f9136da0af7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:38.518690 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f9568c-c621-478b-926f-f9136da0af7c None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:38.518968 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f9568c-c621-478b-926f-f9136da0af7c None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:38.519242 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f9568c-c621-478b-926f-f9136da0af7c None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:38.519861 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f9568c-c621-478b-926f-f9136da0af7c None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:16:38.520164 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f9568c-c621-478b-926f-f9136da0af7c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:38.521534 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f9568c-c621-478b-926f-f9136da0af7c None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:38.526432 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 508/996] 10.222.0.27 () {56 vars in 1122 bytes} [Tue Sep 13 15:16:38 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:16:38.531987 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f9568c-c621-478b-926f-f9136da0af7c None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:38.535950 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679acb5d-06a6-4ff3-b405-033c14cec38b None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:38.572521 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a555167-9914-4f39-b93a-6d61ee225b8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:38.573146 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a555167-9914-4f39-b93a-6d61ee225b8f None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:38.573423 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a555167-9914-4f39-b93a-6d61ee225b8f None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:38.573719 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a555167-9914-4f39-b93a-6d61ee225b8f None admin] PATH_INFO: `/v3/services/compute` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:38.574298 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a555167-9914-4f39-b93a-6d61ee225b8f None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:38.575645 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a555167-9914-4f39-b93a-6d61ee225b8f None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:38.580285 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:38.585853 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-6a555167-9914-4f39-b93a-6d61ee225b8f None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 13 15:16:38.585853 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:16:38.585853 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 15:16:38.585853 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 15:16:38.585853 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 15:16:38.585853 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 15:16:38.585853 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 15:16:38.585853 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 15:16:38.585853 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 13 15:16:38.585853 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Sep 13 15:16:38.585853 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 15:16:38.585853 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Sep 13 15:16:38.585853 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:16:38.585853 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:16:38.585853 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:16:38.585853 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:16:38.585853 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:16:38.586848 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:16:38.586848 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:16:38.586848 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:16:38.586848 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:16:38.586848 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:16:38.586848 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:16:38.586848 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 15:16:38.586848 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 15:16:38.586848 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 15:16:38.586848 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 15:16:38.586848 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:16:38.586848 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:16:38.586848 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:16:38.586848 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:16:38.586848 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:16:38.586848 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:16:38.587691 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:16:38.587691 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Sep 13 15:16:38.587691 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:16:38.587691 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:16:38.587691 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:16:38.587691 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:16:38.587691 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:16:38.587691 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:16:38.587691 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:16:38.587691 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:16:38.587691 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 15:16:38.587691 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 15:16:38.587691 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 13 15:16:38.587691 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Sep 13 15:16:38.591780 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 489/997] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Sep 13 15:16:38 2022] GET /identity/v3/services/compute => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:16:38.592590 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a555167-9914-4f39-b93a-6d61ee225b8f None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:38.639094 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f9568c-c621-478b-926f-f9136da0af7c None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:38.677444 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a8766f-acb1-49cb-b345-6fc89cf704a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:38.678394 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a8766f-acb1-49cb-b345-6fc89cf704a1 None admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:38.678682 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a8766f-acb1-49cb-b345-6fc89cf704a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:38.679106 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a8766f-acb1-49cb-b345-6fc89cf704a1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:38.679774 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a8766f-acb1-49cb-b345-6fc89cf704a1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:38.681139 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a8766f-acb1-49cb-b345-6fc89cf704a1 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:38.698908 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 509/998] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 13 15:16:38 2022] POST /identity/v3/endpoints => generated 325 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 15:16:38.705100 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a555167-9914-4f39-b93a-6d61ee225b8f None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:38.742341 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:38.756884 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c226e8f3-2bd1-4b7e-b993-c5048bd84750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:38.757520 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c226e8f3-2bd1-4b7e-b993-c5048bd84750 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:38.757835 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c226e8f3-2bd1-4b7e-b993-c5048bd84750 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:38.758117 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c226e8f3-2bd1-4b7e-b993-c5048bd84750 None admin] PATH_INFO: `/v3/services` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:38.758765 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c226e8f3-2bd1-4b7e-b993-c5048bd84750 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:16:38.759073 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c226e8f3-2bd1-4b7e-b993-c5048bd84750 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:38.760550 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c226e8f3-2bd1-4b7e-b993-c5048bd84750 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:38.771867 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 490/999] 10.222.0.27 () {56 vars in 1112 bytes} [Tue Sep 13 15:16:38 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:16:38.772897 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a8766f-acb1-49cb-b345-6fc89cf704a1 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:38.885981 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a8766f-acb1-49cb-b345-6fc89cf704a1 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:38.889294 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:38.923843 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461a68c3-540f-423d-9c9a-3a6ff49fc1be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:38.924512 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461a68c3-540f-423d-9c9a-3a6ff49fc1be None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:38.924797 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461a68c3-540f-423d-9c9a-3a6ff49fc1be None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:38.925069 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461a68c3-540f-423d-9c9a-3a6ff49fc1be None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:38.925725 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461a68c3-540f-423d-9c9a-3a6ff49fc1be None admin] RBAC: Adding query filter params (type=compute) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:16:38.926032 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461a68c3-540f-423d-9c9a-3a6ff49fc1be None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:38.927459 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461a68c3-540f-423d-9c9a-3a6ff49fc1be None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:38.932640 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 510/1000] 10.222.0.27 () {56 vars in 1112 bytes} [Tue Sep 13 15:16:38 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:16:38.938524 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c226e8f3-2bd1-4b7e-b993-c5048bd84750 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:39.041801 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c226e8f3-2bd1-4b7e-b993-c5048bd84750 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:39.075965 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5005f1ab-075e-47a2-81f3-5ec08afd64c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:39.076721 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5005f1ab-075e-47a2-81f3-5ec08afd64c2 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:39.077104 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5005f1ab-075e-47a2-81f3-5ec08afd64c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:39.077475 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5005f1ab-075e-47a2-81f3-5ec08afd64c2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:39.078306 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5005f1ab-075e-47a2-81f3-5ec08afd64c2 None admin] RBAC: Adding query filter params (interface=public, service_id=7077af982dfd4161b90d56f2d874d41f, region_id=RegionOne) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:16:39.078717 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5005f1ab-075e-47a2-81f3-5ec08afd64c2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:39.080173 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5005f1ab-075e-47a2-81f3-5ec08afd64c2 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:39.090071 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 491/1001] 10.222.0.27 () {56 vars in 1251 bytes} [Tue Sep 13 15:16:38 2022] GET /identity/v3/endpoints?service_id=7077af982dfd4161b90d56f2d874d41f&interface=public®ion_id=RegionOne => generated 194 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 15:16:39.091297 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461a68c3-540f-423d-9c9a-3a6ff49fc1be None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:39.198882 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461a68c3-540f-423d-9c9a-3a6ff49fc1be None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:39.232796 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aa51fa-cad5-4b12-8b74-b0bccd7c8fc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:39.233403 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aa51fa-cad5-4b12-8b74-b0bccd7c8fc3 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:39.233683 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aa51fa-cad5-4b12-8b74-b0bccd7c8fc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:39.233984 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aa51fa-cad5-4b12-8b74-b0bccd7c8fc3 None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:39.234587 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4aa51fa-cad5-4b12-8b74-b0bccd7c8fc3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:39.235956 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4aa51fa-cad5-4b12-8b74-b0bccd7c8fc3 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:39.249953 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 511/1002] 10.222.0.27 () {56 vars in 1087 bytes} [Tue Sep 13 15:16:39 2022] GET /identity/v3/services => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 15:16:39.255806 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb08ab5-b4e4-4254-9e4e-e1ca6b351ce9 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:39.256110 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb08ab5-b4e4-4254-9e4e-e1ca6b351ce9 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:39.256359 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb08ab5-b4e4-4254-9e4e-e1ca6b351ce9 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:39.257960 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 492/1003] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:16:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:16:39.263765 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3391d1-c52d-463f-8929-b01ac4a661cc None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:39.264150 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3391d1-c52d-463f-8929-b01ac4a661cc None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:39.264524 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3391d1-c52d-463f-8929-b01ac4a661cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:39.284290 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-5d3391d1-c52d-463f-8929-b01ac4a661cc None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:16:39.285726 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-5d3391d1-c52d-463f-8929-b01ac4a661cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:16:39.316406 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:39.363383 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 512/1004] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:16:39 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 15:16:39.629652 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb08ab5-b4e4-4254-9e4e-e1ca6b351ce9 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:39.688379 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:39.741776 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb08ab5-b4e4-4254-9e4e-e1ca6b351ce9 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:39.777095 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a1f097-5ce8-4623-8173-5b98d81e6fae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:39.777744 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a1f097-5ce8-4623-8173-5b98d81e6fae None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:39.778028 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a1f097-5ce8-4623-8173-5b98d81e6fae None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:39.778303 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a1f097-5ce8-4623-8173-5b98d81e6fae None admin] PATH_INFO: `/v3/services/image` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:39.778879 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a1f097-5ce8-4623-8173-5b98d81e6fae None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:39.780221 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a1f097-5ce8-4623-8173-5b98d81e6fae None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:39.789294 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-97a1f097-5ce8-4623-8173-5b98d81e6fae None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 13 15:16:39.789294 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:16:39.789294 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 15:16:39.789294 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 15:16:39.789294 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 15:16:39.789294 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 15:16:39.789294 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 15:16:39.789294 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 15:16:39.789294 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 13 15:16:39.789294 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Sep 13 15:16:39.789294 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 15:16:39.789294 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Sep 13 15:16:39.789294 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:16:39.789294 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:16:39.789294 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:16:39.789294 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:16:39.789294 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:16:39.790322 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:16:39.790322 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:16:39.790322 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:16:39.790322 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:16:39.790322 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:16:39.790322 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:16:39.790322 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 15:16:39.790322 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 15:16:39.790322 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 15:16:39.790322 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 15:16:39.790322 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:16:39.790322 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:16:39.790322 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:16:39.790322 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:16:39.790322 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:16:39.790322 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:16:39.794801 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:16:39.794801 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Sep 13 15:16:39.794801 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:16:39.794801 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:16:39.794801 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:16:39.794801 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:16:39.794801 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:16:39.794801 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:16:39.794801 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:16:39.794801 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:16:39.794801 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 15:16:39.794801 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 15:16:39.794801 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 13 15:16:39.794801 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Sep 13 15:16:39.794801 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 493/1005] 10.222.0.27 () {56 vars in 1105 bytes} [Tue Sep 13 15:16:39 2022] GET /identity/v3/services/image => generated 86 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:16:39.796620 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3391d1-c52d-463f-8929-b01ac4a661cc None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:39.900336 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3391d1-c52d-463f-8929-b01ac4a661cc None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:39.934558 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304fe3b0-9067-41ce-abc9-c271d730eaf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:39.935176 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304fe3b0-9067-41ce-abc9-c271d730eaf6 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:39.935458 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304fe3b0-9067-41ce-abc9-c271d730eaf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:39.935735 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304fe3b0-9067-41ce-abc9-c271d730eaf6 None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:39.936364 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304fe3b0-9067-41ce-abc9-c271d730eaf6 None admin] RBAC: Adding query filter params (name=image) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:16:39.936669 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304fe3b0-9067-41ce-abc9-c271d730eaf6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:39.938058 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304fe3b0-9067-41ce-abc9-c271d730eaf6 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:39.944394 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 513/1006] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 13 15:16:39 2022] GET /identity/v3/services?name=image => generated 122 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:16:39.949900 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a1f097-5ce8-4623-8173-5b98d81e6fae None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:40.051612 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a1f097-5ce8-4623-8173-5b98d81e6fae None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:40.069172 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:40.087251 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3811939-bf90-4d9e-965d-e1a2e0ca715f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:40.087856 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3811939-bf90-4d9e-965d-e1a2e0ca715f None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:40.088135 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3811939-bf90-4d9e-965d-e1a2e0ca715f None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:40.088407 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3811939-bf90-4d9e-965d-e1a2e0ca715f None admin] PATH_INFO: `/v3/services` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:40.089069 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3811939-bf90-4d9e-965d-e1a2e0ca715f None admin] RBAC: Adding query filter params (type=image) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:16:40.089378 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3811939-bf90-4d9e-965d-e1a2e0ca715f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:40.090821 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3811939-bf90-4d9e-965d-e1a2e0ca715f None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:40.101982 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 494/1007] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 13 15:16:39 2022] GET /identity/v3/services?type=image => generated 122 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 15:16:40.900990 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae9f0dd-d513-43c5-8a4c-7c1a7f88a265 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:40.901528 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae9f0dd-d513-43c5-8a4c-7c1a7f88a265 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:40.901528 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae9f0dd-d513-43c5-8a4c-7c1a7f88a265 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:40.903076 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 514/1008] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:16:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:16:40.908293 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3ed1be-b8f3-4ae3-b1c3-e5a134a68791 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:40.908860 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3ed1be-b8f3-4ae3-b1c3-e5a134a68791 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:40.908995 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3ed1be-b8f3-4ae3-b1c3-e5a134a68791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:40.927402 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-5a3ed1be-b8f3-4ae3-b1c3-e5a134a68791 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:16:40.928597 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-5a3ed1be-b8f3-4ae3-b1c3-e5a134a68791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:16:41.002009 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 495/1009] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:16:40 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 15:16:41.270662 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae9f0dd-d513-43c5-8a4c-7c1a7f88a265 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:41.302194 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:41.382598 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae9f0dd-d513-43c5-8a4c-7c1a7f88a265 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:41.411744 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae422720-10c6-44e6-ae14-e1ddb00e5144 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:41.412041 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae422720-10c6-44e6-ae14-e1ddb00e5144 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:41.412299 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae422720-10c6-44e6-ae14-e1ddb00e5144 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:41.413643 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 496/1010] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:16:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 15:16:41.418673 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fe8a45-0b79-4359-b8ab-0052d74504a9 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:41.418963 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fe8a45-0b79-4359-b8ab-0052d74504a9 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:41.419240 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fe8a45-0b79-4359-b8ab-0052d74504a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:41.420955 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7935f07-3dcb-4f3a-ba3d-2fdd044c85e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:41.421585 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7935f07-3dcb-4f3a-ba3d-2fdd044c85e1 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:41.421897 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7935f07-3dcb-4f3a-ba3d-2fdd044c85e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:41.422236 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7935f07-3dcb-4f3a-ba3d-2fdd044c85e1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:41.423290 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7935f07-3dcb-4f3a-ba3d-2fdd044c85e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:41.425265 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7935f07-3dcb-4f3a-ba3d-2fdd044c85e1 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:41.431508 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 515/1011] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 13 15:16:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:16:41.432512 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7935f07-3dcb-4f3a-ba3d-2fdd044c85e1 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:41.438232 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-51fe8a45-0b79-4359-b8ab-0052d74504a9 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:16:41.439432 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-51fe8a45-0b79-4359-b8ab-0052d74504a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:16:41.510050 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 497/1012] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:16:41 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 15:16:41.533873 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:41.540745 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7935f07-3dcb-4f3a-ba3d-2fdd044c85e1 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:41.579189 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c07a43b-4084-4c81-a880-784885b7344e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:41.579790 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c07a43b-4084-4c81-a880-784885b7344e None admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:41.580074 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c07a43b-4084-4c81-a880-784885b7344e None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:41.580391 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c07a43b-4084-4c81-a880-784885b7344e None admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:41.581036 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c07a43b-4084-4c81-a880-784885b7344e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:41.582488 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c07a43b-4084-4c81-a880-784885b7344e None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:41.617737 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 516/1013] 10.222.0.27 () {60 vars in 1141 bytes} [Tue Sep 13 15:16:41 2022] POST /identity/v3/projects => generated 311 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 15:16:41.780934 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fe8a45-0b79-4359-b8ab-0052d74504a9 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:41.827014 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:41.886824 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fe8a45-0b79-4359-b8ab-0052d74504a9 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:41.922912 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45bdf6e-dcf6-405e-b61e-6b769a4cedb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:41.923572 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45bdf6e-dcf6-405e-b61e-6b769a4cedb2 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:41.923822 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45bdf6e-dcf6-405e-b61e-6b769a4cedb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:41.924717 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45bdf6e-dcf6-405e-b61e-6b769a4cedb2 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:41.925448 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45bdf6e-dcf6-405e-b61e-6b769a4cedb2 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:41.926846 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45bdf6e-dcf6-405e-b61e-6b769a4cedb2 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:41.935969 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-f45bdf6e-dcf6-405e-b61e-6b769a4cedb2 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 13 15:16:41.935969 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:16:41.935969 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 15:16:41.935969 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 15:16:41.935969 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 15:16:41.935969 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 15:16:41.935969 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 15:16:41.935969 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 15:16:41.935969 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 13 15:16:41.935969 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Sep 13 15:16:41.935969 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 15:16:41.935969 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Sep 13 15:16:41.935969 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:16:41.935969 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:16:41.935969 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:16:41.935969 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:16:41.935969 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:16:41.936971 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:16:41.936971 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:16:41.936971 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:16:41.936971 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:16:41.936971 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:16:41.936971 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:16:41.936971 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 15:16:41.936971 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 15:16:41.936971 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 15:16:41.936971 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 15:16:41.936971 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:16:41.936971 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:16:41.936971 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:16:41.936971 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:16:41.936971 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:16:41.936971 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:16:41.937861 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:16:41.937861 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Sep 13 15:16:41.937861 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:16:41.937861 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:16:41.937861 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:16:41.937861 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:16:41.937861 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:16:41.937861 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:16:41.937861 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:16:41.937861 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:16:41.937861 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 15:16:41.937861 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 15:16:41.937861 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 13 15:16:41.937861 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Sep 13 15:16:41.937861 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 498/1014] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Sep 13 15:16:41 2022] GET /identity/v3/services/compute => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:16:41.943442 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c07a43b-4084-4c81-a880-784885b7344e None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:42.044472 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c07a43b-4084-4c81-a880-784885b7344e None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:42.078321 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ba5f8a-167a-4ea7-accf-bfee67ace399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:42.078850 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ba5f8a-167a-4ea7-accf-bfee67ace399 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:42.079135 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ba5f8a-167a-4ea7-accf-bfee67ace399 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:42.079413 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ba5f8a-167a-4ea7-accf-bfee67ace399 None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:42.080050 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ba5f8a-167a-4ea7-accf-bfee67ace399 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:16:42.080915 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ba5f8a-167a-4ea7-accf-bfee67ace399 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:42.082318 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ba5f8a-167a-4ea7-accf-bfee67ace399 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:42.091760 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 517/1015] 10.222.0.27 () {56 vars in 1112 bytes} [Tue Sep 13 15:16:41 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:16:42.093327 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45bdf6e-dcf6-405e-b61e-6b769a4cedb2 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:42.205859 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45bdf6e-dcf6-405e-b61e-6b769a4cedb2 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:42.213600 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:42.242478 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679fade3-e430-43f9-9dad-e11e4a7fabbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:42.243090 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679fade3-e430-43f9-9dad-e11e4a7fabbf None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:42.243373 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679fade3-e430-43f9-9dad-e11e4a7fabbf None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:42.243648 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679fade3-e430-43f9-9dad-e11e4a7fabbf None admin] PATH_INFO: `/v3/services` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:42.244283 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679fade3-e430-43f9-9dad-e11e4a7fabbf None admin] RBAC: Adding query filter params (type=compute) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:16:42.244588 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679fade3-e430-43f9-9dad-e11e4a7fabbf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:42.245978 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679fade3-e430-43f9-9dad-e11e4a7fabbf None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:42.256182 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 499/1016] 10.222.0.27 () {56 vars in 1112 bytes} [Tue Sep 13 15:16:42 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 15:16:42.257607 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ba5f8a-167a-4ea7-accf-bfee67ace399 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:42.270644 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:42.288556 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a106b487-e1f0-4443-a870-1c096edc1859 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:42.288910 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a106b487-e1f0-4443-a870-1c096edc1859 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:42.289121 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a106b487-e1f0-4443-a870-1c096edc1859 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:42.290664 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 500/1017] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:16:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 15:16:42.295373 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f16f84d-8778-43da-ad66-5eef79deb012 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:42.295662 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f16f84d-8778-43da-ad66-5eef79deb012 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:42.295943 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f16f84d-8778-43da-ad66-5eef79deb012 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:42.315804 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-9f16f84d-8778-43da-ad66-5eef79deb012 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:16:42.317015 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-9f16f84d-8778-43da-ad66-5eef79deb012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:16:42.372134 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ba5f8a-167a-4ea7-accf-bfee67ace399 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:42.391815 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 501/1018] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:16:42 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 15:16:42.410460 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60189a29-3139-47c6-813e-7bb1f242f160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:42.411066 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60189a29-3139-47c6-813e-7bb1f242f160 None admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:42.411344 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60189a29-3139-47c6-813e-7bb1f242f160 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:42.411614 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60189a29-3139-47c6-813e-7bb1f242f160 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:42.412281 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60189a29-3139-47c6-813e-7bb1f242f160 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:42.413638 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60189a29-3139-47c6-813e-7bb1f242f160 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:42.441801 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 518/1019] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 13 15:16:42 2022] POST /identity/v3/endpoints => generated 334 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:16:42.663040 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f16f84d-8778-43da-ad66-5eef79deb012 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:42.769385 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:42.773161 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f16f84d-8778-43da-ad66-5eef79deb012 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:42.815365 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abc7f0d-653d-44fd-ad3a-515f9f6259da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:42.816216 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abc7f0d-653d-44fd-ad3a-515f9f6259da None admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:42.816600 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abc7f0d-653d-44fd-ad3a-515f9f6259da None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:42.816969 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abc7f0d-653d-44fd-ad3a-515f9f6259da None admin] PATH_INFO: `/v3/services` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:42.817850 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abc7f0d-653d-44fd-ad3a-515f9f6259da None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:42.819465 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abc7f0d-653d-44fd-ad3a-515f9f6259da None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:42.837739 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 502/1020] 10.222.0.27 () {60 vars in 1141 bytes} [Tue Sep 13 15:16:42 2022] POST /identity/v3/services => generated 242 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:16:43.840197 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fd94b2-84fb-4fde-860e-fc2bc54b7625 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:43.840747 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fd94b2-84fb-4fde-860e-fc2bc54b7625 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:43.840747 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fd94b2-84fb-4fde-860e-fc2bc54b7625 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:43.842279 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 519/1021] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:16:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:16:43.847385 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99e240d-e84e-45b9-9455-b6004fe8e818 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:43.847800 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99e240d-e84e-45b9-9455-b6004fe8e818 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:43.848004 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99e240d-e84e-45b9-9455-b6004fe8e818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:43.866332 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-b99e240d-e84e-45b9-9455-b6004fe8e818 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:16:43.867508 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-b99e240d-e84e-45b9-9455-b6004fe8e818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:16:43.940415 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 503/1022] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:16:43 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 15:16:44.206977 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fd94b2-84fb-4fde-860e-fc2bc54b7625 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:44.273130 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:44.312492 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fd94b2-84fb-4fde-860e-fc2bc54b7625 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:44.345412 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a230ad-25e4-42bb-af5f-ffee798d05d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:44.346627 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a230ad-25e4-42bb-af5f-ffee798d05d0 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:44.346908 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a230ad-25e4-42bb-af5f-ffee798d05d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:44.347176 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a230ad-25e4-42bb-af5f-ffee798d05d0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:44.348289 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a230ad-25e4-42bb-af5f-ffee798d05d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:44.349748 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a230ad-25e4-42bb-af5f-ffee798d05d0 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:44.351522 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 520/1023] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 13 15:16:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:16:44.356913 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99e240d-e84e-45b9-9455-b6004fe8e818 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:44.440588 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:44.462769 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99e240d-e84e-45b9-9455-b6004fe8e818 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:44.496797 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36c8783-81a8-402a-8de9-9057af490a42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:44.497412 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36c8783-81a8-402a-8de9-9057af490a42 None admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:44.497877 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36c8783-81a8-402a-8de9-9057af490a42 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:44.498079 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36c8783-81a8-402a-8de9-9057af490a42 None admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:44.498725 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36c8783-81a8-402a-8de9-9057af490a42 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:44.500144 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36c8783-81a8-402a-8de9-9057af490a42 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:44.522834 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 504/1024] 10.222.0.27 () {60 vars in 1132 bytes} [Tue Sep 13 15:16:44 2022] POST /identity/v3/users => generated 285 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:16:44.728707 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2650dc3-9bbe-4f80-b362-0a6eac498b66 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:44.729001 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2650dc3-9bbe-4f80-b362-0a6eac498b66 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:44.729280 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2650dc3-9bbe-4f80-b362-0a6eac498b66 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:44.730922 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 521/1025] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:16:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:16:44.736157 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8980c42-dc29-431e-a62c-16e47e7ffa6e None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:44.737090 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8980c42-dc29-431e-a62c-16e47e7ffa6e None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:44.737536 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8980c42-dc29-431e-a62c-16e47e7ffa6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:44.755944 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-a8980c42-dc29-431e-a62c-16e47e7ffa6e None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:16:44.757153 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-a8980c42-dc29-431e-a62c-16e47e7ffa6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:16:44.829220 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 505/1026] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:16:44 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 15:16:45.040002 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f2b470-e7ba-416f-9741-f6ff6d600acb None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:45.040514 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f2b470-e7ba-416f-9741-f6ff6d600acb None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:45.040514 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f2b470-e7ba-416f-9741-f6ff6d600acb None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:45.041970 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 522/1027] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:16:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:16:45.046981 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3b2a80-2f1d-4346-8e0e-e211bd9d16bf None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:45.047361 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3b2a80-2f1d-4346-8e0e-e211bd9d16bf None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:45.047541 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3b2a80-2f1d-4346-8e0e-e211bd9d16bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:45.066475 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-af3b2a80-2f1d-4346-8e0e-e211bd9d16bf None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:16:45.067681 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-af3b2a80-2f1d-4346-8e0e-e211bd9d16bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:16:45.105715 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f2b470-e7ba-416f-9741-f6ff6d600acb None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:45.135702 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:45.149777 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 506/1028] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:16:45 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 15:16:45.212749 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f2b470-e7ba-416f-9741-f6ff6d600acb None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:45.246168 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d61a9a-5d81-41c0-b8b6-45ad143fa574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:45.246800 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d61a9a-5d81-41c0-b8b6-45ad143fa574 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:45.247085 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d61a9a-5d81-41c0-b8b6-45ad143fa574 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:45.247363 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d61a9a-5d81-41c0-b8b6-45ad143fa574 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:45.249203 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:45.260267 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d61a9a-5d81-41c0-b8b6-45ad143fa574 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 15:16:45.265166 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-06d61a9a-5d81-41c0-b8b6-45ad143fa574 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 13 15:16:45.265166 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:16:45.265166 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:16:45.265166 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:16:45.265166 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:16:45.265166 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:16:45.265166 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:16:45.265166 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:16:45.265166 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:16:45.265166 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:16:45.265166 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:16:45.265166 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:16:45.265166 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 15:16:45.265166 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 15:16:45.265166 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 15:16:45.265166 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 15:16:45.266316 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 15:16:45.266316 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 15:16:45.266316 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 15:16:45.266316 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 15:16:45.266316 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:16:45.266316 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:16:45.266316 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:16:45.266316 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:16:45.266316 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:16:45.266316 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:16:45.266316 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:16:45.266316 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Sep 13 15:16:45.266316 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:16:45.266316 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:16:45.266316 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:16:45.266316 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:16:45.267186 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:16:45.267186 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:16:45.267186 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:16:45.267186 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:16:45.267186 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 15:16:45.267186 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 15:16:45.267186 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 15:16:45.267186 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 15:16:45.267186 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 15:16:45.267186 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 15:16:45.267186 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 13 15:16:45.267186 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Sep 13 15:16:45.267186 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 523/1029] 10.222.0.27 () {56 vars in 1120 bytes} [Tue Sep 13 15:16:45 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 15:16:45.272758 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3b2a80-2f1d-4346-8e0e-e211bd9d16bf None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:45.378588 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3b2a80-2f1d-4346-8e0e-e211bd9d16bf None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:45.413649 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c62d2a-145b-43d0-b671-e9c730dcffea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:45.414286 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c62d2a-145b-43d0-b671-e9c730dcffea None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:45.414564 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c62d2a-145b-43d0-b671-e9c730dcffea None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:45.414837 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c62d2a-145b-43d0-b671-e9c730dcffea None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:45.415501 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c62d2a-145b-43d0-b671-e9c730dcffea None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:16:45.415804 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c62d2a-145b-43d0-b671-e9c730dcffea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:45.417263 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c62d2a-145b-43d0-b671-e9c730dcffea None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:45.417619 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d61a9a-5d81-41c0-b8b6-45ad143fa574 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:45.426284 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 507/1030] 10.222.0.27 () {56 vars in 1115 bytes} [Tue Sep 13 15:16:45 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:16:45.431899 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c62d2a-145b-43d0-b671-e9c730dcffea None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:45.503518 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:45.531095 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d61a9a-5d81-41c0-b8b6-45ad143fa574 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:45.547397 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c62d2a-145b-43d0-b671-e9c730dcffea None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:45.566812 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a5e50d-941e-4820-9042-9565946a9b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:45.567430 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a5e50d-941e-4820-9042-9565946a9b37 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:45.567707 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a5e50d-941e-4820-9042-9565946a9b37 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:45.568231 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a5e50d-941e-4820-9042-9565946a9b37 None admin] PATH_INFO: `/v3/services/image` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:45.568794 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a5e50d-941e-4820-9042-9565946a9b37 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:45.570185 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a5e50d-941e-4820-9042-9565946a9b37 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:45.578998 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-24a5e50d-941e-4820-9042-9565946a9b37 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 13 15:16:45.578998 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:16:45.578998 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 15:16:45.578998 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 15:16:45.578998 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 15:16:45.578998 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 15:16:45.578998 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 15:16:45.578998 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 15:16:45.578998 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 13 15:16:45.578998 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Sep 13 15:16:45.578998 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 15:16:45.578998 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Sep 13 15:16:45.578998 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:16:45.578998 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:16:45.578998 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:16:45.578998 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:16:45.578998 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:16:45.580020 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:16:45.580020 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:16:45.580020 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:16:45.580020 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:16:45.580020 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:16:45.580020 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:16:45.580020 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 15:16:45.580020 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 15:16:45.580020 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 15:16:45.580020 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 15:16:45.580020 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:16:45.580020 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:16:45.580020 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:16:45.580020 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:16:45.580020 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:16:45.580020 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:16:45.581019 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:16:45.581019 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Sep 13 15:16:45.581019 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:16:45.581019 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:16:45.581019 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:16:45.581019 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:16:45.581019 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:16:45.581019 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:16:45.581019 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:16:45.581019 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:16:45.581019 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 15:16:45.581019 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 15:16:45.581019 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 13 15:16:45.581019 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Sep 13 15:16:45.581019 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 524/1031] 10.222.0.27 () {56 vars in 1105 bytes} [Tue Sep 13 15:16:45 2022] GET /identity/v3/services/image => generated 86 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:16:45.585936 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a5e50d-941e-4820-9042-9565946a9b37 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:45.589002 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd1ce14-32fa-42f6-8be4-baae6a8faa5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:45.589637 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd1ce14-32fa-42f6-8be4-baae6a8faa5e None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:45.589951 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd1ce14-32fa-42f6-8be4-baae6a8faa5e None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:45.590253 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd1ce14-32fa-42f6-8be4-baae6a8faa5e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:45.601368 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd1ce14-32fa-42f6-8be4-baae6a8faa5e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:45.602861 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd1ce14-32fa-42f6-8be4-baae6a8faa5e None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:45.617485 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-1fd1ce14-32fa-42f6-8be4-baae6a8faa5e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 15:16:45.617485 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:16:45.617485 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:16:45.617485 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:16:45.617485 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:16:45.617485 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:16:45.617485 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:16:45.617485 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:16:45.617485 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:16:45.617485 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:16:45.617485 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:16:45.617485 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:16:45.617485 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 15:16:45.617485 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 15:16:45.617485 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 15:16:45.617485 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 15:16:45.618491 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:16:45.618491 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:16:45.618491 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:16:45.618491 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:16:45.618491 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:16:45.618491 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:16:45.618491 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:16:45.618491 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Sep 13 15:16:45.618491 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:16:45.618491 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:16:45.618491 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:16:45.618491 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:16:45.618491 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:16:45.618491 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:16:45.618491 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:16:45.618491 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:16:45.618491 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 15:16:45.619391 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 15:16:45.619391 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 15:16:45.619391 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Sep 13 15:16:45.619391 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 508/1032] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 13 15:16:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 15:16:45.624491 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd1ce14-32fa-42f6-8be4-baae6a8faa5e None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:45.655237 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:45.701550 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a5e50d-941e-4820-9042-9565946a9b37 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:45.734468 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd1ce14-32fa-42f6-8be4-baae6a8faa5e None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:45.745864 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06382965-d528-4e32-b275-521cc0163760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:45.746780 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06382965-d528-4e32-b275-521cc0163760 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:45.747213 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06382965-d528-4e32-b275-521cc0163760 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:45.747494 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06382965-d528-4e32-b275-521cc0163760 None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:45.748118 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06382965-d528-4e32-b275-521cc0163760 None admin] RBAC: Adding query filter params (name=image) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:16:45.748419 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06382965-d528-4e32-b275-521cc0163760 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:45.749654 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:45.749785 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06382965-d528-4e32-b275-521cc0163760 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:45.755780 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 525/1033] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 13 15:16:45 2022] GET /identity/v3/services?name=image => generated 122 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:16:45.761409 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06382965-d528-4e32-b275-521cc0163760 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:45.778741 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00aa509e-f571-41ad-b35f-8e5eef7ba06f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:45.779773 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aa509e-f571-41ad-b35f-8e5eef7ba06f None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:45.780562 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aa509e-f571-41ad-b35f-8e5eef7ba06f None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:45.780990 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aa509e-f571-41ad-b35f-8e5eef7ba06f None admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:45.781805 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00aa509e-f571-41ad-b35f-8e5eef7ba06f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:16:45.782275 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00aa509e-f571-41ad-b35f-8e5eef7ba06f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:45.785101 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00aa509e-f571-41ad-b35f-8e5eef7ba06f None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:45.800657 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 509/1034] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Sep 13 15:16:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:16:45.805881 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00aa509e-f571-41ad-b35f-8e5eef7ba06f None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:45.864701 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06382965-d528-4e32-b275-521cc0163760 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:45.887925 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:45.901215 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4388721-ace7-4adc-876e-a48f0aad9f21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:45.901858 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4388721-ace7-4adc-876e-a48f0aad9f21 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:45.902140 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4388721-ace7-4adc-876e-a48f0aad9f21 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:45.902419 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4388721-ace7-4adc-876e-a48f0aad9f21 None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:45.903078 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4388721-ace7-4adc-876e-a48f0aad9f21 None admin] RBAC: Adding query filter params (type=image) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:16:45.903380 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4388721-ace7-4adc-876e-a48f0aad9f21 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:45.904746 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4388721-ace7-4adc-876e-a48f0aad9f21 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:45.914637 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 526/1035] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 13 15:16:45 2022] GET /identity/v3/services?type=image => generated 350 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 15:16:45.915555 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4388721-ace7-4adc-876e-a48f0aad9f21 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:45.915663 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00aa509e-f571-41ad-b35f-8e5eef7ba06f None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:45.950423 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c47526-f127-4fd6-8d47-8582b428cefc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:45.951055 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c47526-f127-4fd6-8d47-8582b428cefc None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:45.951337 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c47526-f127-4fd6-8d47-8582b428cefc None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:45.951609 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c47526-f127-4fd6-8d47-8582b428cefc None admin] PATH_INFO: `/v3/users/nova` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:45.959270 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c47526-f127-4fd6-8d47-8582b428cefc None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:45.960704 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c47526-f127-4fd6-8d47-8582b428cefc None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:45.972467 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-b3c47526-f127-4fd6-8d47-8582b428cefc None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 13 15:16:45.972467 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:16:45.972467 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:16:45.972467 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:16:45.972467 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:16:45.972467 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:16:45.972467 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:16:45.972467 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:16:45.972467 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:16:45.972467 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:16:45.972467 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:16:45.972467 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:16:45.972467 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 15:16:45.972467 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 15:16:45.972467 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 15:16:45.972467 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 15:16:45.973615 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:16:45.973615 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:16:45.973615 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 15:16:45.973615 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 15:16:45.973615 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 15:16:45.973615 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 15:16:45.973615 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:16:45.973615 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:16:45.973615 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:16:45.973615 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:16:45.973615 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:16:45.973615 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Sep 13 15:16:45.973615 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:16:45.973615 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:16:45.973615 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:16:45.973615 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:16:45.973615 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:16:45.973615 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:16:45.974845 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:16:45.974845 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:16:45.974845 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 15:16:45.974845 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 15:16:45.974845 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 15:16:45.974845 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 15:16:45.974845 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 15:16:45.974845 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 15:16:45.974845 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 13 15:16:45.974845 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Sep 13 15:16:45.974845 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 510/1036] 10.222.0.27 () {56 vars in 1093 bytes} [Tue Sep 13 15:16:45 2022] GET /identity/v3/users/nova => generated 82 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:16:45.979196 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c47526-f127-4fd6-8d47-8582b428cefc None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:46.012901 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:46.024254 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4388721-ace7-4adc-876e-a48f0aad9f21 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:46.060215 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dd4ab7-410c-42a9-acf6-2520ee09356e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:46.060840 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dd4ab7-410c-42a9-acf6-2520ee09356e None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:46.061090 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dd4ab7-410c-42a9-acf6-2520ee09356e None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:46.061366 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dd4ab7-410c-42a9-acf6-2520ee09356e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:46.062096 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dd4ab7-410c-42a9-acf6-2520ee09356e None admin] RBAC: Adding query filter params (interface=public, service_id=cac9b08dc52b449fadf77b4c74f19526, region_id=RegionOne) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:16:46.062410 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dd4ab7-410c-42a9-acf6-2520ee09356e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:46.063851 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dd4ab7-410c-42a9-acf6-2520ee09356e None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:46.074193 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 527/1037] 10.222.0.27 () {56 vars in 1251 bytes} [Tue Sep 13 15:16:45 2022] GET /identity/v3/endpoints?service_id=cac9b08dc52b449fadf77b4c74f19526&interface=public®ion_id=RegionOne => generated 194 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 15:16:46.075021 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dd4ab7-410c-42a9-acf6-2520ee09356e None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:46.094708 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c47526-f127-4fd6-8d47-8582b428cefc None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:46.127499 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:46.129693 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bb7976-cadf-4a85-b8a7-e0204d551b89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:46.130326 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bb7976-cadf-4a85-b8a7-e0204d551b89 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:46.130602 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bb7976-cadf-4a85-b8a7-e0204d551b89 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:46.130870 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bb7976-cadf-4a85-b8a7-e0204d551b89 None admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:46.131990 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bb7976-cadf-4a85-b8a7-e0204d551b89 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:16:46.132273 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bb7976-cadf-4a85-b8a7-e0204d551b89 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:46.133797 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bb7976-cadf-4a85-b8a7-e0204d551b89 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:46.154695 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 511/1038] 10.222.0.27 () {56 vars in 1133 bytes} [Tue Sep 13 15:16:45 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 15:16:46.160707 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bb7976-cadf-4a85-b8a7-e0204d551b89 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:46.183590 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dd4ab7-410c-42a9-acf6-2520ee09356e None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:46.227369 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0090e9-f475-4999-aacb-83a9c29d5ab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:46.227981 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0090e9-f475-4999-aacb-83a9c29d5ab2 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:46.228263 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0090e9-f475-4999-aacb-83a9c29d5ab2 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:46.228537 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0090e9-f475-4999-aacb-83a9c29d5ab2 None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:46.229142 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0090e9-f475-4999-aacb-83a9c29d5ab2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:46.230539 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0090e9-f475-4999-aacb-83a9c29d5ab2 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:46.245735 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 528/1039] 10.222.0.27 () {56 vars in 1087 bytes} [Tue Sep 13 15:16:46 2022] GET /identity/v3/services => generated 1957 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 15:16:46.263186 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:46.275775 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bb7976-cadf-4a85-b8a7-e0204d551b89 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:46.315586 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a69f04a-a7ed-4a87-95ae-61c5b3667cc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:46.316215 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a69f04a-a7ed-4a87-95ae-61c5b3667cc5 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:46.316500 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a69f04a-a7ed-4a87-95ae-61c5b3667cc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:46.316773 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a69f04a-a7ed-4a87-95ae-61c5b3667cc5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:46.393109 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a69f04a-a7ed-4a87-95ae-61c5b3667cc5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:46.394800 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a69f04a-a7ed-4a87-95ae-61c5b3667cc5 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:46.492052 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:46.504921 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 512/1040] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Sep 13 15:16:46 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 13 15:16:46.510865 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0090e9-f475-4999-aacb-83a9c29d5ab2 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:46.612690 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0090e9-f475-4999-aacb-83a9c29d5ab2 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:46.626381 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:46.647519 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d62a66-c8b2-44a7-8644-307f72582744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:46.648157 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d62a66-c8b2-44a7-8644-307f72582744 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:46.648438 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d62a66-c8b2-44a7-8644-307f72582744 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:46.648711 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d62a66-c8b2-44a7-8644-307f72582744 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:46.660729 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d62a66-c8b2-44a7-8644-307f72582744 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:46.662261 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d62a66-c8b2-44a7-8644-307f72582744 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:46.678541 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-b2d62a66-c8b2-44a7-8644-307f72582744 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 15:16:46.678541 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:16:46.678541 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:16:46.678541 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:16:46.678541 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:16:46.678541 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:16:46.678541 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:16:46.678541 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:16:46.678541 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:16:46.678541 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:16:46.678541 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:16:46.678541 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:16:46.678541 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 15:16:46.678541 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 15:16:46.678541 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 15:16:46.678541 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 15:16:46.679569 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:16:46.679569 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:16:46.679569 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:16:46.679569 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:16:46.679569 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:16:46.679569 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:16:46.679569 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:16:46.679569 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Sep 13 15:16:46.679569 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:16:46.679569 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:16:46.679569 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:16:46.679569 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:16:46.679569 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:16:46.679569 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:16:46.679569 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:16:46.679569 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:16:46.679569 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 15:16:46.680453 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 15:16:46.680453 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 15:16:46.680453 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Sep 13 15:16:46.681776 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 529/1041] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 13 15:16:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:16:46.685735 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a69f04a-a7ed-4a87-95ae-61c5b3667cc5 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:46.784538 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f82818-df00-4487-a138-c19d50459291 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:46.784725 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f82818-df00-4487-a138-c19d50459291 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:46.785004 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f82818-df00-4487-a138-c19d50459291 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:46.786544 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 530/1042] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:16:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:16:46.791337 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e8f3bb-d30b-4e37-a49f-f42b0325d9c7 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:46.791635 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e8f3bb-d30b-4e37-a49f-f42b0325d9c7 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:46.791915 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e8f3bb-d30b-4e37-a49f-f42b0325d9c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:46.797352 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a69f04a-a7ed-4a87-95ae-61c5b3667cc5 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:46.811121 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-12e8f3bb-d30b-4e37-a49f-f42b0325d9c7 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:16:46.812318 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-12e8f3bb-d30b-4e37-a49f-f42b0325d9c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:16:46.842207 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0894155e-8f0c-4b99-9636-5217fa6140f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:46.842822 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0894155e-8f0c-4b99-9636-5217fa6140f7 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:46.843105 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0894155e-8f0c-4b99-9636-5217fa6140f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:46.843381 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0894155e-8f0c-4b99-9636-5217fa6140f7 None admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:46.844018 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0894155e-8f0c-4b99-9636-5217fa6140f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:16:46.844333 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0894155e-8f0c-4b99-9636-5217fa6140f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:46.845845 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0894155e-8f0c-4b99-9636-5217fa6140f7 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:46.863507 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 513/1043] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Sep 13 15:16:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:16:46.864602 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0894155e-8f0c-4b99-9636-5217fa6140f7 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:46.885800 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 531/1044] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:16:46 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 15:16:46.921490 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:46.976275 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0894155e-8f0c-4b99-9636-5217fa6140f7 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:47.011263 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcd52d9-fb13-4279-a4b6-bec80b0f3ddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:47.012258 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcd52d9-fb13-4279-a4b6-bec80b0f3ddd None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:47.012737 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcd52d9-fb13-4279-a4b6-bec80b0f3ddd None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:47.013202 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcd52d9-fb13-4279-a4b6-bec80b0f3ddd None admin] PATH_INFO: `/v3/projects/service` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:47.020341 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcd52d9-fb13-4279-a4b6-bec80b0f3ddd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:47.022024 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcd52d9-fb13-4279-a4b6-bec80b0f3ddd None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:47.034331 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-3bcd52d9-fb13-4279-a4b6-bec80b0f3ddd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 15:16:47.034331 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:16:47.034331 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:16:47.034331 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:16:47.034331 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:16:47.034331 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:16:47.034331 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:16:47.034331 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:16:47.034331 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:16:47.034331 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:16:47.034331 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:16:47.034331 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:16:47.034331 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 15:16:47.034331 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 15:16:47.034331 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 15:16:47.035255 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 15:16:47.035255 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:16:47.035255 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:16:47.035255 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:16:47.035255 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:16:47.035255 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:16:47.035255 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:16:47.035255 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:16:47.035255 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Sep 13 15:16:47.035255 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:16:47.035255 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:16:47.035255 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:16:47.035255 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:16:47.035255 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:16:47.035255 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:16:47.035255 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:16:47.035255 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:16:47.036172 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 15:16:47.036172 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 15:16:47.036172 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 15:16:47.036172 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 15:16:47.036172 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 15:16:47.036172 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 15:16:47.036172 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 15:16:47.036172 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Sep 13 15:16:47.042167 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 514/1045] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Sep 13 15:16:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:16:47.043483 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e8f3bb-d30b-4e37-a49f-f42b0325d9c7 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:47.139829 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:47.149081 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e8f3bb-d30b-4e37-a49f-f42b0325d9c7 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:47.161408 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcd52d9-fb13-4279-a4b6-bec80b0f3ddd None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:47.184672 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b7ef7d-718f-420b-b6f2-51f7370351e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:47.185290 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b7ef7d-718f-420b-b6f2-51f7370351e2 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:47.185568 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b7ef7d-718f-420b-b6f2-51f7370351e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:47.185871 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b7ef7d-718f-420b-b6f2-51f7370351e2 None admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:47.186554 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b7ef7d-718f-420b-b6f2-51f7370351e2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:16:47.186867 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b7ef7d-718f-420b-b6f2-51f7370351e2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:47.188285 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b7ef7d-718f-420b-b6f2-51f7370351e2 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:47.201856 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 532/1046] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Sep 13 15:16:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:16:47.207608 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b7ef7d-718f-420b-b6f2-51f7370351e2 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:47.268509 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcd52d9-fb13-4279-a4b6-bec80b0f3ddd None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:47.279726 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:47.307248 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c72d27-d44f-41ca-a297-903b9e464c3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:47.308574 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c72d27-d44f-41ca-a297-903b9e464c3e None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:47.309347 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c72d27-d44f-41ca-a297-903b9e464c3e None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:47.309854 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c72d27-d44f-41ca-a297-903b9e464c3e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:47.311095 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b7ef7d-718f-420b-b6f2-51f7370351e2 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:47.322245 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c72d27-d44f-41ca-a297-903b9e464c3e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 15:16:47.328048 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-74c72d27-d44f-41ca-a297-903b9e464c3e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 15:16:47.328048 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:16:47.328048 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:16:47.328048 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:16:47.328048 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:16:47.328048 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:16:47.328048 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:16:47.328048 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:16:47.328048 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:16:47.328048 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:16:47.328048 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:16:47.328048 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:16:47.328048 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 15:16:47.328048 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 15:16:47.328048 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 15:16:47.328048 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 15:16:47.329171 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 15:16:47.329171 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 15:16:47.329171 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 15:16:47.329171 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 15:16:47.329171 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:16:47.329171 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:16:47.329171 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:16:47.329171 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:16:47.329171 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:16:47.329171 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:16:47.329171 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:16:47.329171 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Sep 13 15:16:47.329171 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:16:47.329171 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:16:47.329171 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:16:47.329171 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:16:47.330230 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:16:47.330230 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:16:47.330230 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:16:47.330230 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:16:47.330230 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 15:16:47.330230 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 15:16:47.330230 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 15:16:47.330230 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 15:16:47.330230 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 15:16:47.330230 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 15:16:47.330230 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 15:16:47.330230 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Sep 13 15:16:47.331396 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 515/1047] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Sep 13 15:16:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 15:16:47.337011 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c72d27-d44f-41ca-a297-903b9e464c3e None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:47.350504 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6503e4df-37fc-4130-91b1-6dacbc6da269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:47.351105 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6503e4df-37fc-4130-91b1-6dacbc6da269 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:47.351384 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6503e4df-37fc-4130-91b1-6dacbc6da269 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:47.351651 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6503e4df-37fc-4130-91b1-6dacbc6da269 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:47.352366 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6503e4df-37fc-4130-91b1-6dacbc6da269 None admin] RBAC: Adding query filter params (role.id=d2befaf77d3b4b15850920535a772db0, scope.project.id=3d6e00339cfa47d2a6fa8724c587035f, user.id=62aad71c6c1a4469805762bba330bf0e) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:16:47.352674 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6503e4df-37fc-4130-91b1-6dacbc6da269 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:47.354125 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6503e4df-37fc-4130-91b1-6dacbc6da269 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:47.359650 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 533/1048] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Sep 13 15:16:47 2022] GET /identity/v3/role_assignments?user.id=62aad71c6c1a4469805762bba330bf0e&scope.project.id=3d6e00339cfa47d2a6fa8724c587035f&role.id=d2befaf77d3b4b15850920535a772db0 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 15:16:47.451718 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c72d27-d44f-41ca-a297-903b9e464c3e None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:47.491170 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e064743-79c0-48b6-8698-a2b8dac9af0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:47.491803 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e064743-79c0-48b6-8698-a2b8dac9af0a None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:47.492083 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e064743-79c0-48b6-8698-a2b8dac9af0a None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:47.492357 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e064743-79c0-48b6-8698-a2b8dac9af0a None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:47.493031 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e064743-79c0-48b6-8698-a2b8dac9af0a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:16:47.493337 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e064743-79c0-48b6-8698-a2b8dac9af0a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:47.494751 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e064743-79c0-48b6-8698-a2b8dac9af0a None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:47.505133 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 516/1049] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Sep 13 15:16:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 15:16:47.510962 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6503e4df-37fc-4130-91b1-6dacbc6da269 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:47.535632 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:47.617009 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6503e4df-37fc-4130-91b1-6dacbc6da269 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:47.650291 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22eae97f-b355-4e16-882b-9de6c2d16b8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:47.650923 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eae97f-b355-4e16-882b-9de6c2d16b8b None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:47.651205 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eae97f-b355-4e16-882b-9de6c2d16b8b None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:47.651481 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eae97f-b355-4e16-882b-9de6c2d16b8b None admin] PATH_INFO: `/v3/users/b96fb880493a42db9193c0fb05c7eb9f` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:47.665306 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22eae97f-b355-4e16-882b-9de6c2d16b8b None admin] RBAC: Authorizing `identity:get_user(user_id=b96fb880493a42db9193c0fb05c7eb9f)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:47.666782 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22eae97f-b355-4e16-882b-9de6c2d16b8b None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:47.668577 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 534/1050] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Sep 13 15:16:47 2022] GET /identity/v3/users/b96fb880493a42db9193c0fb05c7eb9f => generated 285 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:16:47.674133 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e064743-79c0-48b6-8698-a2b8dac9af0a None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:47.707195 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:47.783610 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e064743-79c0-48b6-8698-a2b8dac9af0a None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:47.818546 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb619aa-f244-4538-8c87-d25d45eaa776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:47.819159 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb619aa-f244-4538-8c87-d25d45eaa776 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:47.819439 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb619aa-f244-4538-8c87-d25d45eaa776 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:47.819711 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb619aa-f244-4538-8c87-d25d45eaa776 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:47.888787 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb619aa-f244-4538-8c87-d25d45eaa776 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:47.890279 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb619aa-f244-4538-8c87-d25d45eaa776 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:47.920220 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:47.994999 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 517/1051] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Sep 13 15:16:47 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 15:16:47.996198 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22eae97f-b355-4e16-882b-9de6c2d16b8b None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:48.079202 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:48.102495 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22eae97f-b355-4e16-882b-9de6c2d16b8b None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:48.136945 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e1a11a-01d3-4a14-84ea-5a6f017c32d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:48.137576 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e1a11a-01d3-4a14-84ea-5a6f017c32d5 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:48.137891 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e1a11a-01d3-4a14-84ea-5a6f017c32d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:48.138170 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e1a11a-01d3-4a14-84ea-5a6f017c32d5 None admin] PATH_INFO: `/v3/projects/133e15d053124ceeb3bdf8a5c5e2b4fd` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:48.139342 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e1a11a-01d3-4a14-84ea-5a6f017c32d5 None admin] RBAC: Authorizing `identity:get_project(project_id=133e15d053124ceeb3bdf8a5c5e2b4fd)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:48.140725 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e1a11a-01d3-4a14-84ea-5a6f017c32d5 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:48.143100 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 535/1052] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Sep 13 15:16:47 2022] GET /identity/v3/projects/133e15d053124ceeb3bdf8a5c5e2b4fd => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:16:48.149143 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb619aa-f244-4538-8c87-d25d45eaa776 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:48.252245 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb619aa-f244-4538-8c87-d25d45eaa776 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:48.282811 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:48.289518 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c3be7c-9768-49bb-b167-6487b1eec98c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:48.290156 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c3be7c-9768-49bb-b167-6487b1eec98c None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:48.290436 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c3be7c-9768-49bb-b167-6487b1eec98c None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:48.290707 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c3be7c-9768-49bb-b167-6487b1eec98c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:48.291428 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c3be7c-9768-49bb-b167-6487b1eec98c None admin] RBAC: Adding query filter params (role.id=f34412ad29f1478cba775b033129f71f, scope.project.id=133e15d053124ceeb3bdf8a5c5e2b4fd, user.id=b96fb880493a42db9193c0fb05c7eb9f) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:16:48.291737 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c3be7c-9768-49bb-b167-6487b1eec98c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:48.293146 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c3be7c-9768-49bb-b167-6487b1eec98c None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:48.298809 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 518/1053] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Sep 13 15:16:48 2022] GET /identity/v3/role_assignments?user.id=b96fb880493a42db9193c0fb05c7eb9f&scope.project.id=133e15d053124ceeb3bdf8a5c5e2b4fd&role.id=f34412ad29f1478cba775b033129f71f => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 15:16:48.451943 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc76584a-6955-438b-9368-8fa8e03634c7 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:48.452143 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc76584a-6955-438b-9368-8fa8e03634c7 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:48.452386 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc76584a-6955-438b-9368-8fa8e03634c7 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:48.454056 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 536/1054] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:16:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:16:48.460540 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb74324-ce14-4fe3-b3fc-c0d5644378eb None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:48.460819 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb74324-ce14-4fe3-b3fc-c0d5644378eb None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:48.461093 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb74324-ce14-4fe3-b3fc-c0d5644378eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:48.480319 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-aeb74324-ce14-4fe3-b3fc-c0d5644378eb None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:16:48.481524 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-aeb74324-ce14-4fe3-b3fc-c0d5644378eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:16:48.549677 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 519/1055] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:16:48 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 15:16:48.821108 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc76584a-6955-438b-9368-8fa8e03634c7 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:48.923078 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc76584a-6955-438b-9368-8fa8e03634c7 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:48.958078 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae2840c-d15f-4622-b439-a34a3189c2b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:48.958712 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae2840c-d15f-4622-b439-a34a3189c2b2 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:48.958992 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae2840c-d15f-4622-b439-a34a3189c2b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:48.959266 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae2840c-d15f-4622-b439-a34a3189c2b2 None admin] PATH_INFO: `/v3/services/image` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:48.959849 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae2840c-d15f-4622-b439-a34a3189c2b2 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:48.961203 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae2840c-d15f-4622-b439-a34a3189c2b2 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:48.970183 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-1ae2840c-d15f-4622-b439-a34a3189c2b2 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 13 15:16:48.970183 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:16:48.970183 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 15:16:48.970183 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 15:16:48.970183 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 15:16:48.970183 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 15:16:48.970183 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 15:16:48.970183 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 15:16:48.970183 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 13 15:16:48.970183 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Sep 13 15:16:48.970183 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 15:16:48.970183 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Sep 13 15:16:48.970183 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:16:48.970183 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:16:48.970183 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:16:48.970183 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:16:48.970183 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:16:48.971274 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:16:48.971274 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:16:48.971274 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:16:48.971274 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:16:48.971274 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:16:48.971274 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:16:48.971274 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 15:16:48.971274 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 15:16:48.971274 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 15:16:48.971274 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 15:16:48.971274 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:16:48.971274 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:16:48.971274 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:16:48.971274 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:16:48.971274 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:16:48.971274 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:16:48.972155 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:16:48.972155 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Sep 13 15:16:48.972155 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:16:48.972155 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:16:48.972155 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:16:48.972155 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:16:48.972155 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:16:48.972155 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:16:48.972155 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:16:48.972155 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:16:48.972155 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 15:16:48.972155 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 15:16:48.972155 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 13 15:16:48.972155 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Sep 13 15:16:48.972155 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 537/1056] 10.222.0.27 () {56 vars in 1105 bytes} [Tue Sep 13 15:16:48 2022] GET /identity/v3/services/image => generated 86 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:16:48.977638 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb74324-ce14-4fe3-b3fc-c0d5644378eb None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:49.079366 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb74324-ce14-4fe3-b3fc-c0d5644378eb None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:49.104948 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:49.115562 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc99fb9-5cec-49f8-8572-60a2ef532b6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:49.116172 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc99fb9-5cec-49f8-8572-60a2ef532b6e None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:49.116454 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc99fb9-5cec-49f8-8572-60a2ef532b6e None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:49.116725 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc99fb9-5cec-49f8-8572-60a2ef532b6e None admin] PATH_INFO: `/v3/services` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:49.117350 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc99fb9-5cec-49f8-8572-60a2ef532b6e None admin] RBAC: Adding query filter params (name=image) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:16:49.117654 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc99fb9-5cec-49f8-8572-60a2ef532b6e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:49.119042 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc99fb9-5cec-49f8-8572-60a2ef532b6e None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:49.129028 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 520/1057] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 13 15:16:48 2022] GET /identity/v3/services?name=image => generated 122 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 15:16:49.130550 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae2840c-d15f-4622-b439-a34a3189c2b2 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:49.144477 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:49.235770 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae2840c-d15f-4622-b439-a34a3189c2b2 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:49.271043 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd72c309-4e94-45ea-8317-f8eec4a451cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:49.271647 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd72c309-4e94-45ea-8317-f8eec4a451cd None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:49.271928 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd72c309-4e94-45ea-8317-f8eec4a451cd None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:49.272203 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd72c309-4e94-45ea-8317-f8eec4a451cd None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:49.272831 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd72c309-4e94-45ea-8317-f8eec4a451cd None admin] RBAC: Adding query filter params (type=image) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:16:49.273135 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd72c309-4e94-45ea-8317-f8eec4a451cd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:49.274529 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd72c309-4e94-45ea-8317-f8eec4a451cd None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:49.284224 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 538/1058] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 13 15:16:49 2022] GET /identity/v3/services?type=image => generated 350 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 15:16:49.285790 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc99fb9-5cec-49f8-8572-60a2ef532b6e None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:49.392947 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc99fb9-5cec-49f8-8572-60a2ef532b6e None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:49.431709 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15181c7-cece-49f5-9f34-264b488ebff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:49.432322 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15181c7-cece-49f5-9f34-264b488ebff2 None admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:49.432604 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15181c7-cece-49f5-9f34-264b488ebff2 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:49.432875 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15181c7-cece-49f5-9f34-264b488ebff2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:49.433557 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15181c7-cece-49f5-9f34-264b488ebff2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:49.434935 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15181c7-cece-49f5-9f34-264b488ebff2 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:49.456227 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 521/1059] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 13 15:16:49 2022] POST /identity/v3/endpoints => generated 327 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:16:49.519784 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed08ad99-cd84-470b-811e-8a272c950828 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:49.519985 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed08ad99-cd84-470b-811e-8a272c950828 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:49.520252 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed08ad99-cd84-470b-811e-8a272c950828 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:49.521799 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 539/1060] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:16:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:16:49.527164 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06db10d4-73d4-46bf-a94d-6a07f81d8bf5 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:49.527471 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06db10d4-73d4-46bf-a94d-6a07f81d8bf5 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:49.527723 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06db10d4-73d4-46bf-a94d-6a07f81d8bf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:49.548081 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-06db10d4-73d4-46bf-a94d-6a07f81d8bf5 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:16:49.550175 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-06db10d4-73d4-46bf-a94d-6a07f81d8bf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:16:49.598165 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:49.633807 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 522/1061] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:16:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 15:16:49.905472 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed08ad99-cd84-470b-811e-8a272c950828 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:49.985029 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:50.013813 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed08ad99-cd84-470b-811e-8a272c950828 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:50.047702 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b373e06-950b-46f1-98c3-f7ae9d394721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:50.048326 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b373e06-950b-46f1-98c3-f7ae9d394721 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:50.049313 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b373e06-950b-46f1-98c3-f7ae9d394721 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:50.049689 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b373e06-950b-46f1-98c3-f7ae9d394721 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:50.060956 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b373e06-950b-46f1-98c3-f7ae9d394721 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 15:16:50.066262 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-0b373e06-950b-46f1-98c3-f7ae9d394721 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 13 15:16:50.066262 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:16:50.066262 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:16:50.066262 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:16:50.066262 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:16:50.066262 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:16:50.066262 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:16:50.066262 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:16:50.066262 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:16:50.066262 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:16:50.066262 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:16:50.066262 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:16:50.066262 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 15:16:50.066262 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 15:16:50.066262 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 15:16:50.066262 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 15:16:50.067370 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 15:16:50.067370 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 15:16:50.067370 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 15:16:50.067370 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 15:16:50.067370 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:16:50.067370 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:16:50.067370 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:16:50.067370 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:16:50.067370 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:16:50.067370 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:16:50.067370 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:16:50.067370 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Sep 13 15:16:50.067370 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:16:50.067370 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:16:50.067370 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:16:50.067370 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:16:50.069158 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:16:50.069158 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:16:50.069158 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:16:50.069158 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:16:50.069158 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 15:16:50.069158 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 15:16:50.069158 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 15:16:50.069158 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 15:16:50.069158 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 15:16:50.069158 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 15:16:50.069158 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 13 15:16:50.069158 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Sep 13 15:16:50.069158 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 540/1062] 10.222.0.27 () {56 vars in 1120 bytes} [Tue Sep 13 15:16:49 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:16:50.074943 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06db10d4-73d4-46bf-a94d-6a07f81d8bf5 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:50.179734 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06db10d4-73d4-46bf-a94d-6a07f81d8bf5 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:50.213711 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d117745-305d-4fc2-8c85-a0f04090351e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:50.213711 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d117745-305d-4fc2-8c85-a0f04090351e None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:50.215407 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d117745-305d-4fc2-8c85-a0f04090351e None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:50.215491 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d117745-305d-4fc2-8c85-a0f04090351e None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:50.216093 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d117745-305d-4fc2-8c85-a0f04090351e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:16:50.216401 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d117745-305d-4fc2-8c85-a0f04090351e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:50.217787 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d117745-305d-4fc2-8c85-a0f04090351e None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:50.226750 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 523/1063] 10.222.0.27 () {56 vars in 1115 bytes} [Tue Sep 13 15:16:50 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:16:50.232266 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b373e06-950b-46f1-98c3-f7ae9d394721 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:50.335079 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b373e06-950b-46f1-98c3-f7ae9d394721 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:50.369973 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b19d3c2-04e0-44b0-a39e-6d03be195a6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:50.370638 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b19d3c2-04e0-44b0-a39e-6d03be195a6c None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:50.370923 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b19d3c2-04e0-44b0-a39e-6d03be195a6c None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:50.371202 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b19d3c2-04e0-44b0-a39e-6d03be195a6c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:50.373438 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:50.385936 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b19d3c2-04e0-44b0-a39e-6d03be195a6c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:50.387409 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b19d3c2-04e0-44b0-a39e-6d03be195a6c None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:50.404040 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-3b19d3c2-04e0-44b0-a39e-6d03be195a6c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 15:16:50.404040 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:16:50.404040 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:16:50.404040 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:16:50.404040 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:16:50.404040 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:16:50.404040 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:16:50.404040 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:16:50.404040 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:16:50.404040 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:16:50.404040 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:16:50.404040 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:16:50.404040 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 15:16:50.404040 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 15:16:50.404040 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 15:16:50.404040 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 15:16:50.405125 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:16:50.405125 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:16:50.405125 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:16:50.405125 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:16:50.405125 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:16:50.405125 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:16:50.405125 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:16:50.405125 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Sep 13 15:16:50.405125 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:16:50.405125 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:16:50.405125 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:16:50.405125 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:16:50.405125 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:16:50.405125 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:16:50.405125 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:16:50.405125 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:16:50.405125 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 15:16:50.406475 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 15:16:50.406475 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 15:16:50.406475 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Sep 13 15:16:50.406965 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 541/1064] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 13 15:16:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:16:50.412029 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d117745-305d-4fc2-8c85-a0f04090351e None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:50.449083 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:50.519273 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f5166e-bf6c-4569-8e04-5ed1843a0cd6 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:50.519589 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f5166e-bf6c-4569-8e04-5ed1843a0cd6 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:50.519875 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f5166e-bf6c-4569-8e04-5ed1843a0cd6 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:50.521556 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 542/1065] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:16:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:16:50.524957 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d117745-305d-4fc2-8c85-a0f04090351e None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:50.527167 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a556e5-e4b9-488b-9bb9-8f947a07c4b3 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:50.527548 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a556e5-e4b9-488b-9bb9-8f947a07c4b3 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:50.527922 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a556e5-e4b9-488b-9bb9-8f947a07c4b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:50.546036 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-39a556e5-e4b9-488b-9bb9-8f947a07c4b3 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:16:50.547233 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-39a556e5-e4b9-488b-9bb9-8f947a07c4b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:16:50.559663 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a79b88-4519-4768-ac20-0579f5088ae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:50.560269 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a79b88-4519-4768-ac20-0579f5088ae7 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:50.560548 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a79b88-4519-4768-ac20-0579f5088ae7 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:50.560819 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a79b88-4519-4768-ac20-0579f5088ae7 None admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:50.561632 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a79b88-4519-4768-ac20-0579f5088ae7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:16:50.561968 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a79b88-4519-4768-ac20-0579f5088ae7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:50.563718 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a79b88-4519-4768-ac20-0579f5088ae7 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:50.576025 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 524/1066] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Sep 13 15:16:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:16:50.582208 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a79b88-4519-4768-ac20-0579f5088ae7 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:50.633852 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 543/1067] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:16:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 15:16:50.677322 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:50.685031 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a79b88-4519-4768-ac20-0579f5088ae7 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:50.728825 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a508d9d-1072-462e-8231-5926fa679468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:50.729469 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a508d9d-1072-462e-8231-5926fa679468 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:50.729781 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a508d9d-1072-462e-8231-5926fa679468 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:50.730062 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a508d9d-1072-462e-8231-5926fa679468 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:50.737421 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a508d9d-1072-462e-8231-5926fa679468 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:50.738889 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a508d9d-1072-462e-8231-5926fa679468 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:50.750652 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-8a508d9d-1072-462e-8231-5926fa679468 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 13 15:16:50.750652 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:16:50.750652 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:16:50.750652 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:16:50.750652 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:16:50.750652 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:16:50.750652 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:16:50.750652 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:16:50.750652 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:16:50.750652 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:16:50.750652 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:16:50.750652 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:16:50.750652 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 15:16:50.750652 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 15:16:50.750652 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 15:16:50.750652 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 15:16:50.752118 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:16:50.752118 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:16:50.752118 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 15:16:50.752118 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 15:16:50.752118 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 15:16:50.752118 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 15:16:50.752118 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:16:50.752118 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:16:50.752118 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:16:50.752118 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:16:50.752118 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:16:50.752118 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Sep 13 15:16:50.752118 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:16:50.752118 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:16:50.752118 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:16:50.752118 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:16:50.752118 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:16:50.752118 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:16:50.753141 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:16:50.753141 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:16:50.753141 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 15:16:50.753141 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 15:16:50.753141 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 15:16:50.753141 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 15:16:50.753141 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 15:16:50.753141 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 15:16:50.753141 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 13 15:16:50.753141 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Sep 13 15:16:50.753141 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 525/1068] 10.222.0.27 () {56 vars in 1093 bytes} [Tue Sep 13 15:16:50 2022] GET /identity/v3/users/nova => generated 82 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 15:16:50.758155 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a556e5-e4b9-488b-9bb9-8f947a07c4b3 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:50.859987 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a556e5-e4b9-488b-9bb9-8f947a07c4b3 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:50.877180 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:50.895355 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a508d9d-1072-462e-8231-5926fa679468 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:50.897520 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899848a8-f04a-47cb-9a9d-fe6960df0596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:50.898462 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899848a8-f04a-47cb-9a9d-fe6960df0596 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:50.898746 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899848a8-f04a-47cb-9a9d-fe6960df0596 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:50.899929 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899848a8-f04a-47cb-9a9d-fe6960df0596 None admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:50.900675 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899848a8-f04a-47cb-9a9d-fe6960df0596 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:16:50.900987 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899848a8-f04a-47cb-9a9d-fe6960df0596 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:50.902443 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899848a8-f04a-47cb-9a9d-fe6960df0596 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:50.930643 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 544/1069] 10.222.0.27 () {56 vars in 1133 bytes} [Tue Sep 13 15:16:50 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:16:50.931910 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899848a8-f04a-47cb-9a9d-fe6960df0596 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:51.016248 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a508d9d-1072-462e-8231-5926fa679468 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:51.044894 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899848a8-f04a-47cb-9a9d-fe6960df0596 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:51.054980 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9138fa-f48b-43c9-a305-5de9d2693c4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:51.055917 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9138fa-f48b-43c9-a305-5de9d2693c4e None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:51.056188 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9138fa-f48b-43c9-a305-5de9d2693c4e None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:51.056497 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9138fa-f48b-43c9-a305-5de9d2693c4e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:51.068368 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9138fa-f48b-43c9-a305-5de9d2693c4e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 15:16:51.073202 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-4c9138fa-f48b-43c9-a305-5de9d2693c4e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 15:16:51.073202 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:16:51.073202 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:16:51.073202 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:16:51.073202 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:16:51.073202 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:16:51.073202 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:16:51.073202 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:16:51.073202 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:16:51.073202 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:16:51.073202 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:16:51.073202 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:16:51.073202 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 15:16:51.073202 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 15:16:51.073202 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 15:16:51.073202 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 15:16:51.074167 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 15:16:51.074167 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 15:16:51.074167 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 15:16:51.074167 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 15:16:51.074167 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:16:51.074167 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:16:51.074167 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:16:51.074167 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:16:51.074167 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:16:51.074167 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:16:51.074167 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:16:51.074167 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Sep 13 15:16:51.074167 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:16:51.074167 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:16:51.074167 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:16:51.074167 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:16:51.075008 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:16:51.075008 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:16:51.075008 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:16:51.075008 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:16:51.075008 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 15:16:51.075008 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 15:16:51.075008 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 15:16:51.075008 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 15:16:51.075008 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 15:16:51.075008 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 15:16:51.075008 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 15:16:51.075008 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Sep 13 15:16:51.075008 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 526/1070] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Sep 13 15:16:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 15:16:51.080752 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9138fa-f48b-43c9-a305-5de9d2693c4e None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:51.088147 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41c6f9c-3437-469d-a2e6-a194fccc209a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:51.088791 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41c6f9c-3437-469d-a2e6-a194fccc209a None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:51.089074 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41c6f9c-3437-469d-a2e6-a194fccc209a None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:51.089793 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41c6f9c-3437-469d-a2e6-a194fccc209a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:51.096540 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:51.101131 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41c6f9c-3437-469d-a2e6-a194fccc209a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:51.102715 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41c6f9c-3437-469d-a2e6-a194fccc209a None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:51.118208 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-d41c6f9c-3437-469d-a2e6-a194fccc209a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 15:16:51.118208 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:16:51.118208 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:16:51.118208 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:16:51.118208 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:16:51.118208 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:16:51.118208 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:16:51.118208 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:16:51.118208 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:16:51.118208 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:16:51.118208 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:16:51.118208 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:16:51.118208 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 15:16:51.118208 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 15:16:51.118208 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 15:16:51.118208 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 15:16:51.119260 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:16:51.119260 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:16:51.119260 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:16:51.119260 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:16:51.119260 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:16:51.119260 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:16:51.119260 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:16:51.119260 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Sep 13 15:16:51.119260 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:16:51.119260 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:16:51.119260 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:16:51.119260 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:16:51.119260 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:16:51.119260 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:16:51.119260 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:16:51.119260 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:16:51.119260 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 15:16:51.120171 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 15:16:51.120171 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 15:16:51.120171 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Sep 13 15:16:51.120171 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 545/1071] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 13 15:16:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:16:51.124830 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41c6f9c-3437-469d-a2e6-a194fccc209a None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:51.154402 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:51.193583 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9138fa-f48b-43c9-a305-5de9d2693c4e None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:51.229358 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fcebad-4c82-418b-b659-eca5c538bf1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:51.229993 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fcebad-4c82-418b-b659-eca5c538bf1f None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:51.230274 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fcebad-4c82-418b-b659-eca5c538bf1f None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:51.230546 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fcebad-4c82-418b-b659-eca5c538bf1f None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:51.231201 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fcebad-4c82-418b-b659-eca5c538bf1f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:16:51.231505 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fcebad-4c82-418b-b659-eca5c538bf1f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:51.232855 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fcebad-4c82-418b-b659-eca5c538bf1f None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:51.233854 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41c6f9c-3437-469d-a2e6-a194fccc209a None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:51.242593 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 527/1072] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Sep 13 15:16:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 15:16:51.248219 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fcebad-4c82-418b-b659-eca5c538bf1f None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:51.272424 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ef03cf-3ca4-4c6c-a2ec-20244727e77c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:51.272960 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ef03cf-3ca4-4c6c-a2ec-20244727e77c None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:51.273242 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ef03cf-3ca4-4c6c-a2ec-20244727e77c None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:51.273517 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ef03cf-3ca4-4c6c-a2ec-20244727e77c None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:51.274184 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ef03cf-3ca4-4c6c-a2ec-20244727e77c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:16:51.274495 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ef03cf-3ca4-4c6c-a2ec-20244727e77c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:51.275869 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ef03cf-3ca4-4c6c-a2ec-20244727e77c None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:51.288645 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 546/1073] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Sep 13 15:16:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 15:16:51.294301 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ef03cf-3ca4-4c6c-a2ec-20244727e77c None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:51.328587 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:51.355237 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fcebad-4c82-418b-b659-eca5c538bf1f None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:51.386857 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:51.395427 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa54906-767c-4c5b-ba10-a3668891f63b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:51.396126 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa54906-767c-4c5b-ba10-a3668891f63b None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:51.396411 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa54906-767c-4c5b-ba10-a3668891f63b None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:51.396710 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa54906-767c-4c5b-ba10-a3668891f63b None admin] PATH_INFO: `/v3/users/b96fb880493a42db9193c0fb05c7eb9f` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:51.397885 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa54906-767c-4c5b-ba10-a3668891f63b None admin] RBAC: Authorizing `identity:get_user(user_id=b96fb880493a42db9193c0fb05c7eb9f)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:51.399323 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa54906-767c-4c5b-ba10-a3668891f63b None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:51.400913 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 528/1074] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Sep 13 15:16:51 2022] GET /identity/v3/users/b96fb880493a42db9193c0fb05c7eb9f => generated 285 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 15:16:51.404147 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ef03cf-3ca4-4c6c-a2ec-20244727e77c None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:51.406478 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa54906-767c-4c5b-ba10-a3668891f63b None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:51.444257 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db6504f-6c48-4402-93f8-b4f5a606d552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:51.444899 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db6504f-6c48-4402-93f8-b4f5a606d552 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:51.445183 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db6504f-6c48-4402-93f8-b4f5a606d552 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:51.445457 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db6504f-6c48-4402-93f8-b4f5a606d552 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:51.452584 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db6504f-6c48-4402-93f8-b4f5a606d552 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:51.454064 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db6504f-6c48-4402-93f8-b4f5a606d552 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:51.466034 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-2db6504f-6c48-4402-93f8-b4f5a606d552 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 15:16:51.466034 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:16:51.466034 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:16:51.466034 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:16:51.466034 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:16:51.466034 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:16:51.466034 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:16:51.466034 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:16:51.466034 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:16:51.466034 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:16:51.466034 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:16:51.466034 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:16:51.466034 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 15:16:51.466034 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 15:16:51.466034 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 15:16:51.466997 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 15:16:51.466997 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:16:51.466997 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:16:51.466997 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:16:51.466997 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:16:51.466997 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:16:51.466997 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:16:51.466997 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:16:51.466997 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Sep 13 15:16:51.466997 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:16:51.466997 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:16:51.466997 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:16:51.466997 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:16:51.466997 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:16:51.466997 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:16:51.466997 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:16:51.466997 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:16:51.467909 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 15:16:51.467909 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 15:16:51.467909 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 15:16:51.467909 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 15:16:51.467909 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 15:16:51.467909 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 15:16:51.467909 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 15:16:51.467909 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Sep 13 15:16:51.467909 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 547/1075] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Sep 13 15:16:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:16:51.472938 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db6504f-6c48-4402-93f8-b4f5a606d552 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:51.513349 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa54906-767c-4c5b-ba10-a3668891f63b None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:51.549130 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5af2ec-ea31-4db2-98ae-abbf294f930b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:51.549936 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5af2ec-ea31-4db2-98ae-abbf294f930b None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:51.550073 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5af2ec-ea31-4db2-98ae-abbf294f930b None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:51.550266 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5af2ec-ea31-4db2-98ae-abbf294f930b None admin] PATH_INFO: `/v3/projects/133e15d053124ceeb3bdf8a5c5e2b4fd` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:51.551346 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5af2ec-ea31-4db2-98ae-abbf294f930b None admin] RBAC: Authorizing `identity:get_project(project_id=133e15d053124ceeb3bdf8a5c5e2b4fd)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:51.552788 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5af2ec-ea31-4db2-98ae-abbf294f930b None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:51.554780 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 529/1076] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Sep 13 15:16:51 2022] GET /identity/v3/projects/133e15d053124ceeb3bdf8a5c5e2b4fd => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 15:16:51.560720 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5af2ec-ea31-4db2-98ae-abbf294f930b None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:51.578774 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:51.591277 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db6504f-6c48-4402-93f8-b4f5a606d552 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:51.628446 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7c1ed7-8695-4b1f-922b-e1421558d9a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:51.629180 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7c1ed7-8695-4b1f-922b-e1421558d9a7 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:51.629467 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7c1ed7-8695-4b1f-922b-e1421558d9a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:51.629765 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7c1ed7-8695-4b1f-922b-e1421558d9a7 None admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:51.630452 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7c1ed7-8695-4b1f-922b-e1421558d9a7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:16:51.630759 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7c1ed7-8695-4b1f-922b-e1421558d9a7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:51.632191 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7c1ed7-8695-4b1f-922b-e1421558d9a7 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:51.645432 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 548/1077] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Sep 13 15:16:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 15:16:51.651098 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7c1ed7-8695-4b1f-922b-e1421558d9a7 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:51.660633 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:51.676388 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5af2ec-ea31-4db2-98ae-abbf294f930b None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:51.711342 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1068c0d6-ec37-4a4d-909f-c1e92632fd37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:51.712002 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1068c0d6-ec37-4a4d-909f-c1e92632fd37 None admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:51.712280 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1068c0d6-ec37-4a4d-909f-c1e92632fd37 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:51.712555 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1068c0d6-ec37-4a4d-909f-c1e92632fd37 None admin] PATH_INFO: `/v3/projects/133e15d053124ceeb3bdf8a5c5e2b4fd/users/b96fb880493a42db9193c0fb05c7eb9f/roles/f34412ad29f1478cba775b033129f71f` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:51.714618 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1068c0d6-ec37-4a4d-909f-c1e92632fd37 None admin] RBAC: Authorizing `identity:create_grant(project_id=133e15d053124ceeb3bdf8a5c5e2b4fd, user_id=b96fb880493a42db9193c0fb05c7eb9f, role_id=f34412ad29f1478cba775b033129f71f)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:51.716043 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1068c0d6-ec37-4a4d-909f-c1e92632fd37 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:51.733327 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 530/1078] 10.222.0.27 () {58 vars in 1439 bytes} [Tue Sep 13 15:16:51 2022] PUT /identity/v3/projects/133e15d053124ceeb3bdf8a5c5e2b4fd/users/b96fb880493a42db9193c0fb05c7eb9f/roles/f34412ad29f1478cba775b033129f71f => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 15:16:51.743162 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93930b18-1e24-430e-9da2-3389e0eff9b7 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:51.743162 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93930b18-1e24-430e-9da2-3389e0eff9b7 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:51.743162 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93930b18-1e24-430e-9da2-3389e0eff9b7 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:51.743162 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 531/1079] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:16:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:16:51.743522 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597b6100-1264-45db-87b6-d9c513063c9c None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:51.743696 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597b6100-1264-45db-87b6-d9c513063c9c None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:51.749729 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597b6100-1264-45db-87b6-d9c513063c9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:51.760054 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7c1ed7-8695-4b1f-922b-e1421558d9a7 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:51.763888 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-597b6100-1264-45db-87b6-d9c513063c9c None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:16:51.765140 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-597b6100-1264-45db-87b6-d9c513063c9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:16:51.801152 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafcccb3-3a7f-4363-acc7-2952272bacdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:51.801769 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafcccb3-3a7f-4363-acc7-2952272bacdd None admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:51.802051 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafcccb3-3a7f-4363-acc7-2952272bacdd None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:51.802327 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafcccb3-3a7f-4363-acc7-2952272bacdd None admin] PATH_INFO: `/v3/projects/3d6e00339cfa47d2a6fa8724c587035f/users/62aad71c6c1a4469805762bba330bf0e/roles/d2befaf77d3b4b15850920535a772db0` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:51.804501 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafcccb3-3a7f-4363-acc7-2952272bacdd None admin] RBAC: Authorizing `identity:create_grant(project_id=3d6e00339cfa47d2a6fa8724c587035f, user_id=62aad71c6c1a4469805762bba330bf0e, role_id=d2befaf77d3b4b15850920535a772db0)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:51.806015 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafcccb3-3a7f-4363-acc7-2952272bacdd None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:51.833732 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 549/1080] 10.222.0.27 () {58 vars in 1439 bytes} [Tue Sep 13 15:16:51 2022] PUT /identity/v3/projects/3d6e00339cfa47d2a6fa8724c587035f/users/62aad71c6c1a4469805762bba330bf0e/roles/d2befaf77d3b4b15850920535a772db0 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 15:16:51.842633 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 532/1081] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:16:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 15:16:52.117873 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafcccb3-3a7f-4363-acc7-2952272bacdd None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:52.184122 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:52.221656 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafcccb3-3a7f-4363-acc7-2952272bacdd None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:52.257352 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6d8f4d-c15c-492a-a164-17ffb1e7f80f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:52.258036 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6d8f4d-c15c-492a-a164-17ffb1e7f80f None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:52.258253 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6d8f4d-c15c-492a-a164-17ffb1e7f80f None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:52.258522 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6d8f4d-c15c-492a-a164-17ffb1e7f80f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:52.326875 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6d8f4d-c15c-492a-a164-17ffb1e7f80f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:52.328318 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6d8f4d-c15c-492a-a164-17ffb1e7f80f None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:52.392095 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:52.428756 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 550/1082] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Sep 13 15:16:52 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 15:16:52.434527 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597b6100-1264-45db-87b6-d9c513063c9c None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:52.436721 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:52.539003 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597b6100-1264-45db-87b6-d9c513063c9c None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:52.575265 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889996df-a1a7-4570-af6b-12ae4a6437da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:52.576041 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889996df-a1a7-4570-af6b-12ae4a6437da None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:52.576422 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889996df-a1a7-4570-af6b-12ae4a6437da None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:52.576798 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889996df-a1a7-4570-af6b-12ae4a6437da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:52.588051 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889996df-a1a7-4570-af6b-12ae4a6437da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:52.589599 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889996df-a1a7-4570-af6b-12ae4a6437da None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:52.604674 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-889996df-a1a7-4570-af6b-12ae4a6437da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 15:16:52.604674 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:16:52.604674 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:16:52.604674 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:16:52.604674 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:16:52.604674 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:16:52.604674 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:16:52.604674 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:16:52.604674 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:16:52.604674 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:16:52.604674 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:16:52.604674 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:16:52.604674 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 15:16:52.604674 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 15:16:52.604674 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 15:16:52.604674 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 15:16:52.605923 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:16:52.605923 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:16:52.605923 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:16:52.605923 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:16:52.605923 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:16:52.605923 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:16:52.605923 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:16:52.605923 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Sep 13 15:16:52.605923 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:16:52.605923 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:16:52.605923 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:16:52.605923 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:16:52.605923 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:16:52.605923 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:16:52.605923 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:16:52.605923 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:16:52.605923 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 15:16:52.607155 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 15:16:52.607155 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 15:16:52.607155 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Sep 13 15:16:52.608268 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 533/1083] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 13 15:16:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:16:52.614533 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6d8f4d-c15c-492a-a164-17ffb1e7f80f None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:52.722246 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6d8f4d-c15c-492a-a164-17ffb1e7f80f None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:52.760186 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469e487a-c5f2-4dfa-8042-b894158af141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:52.761049 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469e487a-c5f2-4dfa-8042-b894158af141 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:52.761517 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469e487a-c5f2-4dfa-8042-b894158af141 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:52.762032 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469e487a-c5f2-4dfa-8042-b894158af141 None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:52.762830 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469e487a-c5f2-4dfa-8042-b894158af141 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:16:52.763327 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469e487a-c5f2-4dfa-8042-b894158af141 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:52.764838 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469e487a-c5f2-4dfa-8042-b894158af141 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:52.777429 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 551/1084] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Sep 13 15:16:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:16:53.913391 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7ef22d-4c6a-456d-9547-aa0520dac94b None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:53.913990 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7ef22d-4c6a-456d-9547-aa0520dac94b None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:53.913990 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7ef22d-4c6a-456d-9547-aa0520dac94b None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:53.915517 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 534/1085] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:16:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:16:53.921217 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a99be98-e0fc-45e5-a42d-19e2d8518f93 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:53.921754 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a99be98-e0fc-45e5-a42d-19e2d8518f93 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:53.921921 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a99be98-e0fc-45e5-a42d-19e2d8518f93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:53.940491 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-8a99be98-e0fc-45e5-a42d-19e2d8518f93 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:16:53.941676 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-8a99be98-e0fc-45e5-a42d-19e2d8518f93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:16:53.962298 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:54.008056 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 552/1086] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:16:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 15:16:54.015831 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b809eb87-a81c-45cf-ae98-3645fb974f93 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:54.016144 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b809eb87-a81c-45cf-ae98-3645fb974f93 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:54.016421 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b809eb87-a81c-45cf-ae98-3645fb974f93 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:54.018470 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 535/1087] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:16:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:16:54.023596 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb8aa17-dafe-4acc-8266-21ff49cf48b3 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:54.023889 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb8aa17-dafe-4acc-8266-21ff49cf48b3 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:54.024171 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb8aa17-dafe-4acc-8266-21ff49cf48b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:54.042882 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-ebb8aa17-dafe-4acc-8266-21ff49cf48b3 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:16:54.044071 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-ebb8aa17-dafe-4acc-8266-21ff49cf48b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:16:54.108489 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 553/1088] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:16:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 15:16:54.274582 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b809eb87-a81c-45cf-ae98-3645fb974f93 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:54.331813 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:54.378135 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b809eb87-a81c-45cf-ae98-3645fb974f93 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:54.380767 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb8aa17-dafe-4acc-8266-21ff49cf48b3 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:54.414887 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7ef454-1fe3-45ff-b01a-7c5784061042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:54.415516 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7ef454-1fe3-45ff-b01a-7c5784061042 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:54.415798 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7ef454-1fe3-45ff-b01a-7c5784061042 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:54.416073 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7ef454-1fe3-45ff-b01a-7c5784061042 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:54.428119 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7ef454-1fe3-45ff-b01a-7c5784061042 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 15:16:54.432945 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-1d7ef454-1fe3-45ff-b01a-7c5784061042 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 15:16:54.432945 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:16:54.432945 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:16:54.432945 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:16:54.432945 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:16:54.432945 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:16:54.432945 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:16:54.432945 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:16:54.432945 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:16:54.432945 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:16:54.432945 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:16:54.432945 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:16:54.432945 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 15:16:54.432945 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 15:16:54.432945 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 15:16:54.432945 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 15:16:54.433952 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 15:16:54.433952 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 15:16:54.433952 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 15:16:54.433952 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 15:16:54.433952 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:16:54.433952 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:16:54.433952 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:16:54.433952 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:16:54.433952 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:16:54.433952 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:16:54.433952 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:16:54.433952 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Sep 13 15:16:54.433952 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:16:54.433952 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:16:54.433952 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:16:54.433952 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:16:54.435173 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:16:54.435173 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:16:54.435173 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:16:54.435173 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:16:54.435173 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 15:16:54.435173 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 15:16:54.435173 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 15:16:54.435173 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 15:16:54.435173 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 15:16:54.435173 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 15:16:54.435173 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 15:16:54.435173 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Sep 13 15:16:54.435173 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 536/1089] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Sep 13 15:16:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:16:54.440722 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7ef454-1fe3-45ff-b01a-7c5784061042 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:54.467831 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:54.483946 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb8aa17-dafe-4acc-8266-21ff49cf48b3 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:54.518100 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3874b6f5-9806-4ab8-81d4-e32415a3ee83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:54.518744 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3874b6f5-9806-4ab8-81d4-e32415a3ee83 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:54.519044 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3874b6f5-9806-4ab8-81d4-e32415a3ee83 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:54.519318 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3874b6f5-9806-4ab8-81d4-e32415a3ee83 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:54.529751 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3874b6f5-9806-4ab8-81d4-e32415a3ee83 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 15:16:54.535089 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-3874b6f5-9806-4ab8-81d4-e32415a3ee83 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 13 15:16:54.535089 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:16:54.535089 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:16:54.535089 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:16:54.535089 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:16:54.535089 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:16:54.535089 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:16:54.535089 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:16:54.535089 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:16:54.535089 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:16:54.535089 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:16:54.535089 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:16:54.535089 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 15:16:54.535089 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 15:16:54.535089 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 15:16:54.535089 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 15:16:54.536268 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 15:16:54.536268 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 15:16:54.536268 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 15:16:54.536268 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 15:16:54.536268 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:16:54.536268 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:16:54.536268 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:16:54.536268 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:16:54.536268 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:16:54.536268 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:16:54.536268 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:16:54.536268 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Sep 13 15:16:54.536268 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:16:54.536268 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:16:54.536268 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:16:54.536268 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:16:54.537520 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:16:54.537520 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:16:54.537520 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:16:54.537520 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:16:54.537520 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 15:16:54.537520 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 15:16:54.537520 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 15:16:54.537520 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 15:16:54.537520 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 15:16:54.537520 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 15:16:54.537520 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 13 15:16:54.537520 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Sep 13 15:16:54.537520 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 554/1090] 10.222.0.27 () {56 vars in 1120 bytes} [Tue Sep 13 15:16:54 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 15:16:54.542043 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3874b6f5-9806-4ab8-81d4-e32415a3ee83 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:54.544970 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7ef454-1fe3-45ff-b01a-7c5784061042 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:54.559320 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:54.581125 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd78dec-55de-4894-8ea2-09e6092ff6d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:54.581755 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd78dec-55de-4894-8ea2-09e6092ff6d6 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:54.582043 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd78dec-55de-4894-8ea2-09e6092ff6d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:54.582326 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd78dec-55de-4894-8ea2-09e6092ff6d6 None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:54.582987 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd78dec-55de-4894-8ea2-09e6092ff6d6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:16:54.583295 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd78dec-55de-4894-8ea2-09e6092ff6d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:54.584661 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd78dec-55de-4894-8ea2-09e6092ff6d6 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:54.593060 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 537/1091] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Sep 13 15:16:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 15:16:54.599341 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd78dec-55de-4894-8ea2-09e6092ff6d6 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:54.647177 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3874b6f5-9806-4ab8-81d4-e32415a3ee83 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:54.680674 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db84aaab-7bf5-49f8-b1fa-09f58a1bfd27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:54.681282 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db84aaab-7bf5-49f8-b1fa-09f58a1bfd27 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:54.681565 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db84aaab-7bf5-49f8-b1fa-09f58a1bfd27 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:54.681874 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db84aaab-7bf5-49f8-b1fa-09f58a1bfd27 None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:54.682533 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db84aaab-7bf5-49f8-b1fa-09f58a1bfd27 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:16:54.682839 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db84aaab-7bf5-49f8-b1fa-09f58a1bfd27 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:54.684216 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db84aaab-7bf5-49f8-b1fa-09f58a1bfd27 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:54.693017 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 555/1092] 10.222.0.27 () {56 vars in 1115 bytes} [Tue Sep 13 15:16:54 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 15:16:54.697520 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd78dec-55de-4894-8ea2-09e6092ff6d6 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:54.698684 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db84aaab-7bf5-49f8-b1fa-09f58a1bfd27 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:54.709926 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:54.735570 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6d9d97-31f0-4f0f-9d18-e9bffef755bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:54.736213 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6d9d97-31f0-4f0f-9d18-e9bffef755bb None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:54.736495 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6d9d97-31f0-4f0f-9d18-e9bffef755bb None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:54.736770 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6d9d97-31f0-4f0f-9d18-e9bffef755bb None admin] PATH_INFO: `/v3/users/b96fb880493a42db9193c0fb05c7eb9f` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:54.737932 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6d9d97-31f0-4f0f-9d18-e9bffef755bb None admin] RBAC: Authorizing `identity:get_user(user_id=b96fb880493a42db9193c0fb05c7eb9f)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:54.739428 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6d9d97-31f0-4f0f-9d18-e9bffef755bb None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:54.741205 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 538/1093] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Sep 13 15:16:54 2022] GET /identity/v3/users/b96fb880493a42db9193c0fb05c7eb9f => generated 285 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 15:16:54.746705 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6d9d97-31f0-4f0f-9d18-e9bffef755bb None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:54.794709 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:54.799007 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db84aaab-7bf5-49f8-b1fa-09f58a1bfd27 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:54.832606 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23faeea8-0b42-4f1a-92a8-b0cf7951a268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:54.833232 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23faeea8-0b42-4f1a-92a8-b0cf7951a268 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:54.833515 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23faeea8-0b42-4f1a-92a8-b0cf7951a268 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:54.833823 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23faeea8-0b42-4f1a-92a8-b0cf7951a268 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:54.844112 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23faeea8-0b42-4f1a-92a8-b0cf7951a268 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:54.846161 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23faeea8-0b42-4f1a-92a8-b0cf7951a268 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:54.850049 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6d9d97-31f0-4f0f-9d18-e9bffef755bb None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:54.860041 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-23faeea8-0b42-4f1a-92a8-b0cf7951a268 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 15:16:54.860041 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:16:54.860041 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:16:54.860041 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:16:54.860041 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:16:54.860041 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:16:54.860041 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:16:54.860041 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:16:54.860041 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:16:54.860041 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:16:54.860041 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:16:54.860041 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:16:54.860041 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 15:16:54.860041 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 15:16:54.860041 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 15:16:54.860041 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 15:16:54.861317 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:16:54.861317 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:16:54.861317 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:16:54.861317 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:16:54.861317 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:16:54.861317 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:16:54.861317 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:16:54.861317 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Sep 13 15:16:54.861317 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:16:54.861317 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:16:54.861317 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:16:54.861317 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:16:54.861317 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:16:54.861317 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:16:54.861317 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:16:54.861317 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:16:54.861317 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 15:16:54.862273 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 15:16:54.862273 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 15:16:54.862273 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Sep 13 15:16:54.862273 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 556/1094] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 13 15:16:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 15:16:54.867043 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23faeea8-0b42-4f1a-92a8-b0cf7951a268 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:54.884247 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9131fba9-b04e-4ed3-8854-df2a272dad9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:54.884855 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9131fba9-b04e-4ed3-8854-df2a272dad9a None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:54.885131 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9131fba9-b04e-4ed3-8854-df2a272dad9a None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:54.885401 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9131fba9-b04e-4ed3-8854-df2a272dad9a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:54.924912 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:54.953744 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9131fba9-b04e-4ed3-8854-df2a272dad9a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:54.955354 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9131fba9-b04e-4ed3-8854-df2a272dad9a None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:54.966152 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23faeea8-0b42-4f1a-92a8-b0cf7951a268 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:54.998179 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:54.999751 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6bb596-0e7b-43cc-a65c-0fae24659090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:55.000359 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6bb596-0e7b-43cc-a65c-0fae24659090 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:55.000646 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6bb596-0e7b-43cc-a65c-0fae24659090 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:55.000927 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6bb596-0e7b-43cc-a65c-0fae24659090 None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:55.002431 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6bb596-0e7b-43cc-a65c-0fae24659090 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:16:55.002658 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6bb596-0e7b-43cc-a65c-0fae24659090 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:55.004037 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6bb596-0e7b-43cc-a65c-0fae24659090 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:55.016119 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 557/1095] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Sep 13 15:16:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 15:16:55.021839 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6bb596-0e7b-43cc-a65c-0fae24659090 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:55.057997 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 539/1096] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Sep 13 15:16:54 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 15:16:55.063826 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9131fba9-b04e-4ed3-8854-df2a272dad9a None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:55.121066 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6bb596-0e7b-43cc-a65c-0fae24659090 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:55.140123 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:55.155449 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb698ec8-76d3-437a-bb9c-171cf9726ce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:55.156108 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb698ec8-76d3-437a-bb9c-171cf9726ce8 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:55.156385 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb698ec8-76d3-437a-bb9c-171cf9726ce8 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:55.156663 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb698ec8-76d3-437a-bb9c-171cf9726ce8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:55.164128 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9131fba9-b04e-4ed3-8854-df2a272dad9a None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:55.164380 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb698ec8-76d3-437a-bb9c-171cf9726ce8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:55.165845 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb698ec8-76d3-437a-bb9c-171cf9726ce8 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:55.177428 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-bb698ec8-76d3-437a-bb9c-171cf9726ce8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 13 15:16:55.177428 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:16:55.177428 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:16:55.177428 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:16:55.177428 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:16:55.177428 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:16:55.177428 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:16:55.177428 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:16:55.177428 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:16:55.177428 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:16:55.177428 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:16:55.177428 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:16:55.177428 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 15:16:55.177428 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 15:16:55.177428 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 15:16:55.177428 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 15:16:55.178411 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:16:55.178411 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:16:55.178411 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 15:16:55.178411 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 15:16:55.178411 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 15:16:55.178411 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 15:16:55.178411 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:16:55.178411 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:16:55.178411 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:16:55.178411 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:16:55.178411 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:16:55.178411 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Sep 13 15:16:55.178411 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:16:55.178411 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:16:55.178411 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:16:55.178411 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:16:55.178411 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:16:55.178411 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:16:55.179331 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:16:55.179331 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:16:55.179331 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 15:16:55.179331 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 15:16:55.179331 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 15:16:55.179331 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 15:16:55.179331 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 15:16:55.179331 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 15:16:55.179331 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 13 15:16:55.179331 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Sep 13 15:16:55.179331 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 558/1097] 10.222.0.27 () {56 vars in 1093 bytes} [Tue Sep 13 15:16:55 2022] GET /identity/v3/users/nova => generated 82 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:16:55.184158 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb698ec8-76d3-437a-bb9c-171cf9726ce8 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:55.200788 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca427748-ed70-4e40-be10-2e3985a32912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:55.201408 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca427748-ed70-4e40-be10-2e3985a32912 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:55.201687 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca427748-ed70-4e40-be10-2e3985a32912 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:55.201986 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca427748-ed70-4e40-be10-2e3985a32912 None admin] PATH_INFO: `/v3/projects/133e15d053124ceeb3bdf8a5c5e2b4fd` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:55.203341 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca427748-ed70-4e40-be10-2e3985a32912 None admin] RBAC: Authorizing `identity:get_project(project_id=133e15d053124ceeb3bdf8a5c5e2b4fd)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:55.205449 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca427748-ed70-4e40-be10-2e3985a32912 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:55.207110 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 540/1098] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Sep 13 15:16:55 2022] GET /identity/v3/projects/133e15d053124ceeb3bdf8a5c5e2b4fd => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 15:16:55.213032 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca427748-ed70-4e40-be10-2e3985a32912 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:55.227495 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:55.286996 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb698ec8-76d3-437a-bb9c-171cf9726ce8 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:55.310310 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca427748-ed70-4e40-be10-2e3985a32912 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:55.320347 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916f5a3e-c026-4b3f-811a-cbf8a6c3e49e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:55.320945 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916f5a3e-c026-4b3f-811a-cbf8a6c3e49e None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:55.321226 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916f5a3e-c026-4b3f-811a-cbf8a6c3e49e None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:55.321496 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916f5a3e-c026-4b3f-811a-cbf8a6c3e49e None admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:55.322238 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916f5a3e-c026-4b3f-811a-cbf8a6c3e49e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:16:55.322545 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916f5a3e-c026-4b3f-811a-cbf8a6c3e49e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:55.323947 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916f5a3e-c026-4b3f-811a-cbf8a6c3e49e None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:55.340368 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 559/1099] 10.222.0.27 () {56 vars in 1133 bytes} [Tue Sep 13 15:16:55 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 15:16:55.344511 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a25118d-9823-4d79-a62f-d7f50aa357f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:55.345964 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a25118d-9823-4d79-a62f-d7f50aa357f7 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:55.346245 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a25118d-9823-4d79-a62f-d7f50aa357f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:55.346513 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a25118d-9823-4d79-a62f-d7f50aa357f7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:55.347053 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916f5a3e-c026-4b3f-811a-cbf8a6c3e49e None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:55.347234 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a25118d-9823-4d79-a62f-d7f50aa357f7 None admin] RBAC: Adding query filter params (role.id=f34412ad29f1478cba775b033129f71f, scope.project.id=133e15d053124ceeb3bdf8a5c5e2b4fd, user.id=b96fb880493a42db9193c0fb05c7eb9f) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:16:55.347542 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a25118d-9823-4d79-a62f-d7f50aa357f7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:55.348952 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a25118d-9823-4d79-a62f-d7f50aa357f7 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:55.366008 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 541/1100] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Sep 13 15:16:55 2022] GET /identity/v3/role_assignments?user.id=b96fb880493a42db9193c0fb05c7eb9f&scope.project.id=133e15d053124ceeb3bdf8a5c5e2b4fd&role.id=f34412ad29f1478cba775b033129f71f => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 15:16:55.390294 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:55.454746 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916f5a3e-c026-4b3f-811a-cbf8a6c3e49e None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:55.490576 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab0c792-461a-42ec-a4ae-3ceea00f2b84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:55.491194 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab0c792-461a-42ec-a4ae-3ceea00f2b84 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:55.491471 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab0c792-461a-42ec-a4ae-3ceea00f2b84 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:55.491738 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab0c792-461a-42ec-a4ae-3ceea00f2b84 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:55.563361 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab0c792-461a-42ec-a4ae-3ceea00f2b84 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:55.565209 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab0c792-461a-42ec-a4ae-3ceea00f2b84 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:55.603555 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:55.664416 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 560/1101] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Sep 13 15:16:55 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 15:16:55.670158 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a25118d-9823-4d79-a62f-d7f50aa357f7 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:55.747140 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:55.770411 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a25118d-9823-4d79-a62f-d7f50aa357f7 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:55.803076 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c75e909-e2ac-4d10-a4a3-908bff442520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:55.803696 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c75e909-e2ac-4d10-a4a3-908bff442520 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:55.803973 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c75e909-e2ac-4d10-a4a3-908bff442520 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:55.804242 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c75e909-e2ac-4d10-a4a3-908bff442520 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:55.814529 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c75e909-e2ac-4d10-a4a3-908bff442520 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:55.815893 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c75e909-e2ac-4d10-a4a3-908bff442520 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:55.830392 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-0c75e909-e2ac-4d10-a4a3-908bff442520 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 15:16:55.830392 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:16:55.830392 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:16:55.830392 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:16:55.830392 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:16:55.830392 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:16:55.830392 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:16:55.830392 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:16:55.830392 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:16:55.830392 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:16:55.830392 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:16:55.830392 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:16:55.830392 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 15:16:55.830392 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 15:16:55.830392 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 15:16:55.830392 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 15:16:55.831357 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:16:55.831357 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:16:55.831357 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:16:55.831357 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:16:55.831357 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:16:55.831357 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:16:55.831357 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:16:55.831357 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Sep 13 15:16:55.831357 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:16:55.831357 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:16:55.831357 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:16:55.831357 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:16:55.831357 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:16:55.831357 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:16:55.831357 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:16:55.831357 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:16:55.831357 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 15:16:55.832256 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 15:16:55.832256 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 15:16:55.832256 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Sep 13 15:16:55.832256 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 542/1102] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 13 15:16:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:16:55.837137 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab0c792-461a-42ec-a4ae-3ceea00f2b84 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:55.935564 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab0c792-461a-42ec-a4ae-3ceea00f2b84 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:55.970907 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c443c9-662a-47bb-a73e-d064cd657617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:55.971603 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c443c9-662a-47bb-a73e-d064cd657617 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:55.971887 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c443c9-662a-47bb-a73e-d064cd657617 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:55.972160 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c443c9-662a-47bb-a73e-d064cd657617 None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:55.972798 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c443c9-662a-47bb-a73e-d064cd657617 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:16:55.973105 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c443c9-662a-47bb-a73e-d064cd657617 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:55.974604 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c443c9-662a-47bb-a73e-d064cd657617 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:55.980869 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:55.986559 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 561/1103] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Sep 13 15:16:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:16:55.992134 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c75e909-e2ac-4d10-a4a3-908bff442520 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:56.091379 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c75e909-e2ac-4d10-a4a3-908bff442520 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:56.116661 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:56.125260 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb25dbe-65e5-4b3b-9429-9b2bf83620f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:56.125929 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb25dbe-65e5-4b3b-9429-9b2bf83620f6 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:56.126716 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb25dbe-65e5-4b3b-9429-9b2bf83620f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:56.126993 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb25dbe-65e5-4b3b-9429-9b2bf83620f6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:56.133640 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb25dbe-65e5-4b3b-9429-9b2bf83620f6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:56.135120 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb25dbe-65e5-4b3b-9429-9b2bf83620f6 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:56.146950 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-cbb25dbe-65e5-4b3b-9429-9b2bf83620f6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 15:16:56.146950 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:16:56.146950 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:16:56.146950 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:16:56.146950 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:16:56.146950 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:16:56.146950 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:16:56.146950 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:16:56.146950 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:16:56.146950 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:16:56.146950 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:16:56.146950 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:16:56.146950 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 15:16:56.146950 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 15:16:56.146950 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 15:16:56.148021 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 15:16:56.148021 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:16:56.148021 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:16:56.148021 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:16:56.148021 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:16:56.148021 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:16:56.148021 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:16:56.148021 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:16:56.148021 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Sep 13 15:16:56.148021 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:16:56.148021 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:16:56.148021 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:16:56.148021 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:16:56.148021 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:16:56.148021 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:16:56.148021 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:16:56.148021 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:16:56.149146 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 15:16:56.149146 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 15:16:56.149146 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 15:16:56.149146 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 15:16:56.149146 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 15:16:56.149146 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 15:16:56.149146 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 15:16:56.149146 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Sep 13 15:16:56.149146 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 543/1104] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Sep 13 15:16:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 15:16:56.155720 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c443c9-662a-47bb-a73e-d064cd657617 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:56.257493 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c443c9-662a-47bb-a73e-d064cd657617 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:56.295450 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e782d748-5caf-4785-b2b5-b1a02e980fe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:56.296188 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e782d748-5caf-4785-b2b5-b1a02e980fe9 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:56.296546 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e782d748-5caf-4785-b2b5-b1a02e980fe9 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:56.296891 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e782d748-5caf-4785-b2b5-b1a02e980fe9 None admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:56.297664 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e782d748-5caf-4785-b2b5-b1a02e980fe9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:16:56.298175 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e782d748-5caf-4785-b2b5-b1a02e980fe9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:56.299623 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e782d748-5caf-4785-b2b5-b1a02e980fe9 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:56.311516 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 562/1105] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Sep 13 15:16:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:16:56.318742 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb25dbe-65e5-4b3b-9429-9b2bf83620f6 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:56.417876 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb25dbe-65e5-4b3b-9429-9b2bf83620f6 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:56.451052 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1b05a7-a4a2-43cb-a9da-f445fbc6c092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:56.451649 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1b05a7-a4a2-43cb-a9da-f445fbc6c092 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:56.451931 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1b05a7-a4a2-43cb-a9da-f445fbc6c092 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:56.452206 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1b05a7-a4a2-43cb-a9da-f445fbc6c092 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:56.452919 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1b05a7-a4a2-43cb-a9da-f445fbc6c092 None admin] RBAC: Adding query filter params (role.id=d2befaf77d3b4b15850920535a772db0, scope.project.id=3d6e00339cfa47d2a6fa8724c587035f, user.id=62aad71c6c1a4469805762bba330bf0e) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:16:56.453229 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1b05a7-a4a2-43cb-a9da-f445fbc6c092 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:56.454926 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1b05a7-a4a2-43cb-a9da-f445fbc6c092 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:56.460487 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 544/1106] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Sep 13 15:16:56 2022] GET /identity/v3/role_assignments?user.id=62aad71c6c1a4469805762bba330bf0e&scope.project.id=3d6e00339cfa47d2a6fa8724c587035f&role.id=d2befaf77d3b4b15850920535a772db0 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:16:57.537057 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca27311-593b-4b8a-a088-7fe49b69747b None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:57.537593 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca27311-593b-4b8a-a088-7fe49b69747b None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:57.537593 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca27311-593b-4b8a-a088-7fe49b69747b None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:57.538975 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 563/1107] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:16:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:16:57.544090 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b17fb8-582a-4973-8e4b-8c6ee2012f98 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:57.544504 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b17fb8-582a-4973-8e4b-8c6ee2012f98 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:57.544652 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b17fb8-582a-4973-8e4b-8c6ee2012f98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:57.562332 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-e1b17fb8-582a-4973-8e4b-8c6ee2012f98 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:16:57.564137 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-e1b17fb8-582a-4973-8e4b-8c6ee2012f98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:16:57.615442 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:57.634450 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 545/1108] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:16:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 15:16:57.902368 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca27311-593b-4b8a-a088-7fe49b69747b None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:57.960664 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:16:58.001814 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca27311-593b-4b8a-a088-7fe49b69747b None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:58.035298 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643afee3-8821-4568-9154-a749e23cc260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:58.035909 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643afee3-8821-4568-9154-a749e23cc260 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:58.036190 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643afee3-8821-4568-9154-a749e23cc260 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:58.036464 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643afee3-8821-4568-9154-a749e23cc260 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:58.037566 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643afee3-8821-4568-9154-a749e23cc260 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:58.039030 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643afee3-8821-4568-9154-a749e23cc260 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:58.040565 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 564/1109] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 13 15:16:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:16:58.046258 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b17fb8-582a-4973-8e4b-8c6ee2012f98 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:16:58.143188 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b17fb8-582a-4973-8e4b-8c6ee2012f98 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:16:58.176737 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1836ce5-c87b-44f9-a05d-f5396f41aaf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:16:58.177279 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1836ce5-c87b-44f9-a05d-f5396f41aaf0 None admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:16:58.177565 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1836ce5-c87b-44f9-a05d-f5396f41aaf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:16:58.177866 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1836ce5-c87b-44f9-a05d-f5396f41aaf0 None admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:16:58.178528 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1836ce5-c87b-44f9-a05d-f5396f41aaf0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:16:58.179945 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1836ce5-c87b-44f9-a05d-f5396f41aaf0 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:16:58.200384 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 546/1110] 10.222.0.27 () {60 vars in 1132 bytes} [Tue Sep 13 15:16:58 2022] POST /identity/v3/users => generated 286 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:17:00.370398 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a26db3e-5b06-4344-aad0-5c50715ca8c9 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:17:00.370967 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a26db3e-5b06-4344-aad0-5c50715ca8c9 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:17:00.370967 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a26db3e-5b06-4344-aad0-5c50715ca8c9 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:17:00.372270 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 565/1111] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:17:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:17:00.378163 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6534490-e960-4a50-bdc8-082361fce9b3 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:17:00.378695 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6534490-e960-4a50-bdc8-082361fce9b3 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:17:00.378695 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6534490-e960-4a50-bdc8-082361fce9b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:17:00.401616 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-f6534490-e960-4a50-bdc8-082361fce9b3 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:17:00.403301 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-f6534490-e960-4a50-bdc8-082361fce9b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:17:00.432951 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:17:00.471173 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 547/1112] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:17:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 15:17:00.742637 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a26db3e-5b06-4344-aad0-5c50715ca8c9 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:17:00.840500 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a26db3e-5b06-4344-aad0-5c50715ca8c9 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:17:00.866054 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:17:00.874582 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9e5ab7-0d2a-4748-be1b-27d43ed73d46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:17:00.875196 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9e5ab7-0d2a-4748-be1b-27d43ed73d46 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:17:00.875475 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9e5ab7-0d2a-4748-be1b-27d43ed73d46 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:17:00.875799 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9e5ab7-0d2a-4748-be1b-27d43ed73d46 None admin] PATH_INFO: `/v3/roles/5d9c0543f8e04065bb3d8bcd11156c1d` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:17:00.877491 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9e5ab7-0d2a-4748-be1b-27d43ed73d46 None admin] RBAC: Authorizing `identity:get_role(role_id=5d9c0543f8e04065bb3d8bcd11156c1d)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:17:00.878880 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9e5ab7-0d2a-4748-be1b-27d43ed73d46 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:17:00.880185 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 566/1113] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Sep 13 15:17:00 2022] GET /identity/v3/roles/5d9c0543f8e04065bb3d8bcd11156c1d => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:17:00.886009 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6534490-e960-4a50-bdc8-082361fce9b3 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:17:00.980819 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6534490-e960-4a50-bdc8-082361fce9b3 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:17:01.012791 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dc6c9e-3138-44db-8afc-6b440c2f2e0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:17:01.013401 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dc6c9e-3138-44db-8afc-6b440c2f2e0a None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:17:01.013682 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dc6c9e-3138-44db-8afc-6b440c2f2e0a None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:17:01.013979 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dc6c9e-3138-44db-8afc-6b440c2f2e0a None admin] PATH_INFO: `/v3/users/26e5a493e4f54aba8b9db66b06aa084c` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:17:01.026959 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dc6c9e-3138-44db-8afc-6b440c2f2e0a None admin] RBAC: Authorizing `identity:get_user(user_id=26e5a493e4f54aba8b9db66b06aa084c)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:17:01.028369 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dc6c9e-3138-44db-8afc-6b440c2f2e0a None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:17:01.029939 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 548/1114] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Sep 13 15:17:00 2022] GET /identity/v3/users/26e5a493e4f54aba8b9db66b06aa084c => generated 286 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 15:17:01.035943 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9e5ab7-0d2a-4748-be1b-27d43ed73d46 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:17:01.133013 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9e5ab7-0d2a-4748-be1b-27d43ed73d46 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:17:01.165668 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafe36f5-ce6e-48b3-acc9-d3f88229564b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:17:01.171278 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafe36f5-ce6e-48b3-acc9-d3f88229564b None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:17:01.171278 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafe36f5-ce6e-48b3-acc9-d3f88229564b None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:17:01.171278 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafe36f5-ce6e-48b3-acc9-d3f88229564b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:17:01.227178 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:17:01.234873 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafe36f5-ce6e-48b3-acc9-d3f88229564b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:17:01.236955 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafe36f5-ce6e-48b3-acc9-d3f88229564b None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:17:01.330234 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 567/1115] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Sep 13 15:17:01 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 15:17:01.336176 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dc6c9e-3138-44db-8afc-6b440c2f2e0a None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:17:01.363635 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:17:01.435592 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dc6c9e-3138-44db-8afc-6b440c2f2e0a None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:17:01.467958 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f468d2-e9d1-4774-b7ee-0c81a648ba13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:17:01.468575 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f468d2-e9d1-4774-b7ee-0c81a648ba13 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:17:01.468858 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f468d2-e9d1-4774-b7ee-0c81a648ba13 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:17:01.469135 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f468d2-e9d1-4774-b7ee-0c81a648ba13 None admin] PATH_INFO: `/v3/projects/133e15d053124ceeb3bdf8a5c5e2b4fd` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:17:01.470946 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f468d2-e9d1-4774-b7ee-0c81a648ba13 None admin] RBAC: Authorizing `identity:get_project(project_id=133e15d053124ceeb3bdf8a5c5e2b4fd)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:17:01.472363 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f468d2-e9d1-4774-b7ee-0c81a648ba13 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:17:01.474000 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 549/1116] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Sep 13 15:17:01 2022] GET /identity/v3/projects/133e15d053124ceeb3bdf8a5c5e2b4fd => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:17:01.480162 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafe36f5-ce6e-48b3-acc9-d3f88229564b None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:17:01.575427 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:17:01.583071 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafe36f5-ce6e-48b3-acc9-d3f88229564b None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:17:01.617232 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b0f808-3006-4758-82d8-529e2cbaf0fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:17:01.617862 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b0f808-3006-4758-82d8-529e2cbaf0fd None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:17:01.618148 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b0f808-3006-4758-82d8-529e2cbaf0fd None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:17:01.618424 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b0f808-3006-4758-82d8-529e2cbaf0fd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:17:01.619144 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b0f808-3006-4758-82d8-529e2cbaf0fd None admin] RBAC: Adding query filter params (role.id=5d9c0543f8e04065bb3d8bcd11156c1d, scope.project.id=133e15d053124ceeb3bdf8a5c5e2b4fd, user.id=26e5a493e4f54aba8b9db66b06aa084c) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:17:01.619457 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b0f808-3006-4758-82d8-529e2cbaf0fd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:17:01.621006 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b0f808-3006-4758-82d8-529e2cbaf0fd None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:17:01.626319 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 568/1117] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Sep 13 15:17:01 2022] GET /identity/v3/role_assignments?user.id=26e5a493e4f54aba8b9db66b06aa084c&scope.project.id=133e15d053124ceeb3bdf8a5c5e2b4fd&role.id=5d9c0543f8e04065bb3d8bcd11156c1d => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:17:03.745904 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc5f21f-8bfd-47a0-b4fe-66eb0f31dc9f None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:17:03.746338 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc5f21f-8bfd-47a0-b4fe-66eb0f31dc9f None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:17:03.746445 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc5f21f-8bfd-47a0-b4fe-66eb0f31dc9f None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:17:03.747793 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 550/1118] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:17:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:17:03.753726 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fd2dc7-63b7-48d6-af0f-01dd1fea8519 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:17:03.754169 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fd2dc7-63b7-48d6-af0f-01dd1fea8519 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:17:03.754279 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fd2dc7-63b7-48d6-af0f-01dd1fea8519 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:17:03.772649 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-58fd2dc7-63b7-48d6-af0f-01dd1fea8519 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:17:03.773881 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-58fd2dc7-63b7-48d6-af0f-01dd1fea8519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:17:03.838602 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 569/1119] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:17:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 15:17:04.109423 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc5f21f-8bfd-47a0-b4fe-66eb0f31dc9f None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:17:04.200918 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:17:04.208885 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc5f21f-8bfd-47a0-b4fe-66eb0f31dc9f None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:17:04.241829 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d4a59c-3f8d-4dd0-9d4e-a51798957ac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:17:04.242440 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d4a59c-3f8d-4dd0-9d4e-a51798957ac9 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:17:04.242722 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d4a59c-3f8d-4dd0-9d4e-a51798957ac9 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:17:04.242996 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d4a59c-3f8d-4dd0-9d4e-a51798957ac9 None admin] PATH_INFO: `/v3/roles/5d9c0543f8e04065bb3d8bcd11156c1d` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:17:04.244375 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d4a59c-3f8d-4dd0-9d4e-a51798957ac9 None admin] RBAC: Authorizing `identity:get_role(role_id=5d9c0543f8e04065bb3d8bcd11156c1d)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:17:04.245753 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d4a59c-3f8d-4dd0-9d4e-a51798957ac9 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:17:04.247050 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 551/1120] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Sep 13 15:17:04 2022] GET /identity/v3/roles/5d9c0543f8e04065bb3d8bcd11156c1d => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:17:04.253443 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fd2dc7-63b7-48d6-af0f-01dd1fea8519 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:17:04.339187 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:17:04.351206 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fd2dc7-63b7-48d6-af0f-01dd1fea8519 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:17:04.383940 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd544cb-7601-4ed5-84e1-fcab8479d3b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:17:04.384503 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd544cb-7601-4ed5-84e1-fcab8479d3b0 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:17:04.384787 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd544cb-7601-4ed5-84e1-fcab8479d3b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:17:04.385063 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd544cb-7601-4ed5-84e1-fcab8479d3b0 None admin] PATH_INFO: `/v3/users/26e5a493e4f54aba8b9db66b06aa084c` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:17:04.386266 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd544cb-7601-4ed5-84e1-fcab8479d3b0 None admin] RBAC: Authorizing `identity:get_user(user_id=26e5a493e4f54aba8b9db66b06aa084c)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:17:04.387726 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd544cb-7601-4ed5-84e1-fcab8479d3b0 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:17:04.389293 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 570/1121] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Sep 13 15:17:04 2022] GET /identity/v3/users/26e5a493e4f54aba8b9db66b06aa084c => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:17:04.396431 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d4a59c-3f8d-4dd0-9d4e-a51798957ac9 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:17:04.493504 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d4a59c-3f8d-4dd0-9d4e-a51798957ac9 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:17:04.526963 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4d4e94-b11d-498c-b155-66a651c15491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:17:04.527579 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4d4e94-b11d-498c-b155-66a651c15491 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:17:04.527858 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4d4e94-b11d-498c-b155-66a651c15491 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:17:04.528130 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4d4e94-b11d-498c-b155-66a651c15491 None admin] PATH_INFO: `/v3/projects/133e15d053124ceeb3bdf8a5c5e2b4fd` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:17:04.529232 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4d4e94-b11d-498c-b155-66a651c15491 None admin] RBAC: Authorizing `identity:get_project(project_id=133e15d053124ceeb3bdf8a5c5e2b4fd)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:17:04.530675 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4d4e94-b11d-498c-b155-66a651c15491 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:17:04.532533 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 552/1122] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Sep 13 15:17:04 2022] GET /identity/v3/projects/133e15d053124ceeb3bdf8a5c5e2b4fd => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:17:04.538490 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd544cb-7601-4ed5-84e1-fcab8479d3b0 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:17:04.636306 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd544cb-7601-4ed5-84e1-fcab8479d3b0 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:17:04.668826 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160131d5-b2e1-4827-9f1a-4186d3755ca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:17:04.669482 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160131d5-b2e1-4827-9f1a-4186d3755ca4 None admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:17:04.669794 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160131d5-b2e1-4827-9f1a-4186d3755ca4 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:17:04.670076 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160131d5-b2e1-4827-9f1a-4186d3755ca4 None admin] PATH_INFO: `/v3/projects/133e15d053124ceeb3bdf8a5c5e2b4fd/users/26e5a493e4f54aba8b9db66b06aa084c/roles/5d9c0543f8e04065bb3d8bcd11156c1d` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:17:04.672209 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160131d5-b2e1-4827-9f1a-4186d3755ca4 None admin] RBAC: Authorizing `identity:create_grant(project_id=133e15d053124ceeb3bdf8a5c5e2b4fd, user_id=26e5a493e4f54aba8b9db66b06aa084c, role_id=5d9c0543f8e04065bb3d8bcd11156c1d)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:17:04.674364 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160131d5-b2e1-4827-9f1a-4186d3755ca4 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:17:04.686663 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 571/1123] 10.222.0.27 () {58 vars in 1439 bytes} [Tue Sep 13 15:17:04 2022] PUT /identity/v3/projects/133e15d053124ceeb3bdf8a5c5e2b4fd/users/26e5a493e4f54aba8b9db66b06aa084c/roles/5d9c0543f8e04065bb3d8bcd11156c1d => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:17:06.807453 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1125a5b2-e355-48cd-8f92-d12baf215016 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:17:06.807987 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1125a5b2-e355-48cd-8f92-d12baf215016 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:17:06.807987 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1125a5b2-e355-48cd-8f92-d12baf215016 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:17:06.809331 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 553/1124] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:17:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:17:06.814653 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8cf5bb-7f1a-4ca2-96fa-430df81989a6 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:17:06.815066 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8cf5bb-7f1a-4ca2-96fa-430df81989a6 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:17:06.815223 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8cf5bb-7f1a-4ca2-96fa-430df81989a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:17:06.833286 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-ac8cf5bb-7f1a-4ca2-96fa-430df81989a6 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:17:06.834488 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-ac8cf5bb-7f1a-4ca2-96fa-430df81989a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:17:06.845488 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:17:06.901423 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 572/1125] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:17:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 15:17:07.171803 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1125a5b2-e355-48cd-8f92-d12baf215016 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:17:07.201727 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:17:07.272531 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1125a5b2-e355-48cd-8f92-d12baf215016 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:17:07.304549 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23b539f-558b-4741-87d9-3b1e95b578a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:17:07.305166 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23b539f-558b-4741-87d9-3b1e95b578a3 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:17:07.305448 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23b539f-558b-4741-87d9-3b1e95b578a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:17:07.305744 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23b539f-558b-4741-87d9-3b1e95b578a3 None admin] PATH_INFO: `/v3/roles/5d9c0543f8e04065bb3d8bcd11156c1d` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:17:07.307132 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23b539f-558b-4741-87d9-3b1e95b578a3 None admin] RBAC: Authorizing `identity:get_role(role_id=5d9c0543f8e04065bb3d8bcd11156c1d)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:17:07.308486 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23b539f-558b-4741-87d9-3b1e95b578a3 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:17:07.309805 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 554/1126] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Sep 13 15:17:07 2022] GET /identity/v3/roles/5d9c0543f8e04065bb3d8bcd11156c1d => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:17:07.316259 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8cf5bb-7f1a-4ca2-96fa-430df81989a6 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:17:07.411899 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8cf5bb-7f1a-4ca2-96fa-430df81989a6 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:17:07.444617 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ef62fe-add5-4191-be2e-e4b62af9db0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:17:07.445178 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ef62fe-add5-4191-be2e-e4b62af9db0e None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:17:07.445458 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ef62fe-add5-4191-be2e-e4b62af9db0e None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:17:07.445753 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ef62fe-add5-4191-be2e-e4b62af9db0e None admin] PATH_INFO: `/v3/users/26e5a493e4f54aba8b9db66b06aa084c` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:17:07.446868 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ef62fe-add5-4191-be2e-e4b62af9db0e None admin] RBAC: Authorizing `identity:get_user(user_id=26e5a493e4f54aba8b9db66b06aa084c)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:17:07.448291 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ef62fe-add5-4191-be2e-e4b62af9db0e None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:17:07.449866 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 573/1127] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Sep 13 15:17:07 2022] GET /identity/v3/users/26e5a493e4f54aba8b9db66b06aa084c => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:17:07.456079 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23b539f-558b-4741-87d9-3b1e95b578a3 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:17:07.547534 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:17:07.551537 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23b539f-558b-4741-87d9-3b1e95b578a3 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:17:07.584994 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea307ea-26dc-49c8-8ba2-b4a0e564a311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:17:07.585589 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea307ea-26dc-49c8-8ba2-b4a0e564a311 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:17:07.585897 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea307ea-26dc-49c8-8ba2-b4a0e564a311 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:17:07.586170 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea307ea-26dc-49c8-8ba2-b4a0e564a311 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:17:07.650333 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea307ea-26dc-49c8-8ba2-b4a0e564a311 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:17:07.651764 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea307ea-26dc-49c8-8ba2-b4a0e564a311 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:17:07.743428 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:17:07.749797 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 555/1128] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Sep 13 15:17:07 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 15:17:07.755278 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ef62fe-add5-4191-be2e-e4b62af9db0e None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:17:07.770309 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:17:07.851572 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ef62fe-add5-4191-be2e-e4b62af9db0e None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:17:07.884712 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90760bae-b2ca-4c82-bd56-f417ee0a5818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:17:07.885322 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90760bae-b2ca-4c82-bd56-f417ee0a5818 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:17:07.885601 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90760bae-b2ca-4c82-bd56-f417ee0a5818 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:17:07.885900 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90760bae-b2ca-4c82-bd56-f417ee0a5818 None admin] PATH_INFO: `/v3/projects/133e15d053124ceeb3bdf8a5c5e2b4fd` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:17:07.886993 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90760bae-b2ca-4c82-bd56-f417ee0a5818 None admin] RBAC: Authorizing `identity:get_project(project_id=133e15d053124ceeb3bdf8a5c5e2b4fd)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:17:07.888409 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90760bae-b2ca-4c82-bd56-f417ee0a5818 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:17:07.890048 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 574/1129] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Sep 13 15:17:07 2022] GET /identity/v3/projects/133e15d053124ceeb3bdf8a5c5e2b4fd => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:17:07.896432 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea307ea-26dc-49c8-8ba2-b4a0e564a311 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:17:07.992718 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea307ea-26dc-49c8-8ba2-b4a0e564a311 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:17:08.025568 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d551862c-30c8-4521-8701-5f46b8ad0219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:17:08.026188 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d551862c-30c8-4521-8701-5f46b8ad0219 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:17:08.026466 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d551862c-30c8-4521-8701-5f46b8ad0219 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:17:08.026734 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d551862c-30c8-4521-8701-5f46b8ad0219 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:17:08.027438 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d551862c-30c8-4521-8701-5f46b8ad0219 None admin] RBAC: Adding query filter params (role.id=5d9c0543f8e04065bb3d8bcd11156c1d, scope.project.id=133e15d053124ceeb3bdf8a5c5e2b4fd, user.id=26e5a493e4f54aba8b9db66b06aa084c) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:17:08.027741 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d551862c-30c8-4521-8701-5f46b8ad0219 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:17:08.029134 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d551862c-30c8-4521-8701-5f46b8ad0219 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:17:08.035319 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 556/1130] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Sep 13 15:17:07 2022] GET /identity/v3/role_assignments?user.id=26e5a493e4f54aba8b9db66b06aa084c&scope.project.id=133e15d053124ceeb3bdf8a5c5e2b4fd&role.id=5d9c0543f8e04065bb3d8bcd11156c1d => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:17:10.182090 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279c9d66-959d-40e2-a85d-a03468215d3d None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:17:10.182630 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279c9d66-959d-40e2-a85d-a03468215d3d None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:17:10.182630 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279c9d66-959d-40e2-a85d-a03468215d3d None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:17:10.183960 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 575/1131] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:17:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:17:10.189280 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81382e90-2950-4e55-99a3-3009492be9c5 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:17:10.189724 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81382e90-2950-4e55-99a3-3009492be9c5 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:17:10.189870 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81382e90-2950-4e55-99a3-3009492be9c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:17:10.208512 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-81382e90-2950-4e55-99a3-3009492be9c5 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:17:10.209710 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-81382e90-2950-4e55-99a3-3009492be9c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:17:10.264997 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:17:10.276412 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 557/1132] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:17:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 15:17:10.555708 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279c9d66-959d-40e2-a85d-a03468215d3d None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:17:10.635541 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:17:10.654613 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279c9d66-959d-40e2-a85d-a03468215d3d None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:17:10.687168 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750d7267-5cee-4b0f-80a0-62e82b0ec3c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:17:10.687812 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750d7267-5cee-4b0f-80a0-62e82b0ec3c3 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:17:10.688091 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750d7267-5cee-4b0f-80a0-62e82b0ec3c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:17:10.688360 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750d7267-5cee-4b0f-80a0-62e82b0ec3c3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:17:10.689458 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750d7267-5cee-4b0f-80a0-62e82b0ec3c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:17:10.690911 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750d7267-5cee-4b0f-80a0-62e82b0ec3c3 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:17:10.692761 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 576/1133] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 13 15:17:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:17:10.698510 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81382e90-2950-4e55-99a3-3009492be9c5 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:17:10.794014 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81382e90-2950-4e55-99a3-3009492be9c5 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:17:10.825919 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fbae69-8f71-4004-95c5-8f8edf90eb89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:17:10.826458 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fbae69-8f71-4004-95c5-8f8edf90eb89 None admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:17:10.826735 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fbae69-8f71-4004-95c5-8f8edf90eb89 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:17:10.827009 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fbae69-8f71-4004-95c5-8f8edf90eb89 None admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:17:10.827651 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fbae69-8f71-4004-95c5-8f8edf90eb89 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:17:10.829766 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fbae69-8f71-4004-95c5-8f8edf90eb89 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:17:10.855191 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 558/1134] 10.222.0.27 () {60 vars in 1141 bytes} [Tue Sep 13 15:17:10 2022] POST /identity/v3/projects => generated 311 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:17:13.014651 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc808d6-9ebf-4b12-b5ec-bcc8cc90f66e None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:17:13.015179 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc808d6-9ebf-4b12-b5ec-bcc8cc90f66e None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:17:13.015179 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc808d6-9ebf-4b12-b5ec-bcc8cc90f66e None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:17:13.017005 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 577/1135] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:17:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:17:13.022237 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a730595-c8c6-4182-9cbb-5afc4926cc94 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:17:13.022648 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a730595-c8c6-4182-9cbb-5afc4926cc94 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:17:13.022797 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a730595-c8c6-4182-9cbb-5afc4926cc94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:17:13.041524 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-6a730595-c8c6-4182-9cbb-5afc4926cc94 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:17:13.042740 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-6a730595-c8c6-4182-9cbb-5afc4926cc94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:17:13.081429 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:17:13.110212 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 559/1136] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:17:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 15:17:13.381123 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc808d6-9ebf-4b12-b5ec-bcc8cc90f66e None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:17:13.479204 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc808d6-9ebf-4b12-b5ec-bcc8cc90f66e None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:17:13.511750 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13254659-827a-4e59-a84e-140693f6ba7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:17:13.512365 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13254659-827a-4e59-a84e-140693f6ba7e None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:17:13.512643 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13254659-827a-4e59-a84e-140693f6ba7e None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:17:13.512916 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13254659-827a-4e59-a84e-140693f6ba7e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:17:13.514047 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13254659-827a-4e59-a84e-140693f6ba7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:17:13.515528 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13254659-827a-4e59-a84e-140693f6ba7e None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:17:13.517583 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 578/1137] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 13 15:17:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:17:13.523300 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a730595-c8c6-4182-9cbb-5afc4926cc94 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:17:13.619292 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a730595-c8c6-4182-9cbb-5afc4926cc94 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:17:13.652053 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6663ba58-74aa-4f95-9d6b-154326e81556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:17:13.652647 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6663ba58-74aa-4f95-9d6b-154326e81556 None admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:17:13.652929 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6663ba58-74aa-4f95-9d6b-154326e81556 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:17:13.653202 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6663ba58-74aa-4f95-9d6b-154326e81556 None admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:17:13.653873 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6663ba58-74aa-4f95-9d6b-154326e81556 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:17:13.655282 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6663ba58-74aa-4f95-9d6b-154326e81556 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:17:13.675694 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 560/1138] 10.222.0.27 () {60 vars in 1132 bytes} [Tue Sep 13 15:17:13 2022] POST /identity/v3/users => generated 286 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:17:15.844226 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955c76f3-d2be-4f64-803f-8ccb1590c2a4 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:17:15.844756 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955c76f3-d2be-4f64-803f-8ccb1590c2a4 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:17:15.844756 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955c76f3-d2be-4f64-803f-8ccb1590c2a4 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:17:15.846206 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 579/1139] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:17:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:17:15.851286 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93d56dc-c493-455f-939d-f166abcf0419 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:17:15.851665 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93d56dc-c493-455f-939d-f166abcf0419 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:17:15.851837 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93d56dc-c493-455f-939d-f166abcf0419 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:17:15.869802 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-c93d56dc-c493-455f-939d-f166abcf0419 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:17:15.870970 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-c93d56dc-c493-455f-939d-f166abcf0419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:17:15.894054 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:17:15.935456 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 561/1140] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:17:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 15:17:16.204967 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955c76f3-d2be-4f64-803f-8ccb1590c2a4 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:17:16.224073 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:17:16.303673 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955c76f3-d2be-4f64-803f-8ccb1590c2a4 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:17:16.336336 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b58d93d-984c-4a22-86fe-f159013c4dea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:17:16.336947 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b58d93d-984c-4a22-86fe-f159013c4dea None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:17:16.337230 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b58d93d-984c-4a22-86fe-f159013c4dea None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:17:16.337505 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b58d93d-984c-4a22-86fe-f159013c4dea None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:17:16.347935 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b58d93d-984c-4a22-86fe-f159013c4dea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 15:17:16.352755 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-7b58d93d-984c-4a22-86fe-f159013c4dea None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 15:17:16.352755 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:17:16.352755 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:17:16.352755 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:17:16.352755 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:17:16.352755 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:17:16.352755 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:17:16.352755 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:17:16.352755 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:17:16.352755 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:17:16.352755 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:17:16.352755 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:17:16.352755 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 15:17:16.352755 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 15:17:16.352755 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 15:17:16.352755 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 15:17:16.353956 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 15:17:16.353956 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 15:17:16.353956 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 15:17:16.353956 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 15:17:16.353956 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:17:16.353956 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:17:16.353956 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:17:16.353956 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:17:16.353956 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:17:16.353956 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:17:16.353956 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:17:16.353956 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Sep 13 15:17:16.353956 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:17:16.353956 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:17:16.353956 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:17:16.353956 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:17:16.355215 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:17:16.355215 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:17:16.355215 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:17:16.355215 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:17:16.355215 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 15:17:16.355215 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 15:17:16.355215 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 15:17:16.355215 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 15:17:16.355215 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 15:17:16.355215 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 15:17:16.355215 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 15:17:16.355215 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Sep 13 15:17:16.355215 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 580/1141] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Sep 13 15:17:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:17:16.360523 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93d56dc-c493-455f-939d-f166abcf0419 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:17:16.458160 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93d56dc-c493-455f-939d-f166abcf0419 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:17:16.494196 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117cf90b-62f8-48cf-b76c-250c27bef339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:17:16.494806 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117cf90b-62f8-48cf-b76c-250c27bef339 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:17:16.495089 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117cf90b-62f8-48cf-b76c-250c27bef339 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:17:16.495362 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117cf90b-62f8-48cf-b76c-250c27bef339 None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:17:16.496018 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117cf90b-62f8-48cf-b76c-250c27bef339 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:17:16.496322 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117cf90b-62f8-48cf-b76c-250c27bef339 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:17:16.497676 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117cf90b-62f8-48cf-b76c-250c27bef339 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:17:16.505582 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 562/1142] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Sep 13 15:17:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:17:16.511489 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b58d93d-984c-4a22-86fe-f159013c4dea None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:17:16.588548 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:17:16.610748 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b58d93d-984c-4a22-86fe-f159013c4dea None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:17:16.644300 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a2b552-81a8-455b-bd00-aa42fdce81ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:17:16.644923 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a2b552-81a8-455b-bd00-aa42fdce81ea None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:17:16.645204 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a2b552-81a8-455b-bd00-aa42fdce81ea None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:17:16.645483 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a2b552-81a8-455b-bd00-aa42fdce81ea None admin] PATH_INFO: `/v3/users/685bbeda5f584d25afa6a5fd99ccd35e` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:17:16.658639 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a2b552-81a8-455b-bd00-aa42fdce81ea None admin] RBAC: Authorizing `identity:get_user(user_id=685bbeda5f584d25afa6a5fd99ccd35e)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:17:16.660074 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a2b552-81a8-455b-bd00-aa42fdce81ea None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:17:16.661644 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 581/1143] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Sep 13 15:17:16 2022] GET /identity/v3/users/685bbeda5f584d25afa6a5fd99ccd35e => generated 286 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:17:16.667362 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117cf90b-62f8-48cf-b76c-250c27bef339 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:17:16.692319 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:17:16.768877 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117cf90b-62f8-48cf-b76c-250c27bef339 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:17:16.801473 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc2413f-c313-45f7-b4eb-1975e9e6d681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:17:16.802097 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc2413f-c313-45f7-b4eb-1975e9e6d681 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:17:16.802376 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc2413f-c313-45f7-b4eb-1975e9e6d681 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:17:16.802662 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc2413f-c313-45f7-b4eb-1975e9e6d681 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:17:16.867618 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc2413f-c313-45f7-b4eb-1975e9e6d681 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:17:16.869040 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc2413f-c313-45f7-b4eb-1975e9e6d681 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:17:16.891760 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:17:16.964376 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 563/1144] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Sep 13 15:17:16 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 15:17:16.971075 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a2b552-81a8-455b-bd00-aa42fdce81ea None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:17:17.065522 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a2b552-81a8-455b-bd00-aa42fdce81ea None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:17:17.098196 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18aefe2-e3b3-4e0e-9fae-e5e8cdc555ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:17:17.098809 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18aefe2-e3b3-4e0e-9fae-e5e8cdc555ef None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:17:17.099087 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18aefe2-e3b3-4e0e-9fae-e5e8cdc555ef None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:17:17.099359 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18aefe2-e3b3-4e0e-9fae-e5e8cdc555ef None admin] PATH_INFO: `/v3/projects/03eff1f1741f4065a7c57021ccfa1d5f` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:17:17.100445 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18aefe2-e3b3-4e0e-9fae-e5e8cdc555ef None admin] RBAC: Authorizing `identity:get_project(project_id=03eff1f1741f4065a7c57021ccfa1d5f)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:17:17.101890 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18aefe2-e3b3-4e0e-9fae-e5e8cdc555ef None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:17:17.103474 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 582/1145] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Sep 13 15:17:16 2022] GET /identity/v3/projects/03eff1f1741f4065a7c57021ccfa1d5f => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:17:17.109547 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc2413f-c313-45f7-b4eb-1975e9e6d681 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:17:17.206162 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc2413f-c313-45f7-b4eb-1975e9e6d681 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:17:17.227672 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:17:17.239369 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8ecdef-2738-41d9-8fec-ebc326bcaad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:17:17.239961 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8ecdef-2738-41d9-8fec-ebc326bcaad0 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:17:17.240241 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8ecdef-2738-41d9-8fec-ebc326bcaad0 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:17:17.240512 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8ecdef-2738-41d9-8fec-ebc326bcaad0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:17:17.241222 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8ecdef-2738-41d9-8fec-ebc326bcaad0 None admin] RBAC: Adding query filter params (role.id=f34412ad29f1478cba775b033129f71f, scope.project.id=03eff1f1741f4065a7c57021ccfa1d5f, user.id=685bbeda5f584d25afa6a5fd99ccd35e) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:17:17.241530 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8ecdef-2738-41d9-8fec-ebc326bcaad0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:17:17.242970 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8ecdef-2738-41d9-8fec-ebc326bcaad0 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:17:17.248103 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 564/1146] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Sep 13 15:17:17 2022] GET /identity/v3/role_assignments?user.id=685bbeda5f584d25afa6a5fd99ccd35e&scope.project.id=03eff1f1741f4065a7c57021ccfa1d5f&role.id=f34412ad29f1478cba775b033129f71f => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:17:19.367433 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7834be-cea3-4bc5-9a79-a3cc20054cef None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:17:19.367987 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7834be-cea3-4bc5-9a79-a3cc20054cef None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:17:19.367987 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7834be-cea3-4bc5-9a79-a3cc20054cef None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:17:19.369294 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 583/1147] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:17:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:17:19.375055 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6841447f-0210-4afa-93dc-7076873cb72a None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:17:19.375559 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6841447f-0210-4afa-93dc-7076873cb72a None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:17:19.375913 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6841447f-0210-4afa-93dc-7076873cb72a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:17:19.395308 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-6841447f-0210-4afa-93dc-7076873cb72a None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:17:19.396582 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-6841447f-0210-4afa-93dc-7076873cb72a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:17:19.461707 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 565/1148] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:17:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 15:17:19.731289 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7834be-cea3-4bc5-9a79-a3cc20054cef None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:17:19.735266 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:17:19.830378 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7834be-cea3-4bc5-9a79-a3cc20054cef None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:17:19.863795 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd62961e-e3f3-463e-929c-7e7378a082b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:17:19.864417 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd62961e-e3f3-463e-929c-7e7378a082b7 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:17:19.864702 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd62961e-e3f3-463e-929c-7e7378a082b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:17:19.864981 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd62961e-e3f3-463e-929c-7e7378a082b7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:17:19.874993 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd62961e-e3f3-463e-929c-7e7378a082b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 15:17:19.879857 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-cd62961e-e3f3-463e-929c-7e7378a082b7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 15:17:19.879857 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:17:19.879857 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:17:19.879857 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:17:19.879857 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:17:19.879857 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:17:19.879857 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:17:19.879857 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:17:19.879857 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:17:19.879857 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:17:19.879857 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:17:19.879857 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:17:19.879857 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 15:17:19.879857 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 15:17:19.879857 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 15:17:19.879857 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 15:17:19.880928 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 15:17:19.880928 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 15:17:19.880928 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 15:17:19.880928 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 15:17:19.880928 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:17:19.880928 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:17:19.880928 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:17:19.880928 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:17:19.880928 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:17:19.880928 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:17:19.880928 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:17:19.880928 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Sep 13 15:17:19.880928 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:17:19.880928 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:17:19.880928 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:17:19.880928 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:17:19.881804 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:17:19.881804 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:17:19.881804 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:17:19.881804 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:17:19.881804 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 15:17:19.881804 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 15:17:19.881804 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 15:17:19.881804 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 15:17:19.881804 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 15:17:19.881804 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 15:17:19.881804 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 15:17:19.881804 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Sep 13 15:17:19.881804 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 584/1149] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Sep 13 15:17:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:17:19.887032 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6841447f-0210-4afa-93dc-7076873cb72a None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:17:19.983351 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6841447f-0210-4afa-93dc-7076873cb72a None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:17:20.000040 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:17:20.018526 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ded201a-23fb-4017-94c9-0108a77ba445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:17:20.019132 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ded201a-23fb-4017-94c9-0108a77ba445 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:17:20.019419 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ded201a-23fb-4017-94c9-0108a77ba445 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:17:20.019698 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ded201a-23fb-4017-94c9-0108a77ba445 None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:17:20.020368 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ded201a-23fb-4017-94c9-0108a77ba445 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:17:20.020674 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ded201a-23fb-4017-94c9-0108a77ba445 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:17:20.022066 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ded201a-23fb-4017-94c9-0108a77ba445 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:17:20.029982 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 566/1150] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Sep 13 15:17:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:17:20.036075 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd62961e-e3f3-463e-929c-7e7378a082b7 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:17:20.103453 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:17:20.141662 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd62961e-e3f3-463e-929c-7e7378a082b7 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:17:20.175263 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd650b7-b798-4864-8af7-de2d5f4d8542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:17:20.176341 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd650b7-b798-4864-8af7-de2d5f4d8542 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:17:20.176831 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd650b7-b798-4864-8af7-de2d5f4d8542 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:17:20.177339 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd650b7-b798-4864-8af7-de2d5f4d8542 None admin] PATH_INFO: `/v3/users/685bbeda5f584d25afa6a5fd99ccd35e` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:17:20.179352 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd650b7-b798-4864-8af7-de2d5f4d8542 None admin] RBAC: Authorizing `identity:get_user(user_id=685bbeda5f584d25afa6a5fd99ccd35e)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:17:20.181160 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd650b7-b798-4864-8af7-de2d5f4d8542 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:17:20.182741 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 585/1151] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Sep 13 15:17:20 2022] GET /identity/v3/users/685bbeda5f584d25afa6a5fd99ccd35e => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:17:20.189415 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ded201a-23fb-4017-94c9-0108a77ba445 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:17:20.286629 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ded201a-23fb-4017-94c9-0108a77ba445 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:17:20.319535 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44041ce9-07af-488f-b73d-7ffa02411b1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:17:20.320149 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44041ce9-07af-488f-b73d-7ffa02411b1d None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:17:20.320435 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44041ce9-07af-488f-b73d-7ffa02411b1d None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:17:20.320713 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44041ce9-07af-488f-b73d-7ffa02411b1d None admin] PATH_INFO: `/v3/projects/03eff1f1741f4065a7c57021ccfa1d5f` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:17:20.321851 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44041ce9-07af-488f-b73d-7ffa02411b1d None admin] RBAC: Authorizing `identity:get_project(project_id=03eff1f1741f4065a7c57021ccfa1d5f)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:17:20.323272 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44041ce9-07af-488f-b73d-7ffa02411b1d None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:17:20.324873 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 567/1152] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Sep 13 15:17:20 2022] GET /identity/v3/projects/03eff1f1741f4065a7c57021ccfa1d5f => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:17:20.331329 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd650b7-b798-4864-8af7-de2d5f4d8542 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:17:20.428717 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd650b7-b798-4864-8af7-de2d5f4d8542 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:17:20.458504 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:17:20.466718 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe43d55-e02f-4cbf-a202-2e31b02e0817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:17:20.467381 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe43d55-e02f-4cbf-a202-2e31b02e0817 None admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:17:20.467663 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe43d55-e02f-4cbf-a202-2e31b02e0817 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:17:20.467936 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe43d55-e02f-4cbf-a202-2e31b02e0817 None admin] PATH_INFO: `/v3/projects/03eff1f1741f4065a7c57021ccfa1d5f/users/685bbeda5f584d25afa6a5fd99ccd35e/roles/f34412ad29f1478cba775b033129f71f` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:17:20.470420 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe43d55-e02f-4cbf-a202-2e31b02e0817 None admin] RBAC: Authorizing `identity:create_grant(project_id=03eff1f1741f4065a7c57021ccfa1d5f, user_id=685bbeda5f584d25afa6a5fd99ccd35e, role_id=f34412ad29f1478cba775b033129f71f)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:17:20.471854 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe43d55-e02f-4cbf-a202-2e31b02e0817 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:17:20.484823 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 586/1153] 10.222.0.27 () {58 vars in 1439 bytes} [Tue Sep 13 15:17:20 2022] PUT /identity/v3/projects/03eff1f1741f4065a7c57021ccfa1d5f/users/685bbeda5f584d25afa6a5fd99ccd35e/roles/f34412ad29f1478cba775b033129f71f => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:17:22.597273 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da93bcaa-55e8-4fb2-8889-9276b994af92 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:17:22.597927 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da93bcaa-55e8-4fb2-8889-9276b994af92 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:17:22.597927 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da93bcaa-55e8-4fb2-8889-9276b994af92 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:17:22.599192 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 568/1154] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:17:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:17:22.604401 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce63b8c4-0568-451d-a6bb-eed5723a1d46 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:17:22.604837 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce63b8c4-0568-451d-a6bb-eed5723a1d46 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:17:22.604947 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce63b8c4-0568-451d-a6bb-eed5723a1d46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:17:22.623244 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-ce63b8c4-0568-451d-a6bb-eed5723a1d46 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:17:22.624465 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-ce63b8c4-0568-451d-a6bb-eed5723a1d46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:17:22.688529 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 587/1155] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:17:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 15:17:22.960376 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da93bcaa-55e8-4fb2-8889-9276b994af92 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:17:23.008409 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:17:23.061010 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da93bcaa-55e8-4fb2-8889-9276b994af92 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:17:23.094258 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af492d2d-cb00-4672-8814-9a91ee10aa04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:17:23.094872 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af492d2d-cb00-4672-8814-9a91ee10aa04 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:17:23.095152 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af492d2d-cb00-4672-8814-9a91ee10aa04 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:17:23.095423 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af492d2d-cb00-4672-8814-9a91ee10aa04 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:17:23.105642 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af492d2d-cb00-4672-8814-9a91ee10aa04 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 15:17:23.110614 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-af492d2d-cb00-4672-8814-9a91ee10aa04 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 15:17:23.110614 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:17:23.110614 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:17:23.110614 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:17:23.110614 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:17:23.110614 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:17:23.110614 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:17:23.110614 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:17:23.110614 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:17:23.110614 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:17:23.110614 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:17:23.110614 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:17:23.110614 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 15:17:23.110614 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 15:17:23.110614 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 15:17:23.110614 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 15:17:23.111843 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 15:17:23.111843 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 15:17:23.111843 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 15:17:23.111843 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 15:17:23.111843 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:17:23.111843 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:17:23.111843 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:17:23.111843 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:17:23.111843 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:17:23.111843 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:17:23.111843 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:17:23.111843 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Sep 13 15:17:23.111843 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:17:23.111843 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:17:23.111843 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:17:23.111843 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:17:23.112950 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:17:23.112950 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:17:23.112950 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:17:23.112950 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:17:23.112950 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 15:17:23.112950 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 15:17:23.112950 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 15:17:23.112950 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 15:17:23.112950 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 15:17:23.112950 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 15:17:23.112950 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 15:17:23.112950 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Sep 13 15:17:23.112950 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 569/1156] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Sep 13 15:17:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:17:23.117608 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce63b8c4-0568-451d-a6bb-eed5723a1d46 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:17:23.214192 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce63b8c4-0568-451d-a6bb-eed5723a1d46 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:17:23.235334 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:17:23.247704 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2d014d-b51f-4485-ac6e-7bd9ffca6452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:17:23.248304 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2d014d-b51f-4485-ac6e-7bd9ffca6452 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:17:23.248585 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2d014d-b51f-4485-ac6e-7bd9ffca6452 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:17:23.248857 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2d014d-b51f-4485-ac6e-7bd9ffca6452 None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:17:23.250256 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2d014d-b51f-4485-ac6e-7bd9ffca6452 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:17:23.250563 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2d014d-b51f-4485-ac6e-7bd9ffca6452 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:17:23.251958 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2d014d-b51f-4485-ac6e-7bd9ffca6452 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:17:23.259757 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 588/1157] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Sep 13 15:17:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:17:23.266221 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af492d2d-cb00-4672-8814-9a91ee10aa04 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:17:23.362120 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af492d2d-cb00-4672-8814-9a91ee10aa04 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:17:23.368664 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:17:23.396100 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f05652d-f1d3-41ff-8233-d96a51ee646e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:17:23.396727 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f05652d-f1d3-41ff-8233-d96a51ee646e None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:17:23.397012 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f05652d-f1d3-41ff-8233-d96a51ee646e None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:17:23.397291 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f05652d-f1d3-41ff-8233-d96a51ee646e None admin] PATH_INFO: `/v3/users/685bbeda5f584d25afa6a5fd99ccd35e` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:17:23.398430 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f05652d-f1d3-41ff-8233-d96a51ee646e None admin] RBAC: Authorizing `identity:get_user(user_id=685bbeda5f584d25afa6a5fd99ccd35e)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:17:23.399884 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f05652d-f1d3-41ff-8233-d96a51ee646e None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:17:23.401460 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 570/1158] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Sep 13 15:17:23 2022] GET /identity/v3/users/685bbeda5f584d25afa6a5fd99ccd35e => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:17:23.407358 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2d014d-b51f-4485-ac6e-7bd9ffca6452 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:17:23.505546 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2d014d-b51f-4485-ac6e-7bd9ffca6452 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:17:23.537484 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2692246-fe2c-4ea2-8e3c-f2a18d18c9d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:17:23.538115 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2692246-fe2c-4ea2-8e3c-f2a18d18c9d2 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:17:23.538399 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2692246-fe2c-4ea2-8e3c-f2a18d18c9d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:17:23.538676 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2692246-fe2c-4ea2-8e3c-f2a18d18c9d2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:17:23.588766 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:17:23.604478 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2692246-fe2c-4ea2-8e3c-f2a18d18c9d2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:17:23.605960 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2692246-fe2c-4ea2-8e3c-f2a18d18c9d2 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:17:23.701688 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 589/1159] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Sep 13 15:17:23 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 15:17:23.707861 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f05652d-f1d3-41ff-8233-d96a51ee646e None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:17:23.804537 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f05652d-f1d3-41ff-8233-d96a51ee646e None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:17:23.836470 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a0582c-89e2-4b05-9359-f6d7b7c53dd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:17:23.837087 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a0582c-89e2-4b05-9359-f6d7b7c53dd0 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:17:23.837369 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a0582c-89e2-4b05-9359-f6d7b7c53dd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:17:23.837643 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a0582c-89e2-4b05-9359-f6d7b7c53dd0 None admin] PATH_INFO: `/v3/projects/03eff1f1741f4065a7c57021ccfa1d5f` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:17:23.838773 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a0582c-89e2-4b05-9359-f6d7b7c53dd0 None admin] RBAC: Authorizing `identity:get_project(project_id=03eff1f1741f4065a7c57021ccfa1d5f)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:17:23.840192 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a0582c-89e2-4b05-9359-f6d7b7c53dd0 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:17:23.841832 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 571/1160] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Sep 13 15:17:23 2022] GET /identity/v3/projects/03eff1f1741f4065a7c57021ccfa1d5f => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:17:23.848747 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2692246-fe2c-4ea2-8e3c-f2a18d18c9d2 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:17:23.928638 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:17:23.946642 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2692246-fe2c-4ea2-8e3c-f2a18d18c9d2 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:17:23.979454 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3b609c-6f21-4c78-b952-2073e58dd165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:17:23.980044 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3b609c-6f21-4c78-b952-2073e58dd165 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:17:23.980322 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3b609c-6f21-4c78-b952-2073e58dd165 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:17:23.980593 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3b609c-6f21-4c78-b952-2073e58dd165 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:17:23.981305 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3b609c-6f21-4c78-b952-2073e58dd165 None admin] RBAC: Adding query filter params (role.id=f34412ad29f1478cba775b033129f71f, scope.project.id=03eff1f1741f4065a7c57021ccfa1d5f, user.id=685bbeda5f584d25afa6a5fd99ccd35e) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:17:23.981613 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3b609c-6f21-4c78-b952-2073e58dd165 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:17:23.983069 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3b609c-6f21-4c78-b952-2073e58dd165 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:17:23.988576 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 590/1161] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Sep 13 15:17:23 2022] GET /identity/v3/role_assignments?user.id=685bbeda5f584d25afa6a5fd99ccd35e&scope.project.id=03eff1f1741f4065a7c57021ccfa1d5f&role.id=f34412ad29f1478cba775b033129f71f => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:17:26.141637 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aff76a9-da6d-48f1-ae8d-10172c28ba67 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:17:26.142177 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aff76a9-da6d-48f1-ae8d-10172c28ba67 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:17:26.142291 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aff76a9-da6d-48f1-ae8d-10172c28ba67 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:17:26.143555 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 572/1162] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:17:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:17:26.148826 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30ec5e1-53ea-43cb-857c-fca6629eb7fb None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:17:26.149251 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30ec5e1-53ea-43cb-857c-fca6629eb7fb None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:17:26.149394 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30ec5e1-53ea-43cb-857c-fca6629eb7fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:17:26.167717 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-e30ec5e1-53ea-43cb-857c-fca6629eb7fb None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:17:26.168908 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-e30ec5e1-53ea-43cb-857c-fca6629eb7fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:17:26.233858 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 591/1163] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:17:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 15:17:26.502638 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aff76a9-da6d-48f1-ae8d-10172c28ba67 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:17:26.547317 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:17:26.603938 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aff76a9-da6d-48f1-ae8d-10172c28ba67 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:17:26.637018 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12543c14-6985-4867-a8df-148a35bf2ce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:17:26.637614 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12543c14-6985-4867-a8df-148a35bf2ce6 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:17:26.637919 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12543c14-6985-4867-a8df-148a35bf2ce6 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:17:26.638198 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12543c14-6985-4867-a8df-148a35bf2ce6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:17:26.703011 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12543c14-6985-4867-a8df-148a35bf2ce6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:17:26.704443 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12543c14-6985-4867-a8df-148a35bf2ce6 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:17:26.744917 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:17:26.800749 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 573/1164] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Sep 13 15:17:26 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 15:17:26.806700 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30ec5e1-53ea-43cb-857c-fca6629eb7fb None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:17:26.882722 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:17:26.903861 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30ec5e1-53ea-43cb-857c-fca6629eb7fb None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:17:26.937162 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6a2116-ce81-49ad-b8fb-d74203372a73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:17:26.937807 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6a2116-ce81-49ad-b8fb-d74203372a73 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:17:26.938090 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6a2116-ce81-49ad-b8fb-d74203372a73 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:17:26.938364 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6a2116-ce81-49ad-b8fb-d74203372a73 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:17:26.944982 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6a2116-ce81-49ad-b8fb-d74203372a73 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:17:26.946450 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6a2116-ce81-49ad-b8fb-d74203372a73 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:17:26.957471 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-ec6a2116-ce81-49ad-b8fb-d74203372a73 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 13 15:17:26.957471 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:17:26.957471 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 13 15:17:26.957471 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 13 15:17:26.957471 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 15:17:26.957471 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 15:17:26.957471 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 15:17:26.957471 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 15:17:26.957471 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Sep 13 15:17:26.957471 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Sep 13 15:17:26.957471 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 15:17:26.957471 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Sep 13 15:17:26.957471 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:17:26.957471 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:17:26.957471 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:17:26.957471 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:17:26.957471 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:17:26.958690 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:17:26.958690 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:17:26.958690 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:17:26.958690 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:17:26.958690 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:17:26.958690 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:17:26.958690 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 15:17:26.958690 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 15:17:26.958690 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 15:17:26.958690 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 15:17:26.958690 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:17:26.958690 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:17:26.958690 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:17:26.958690 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:17:26.958690 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:17:26.958690 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:17:26.959577 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:17:26.959577 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Sep 13 15:17:26.959577 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:17:26.959577 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:17:26.959577 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:17:26.959577 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:17:26.959577 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:17:26.959577 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:17:26.959577 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:17:26.959577 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:17:26.959577 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 13 15:17:26.959577 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 15:17:26.959577 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 13 15:17:26.959577 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Sep 13 15:17:26.959577 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 592/1165] 10.222.0.27 () {56 vars in 1117 bytes} [Tue Sep 13 15:17:26 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:17:26.964513 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12543c14-6985-4867-a8df-148a35bf2ce6 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:17:27.060145 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12543c14-6985-4867-a8df-148a35bf2ce6 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:17:27.093173 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9942bfa7-6729-4b58-ac3f-5fbead31d622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:17:27.093949 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9942bfa7-6729-4b58-ac3f-5fbead31d622 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:17:27.094233 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9942bfa7-6729-4b58-ac3f-5fbead31d622 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:17:27.094506 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9942bfa7-6729-4b58-ac3f-5fbead31d622 None admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:17:27.095139 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9942bfa7-6729-4b58-ac3f-5fbead31d622 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:17:27.095441 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9942bfa7-6729-4b58-ac3f-5fbead31d622 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:17:27.096782 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9942bfa7-6729-4b58-ac3f-5fbead31d622 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:17:27.103687 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 574/1166] 10.222.0.27 () {56 vars in 1115 bytes} [Tue Sep 13 15:17:26 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:17:29.223947 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a27696-f6ac-44b2-824a-21287d0077a4 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:17:29.224514 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a27696-f6ac-44b2-824a-21287d0077a4 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:17:29.224514 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a27696-f6ac-44b2-824a-21287d0077a4 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:17:29.225869 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 593/1167] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:17:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:17:29.231188 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ffb35e-9283-424c-9562-1b9aa428fe76 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:17:29.231563 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ffb35e-9283-424c-9562-1b9aa428fe76 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:17:29.231736 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ffb35e-9283-424c-9562-1b9aa428fe76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:17:29.245008 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:17:29.250836 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-b6ffb35e-9283-424c-9562-1b9aa428fe76 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:17:29.252014 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-b6ffb35e-9283-424c-9562-1b9aa428fe76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:17:29.316659 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 575/1168] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:17:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 15:17:29.586486 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a27696-f6ac-44b2-824a-21287d0077a4 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:17:29.684331 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a27696-f6ac-44b2-824a-21287d0077a4 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:17:29.718465 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da8d10e-5cbc-4c90-b68a-a0d1c9ad6bcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:17:29.719065 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da8d10e-5cbc-4c90-b68a-a0d1c9ad6bcc None admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:17:29.719344 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da8d10e-5cbc-4c90-b68a-a0d1c9ad6bcc None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:17:29.719615 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da8d10e-5cbc-4c90-b68a-a0d1c9ad6bcc None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:17:29.720289 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da8d10e-5cbc-4c90-b68a-a0d1c9ad6bcc None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:17:29.721642 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da8d10e-5cbc-4c90-b68a-a0d1c9ad6bcc None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:17:29.730828 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:17:29.739476 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 594/1169] 10.222.0.27 () {60 vars in 1138 bytes} [Tue Sep 13 15:17:29 2022] POST /identity/v3/domains => generated 267 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:17:31.918595 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68155ec1-75fe-40fc-9db0-07767c987b45 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:17:31.919122 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68155ec1-75fe-40fc-9db0-07767c987b45 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:17:31.919122 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68155ec1-75fe-40fc-9db0-07767c987b45 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:17:31.921126 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 576/1170] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:17:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:17:31.926561 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35a89ee-2fa6-4457-b6e6-3ad1d0a8d121 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:17:31.926970 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35a89ee-2fa6-4457-b6e6-3ad1d0a8d121 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:17:31.927108 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35a89ee-2fa6-4457-b6e6-3ad1d0a8d121 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:17:31.945940 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-d35a89ee-2fa6-4457-b6e6-3ad1d0a8d121 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:17:31.947109 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-d35a89ee-2fa6-4457-b6e6-3ad1d0a8d121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:17:32.017121 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 595/1171] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:17:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 15:17:32.312388 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68155ec1-75fe-40fc-9db0-07767c987b45 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:17:32.438979 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68155ec1-75fe-40fc-9db0-07767c987b45 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:17:32.477068 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4248f713-9042-4ada-b902-5a0033a96c7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:17:32.478127 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4248f713-9042-4ada-b902-5a0033a96c7e None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:17:32.478419 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4248f713-9042-4ada-b902-5a0033a96c7e None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:17:32.478698 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4248f713-9042-4ada-b902-5a0033a96c7e None admin] PATH_INFO: `/v3/domains/96624288e2304779818987b37b085b16` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:17:32.482712 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:17:32.495473 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4248f713-9042-4ada-b902-5a0033a96c7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=96624288e2304779818987b37b085b16)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:17:32.496926 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4248f713-9042-4ada-b902-5a0033a96c7e None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:17:32.499002 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 577/1172] 10.222.0.27 () {56 vars in 1183 bytes} [Tue Sep 13 15:17:32 2022] GET /identity/v3/domains/96624288e2304779818987b37b085b16 => generated 267 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:17:32.504867 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35a89ee-2fa6-4457-b6e6-3ad1d0a8d121 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:17:32.612765 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35a89ee-2fa6-4457-b6e6-3ad1d0a8d121 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:17:32.641432 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:17:32.649713 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ad1ad8-97ad-49ac-8856-8a3e14d0ff5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:17:32.650346 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ad1ad8-97ad-49ac-8856-8a3e14d0ff5a None admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:17:32.650622 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ad1ad8-97ad-49ac-8856-8a3e14d0ff5a None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:17:32.650892 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ad1ad8-97ad-49ac-8856-8a3e14d0ff5a None admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:17:32.651550 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ad1ad8-97ad-49ac-8856-8a3e14d0ff5a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:17:32.653046 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ad1ad8-97ad-49ac-8856-8a3e14d0ff5a None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:17:32.682257 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 596/1173] 10.222.0.27 () {60 vars in 1141 bytes} [Tue Sep 13 15:17:32 2022] POST /identity/v3/projects => generated 361 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:17:34.861761 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ffe185-7815-4480-bdac-bd3ab7cb4902 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:17:34.862284 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ffe185-7815-4480-bdac-bd3ab7cb4902 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:17:34.862406 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ffe185-7815-4480-bdac-bd3ab7cb4902 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:17:34.863649 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 578/1174] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:17:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:17:34.868888 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdbaa66-456b-43cd-aee6-50ee777653e3 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:17:34.869271 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdbaa66-456b-43cd-aee6-50ee777653e3 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:17:34.869440 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdbaa66-456b-43cd-aee6-50ee777653e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:17:34.887815 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-0cdbaa66-456b-43cd-aee6-50ee777653e3 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:17:34.889155 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-0cdbaa66-456b-43cd-aee6-50ee777653e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:17:34.953265 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 597/1175] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:17:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 15:17:35.222984 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ffe185-7815-4480-bdac-bd3ab7cb4902 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:17:35.322464 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ffe185-7815-4480-bdac-bd3ab7cb4902 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:17:35.354523 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c635a641-6efd-4715-9211-935f81b74265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:17:35.355138 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c635a641-6efd-4715-9211-935f81b74265 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:17:35.355419 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c635a641-6efd-4715-9211-935f81b74265 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:17:35.355699 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c635a641-6efd-4715-9211-935f81b74265 None admin] PATH_INFO: `/v3/domains/96624288e2304779818987b37b085b16` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:17:35.356805 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c635a641-6efd-4715-9211-935f81b74265 None admin] RBAC: Authorizing `identity:get_domain(domain_id=96624288e2304779818987b37b085b16)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:17:35.358958 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c635a641-6efd-4715-9211-935f81b74265 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:17:35.360505 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 579/1176] 10.222.0.27 () {56 vars in 1183 bytes} [Tue Sep 13 15:17:35 2022] GET /identity/v3/domains/96624288e2304779818987b37b085b16 => generated 267 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:17:35.366151 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdbaa66-456b-43cd-aee6-50ee777653e3 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:17:35.463856 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdbaa66-456b-43cd-aee6-50ee777653e3 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:17:35.475268 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:17:35.499853 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e3c44f-e195-4315-a398-825a769aa1a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:17:35.500448 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e3c44f-e195-4315-a398-825a769aa1a2 None admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:17:35.500722 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e3c44f-e195-4315-a398-825a769aa1a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:17:35.500989 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e3c44f-e195-4315-a398-825a769aa1a2 None admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:17:35.501625 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e3c44f-e195-4315-a398-825a769aa1a2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:17:35.503071 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e3c44f-e195-4315-a398-825a769aa1a2 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:17:35.525245 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 598/1177] 10.222.0.27 () {60 vars in 1132 bytes} [Tue Sep 13 15:17:35 2022] POST /identity/v3/users => generated 311 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:17:37.708037 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a22c842-d29a-47eb-8b10-e2c1132fa50a None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:17:37.708573 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a22c842-d29a-47eb-8b10-e2c1132fa50a None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:17:37.708695 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a22c842-d29a-47eb-8b10-e2c1132fa50a None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:17:37.709974 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 580/1178] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:17:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:17:37.715237 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639e961e-2f71-42d6-929b-771483f86b95 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:17:37.715635 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639e961e-2f71-42d6-929b-771483f86b95 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:17:37.715783 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639e961e-2f71-42d6-929b-771483f86b95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:17:37.734958 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-639e961e-2f71-42d6-929b-771483f86b95 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:17:37.736139 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-639e961e-2f71-42d6-929b-771483f86b95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:17:37.800398 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 599/1179] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:17:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 15:17:38.080410 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a22c842-d29a-47eb-8b10-e2c1132fa50a None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:17:38.142624 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:17:38.180854 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a22c842-d29a-47eb-8b10-e2c1132fa50a None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:17:38.216643 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1171020-c87b-4463-828b-c9059ecbdda2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:17:38.217841 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1171020-c87b-4463-828b-c9059ecbdda2 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:17:38.218111 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1171020-c87b-4463-828b-c9059ecbdda2 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:17:38.218377 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1171020-c87b-4463-828b-c9059ecbdda2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:17:38.228734 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1171020-c87b-4463-828b-c9059ecbdda2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 15:17:38.234082 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-a1171020-c87b-4463-828b-c9059ecbdda2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 15:17:38.234082 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:17:38.234082 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:17:38.234082 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:17:38.234082 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:17:38.234082 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:17:38.234082 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:17:38.234082 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:17:38.234082 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:17:38.234082 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:17:38.234082 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:17:38.234082 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:17:38.234082 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 15:17:38.234082 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 15:17:38.234082 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 15:17:38.234082 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 15:17:38.235166 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 15:17:38.235166 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 15:17:38.235166 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 15:17:38.235166 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 15:17:38.235166 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:17:38.235166 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:17:38.235166 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:17:38.235166 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:17:38.235166 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:17:38.235166 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:17:38.235166 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:17:38.235166 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Sep 13 15:17:38.235166 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:17:38.235166 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:17:38.235166 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:17:38.235166 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:17:38.236261 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:17:38.236261 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:17:38.236261 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:17:38.236261 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:17:38.236261 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 15:17:38.236261 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 15:17:38.236261 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 15:17:38.236261 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 15:17:38.236261 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 15:17:38.236261 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 15:17:38.236261 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 15:17:38.236261 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Sep 13 15:17:38.236261 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 581/1180] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Sep 13 15:17:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:17:38.241203 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639e961e-2f71-42d6-929b-771483f86b95 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:17:38.330525 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:17:38.336671 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639e961e-2f71-42d6-929b-771483f86b95 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:17:38.370620 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4462503-bbf6-4575-8a6e-48a20ec4ddc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:17:38.371216 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4462503-bbf6-4575-8a6e-48a20ec4ddc0 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:17:38.371496 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4462503-bbf6-4575-8a6e-48a20ec4ddc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:17:38.371768 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4462503-bbf6-4575-8a6e-48a20ec4ddc0 None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:17:38.372425 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4462503-bbf6-4575-8a6e-48a20ec4ddc0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:17:38.372731 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4462503-bbf6-4575-8a6e-48a20ec4ddc0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:17:38.374132 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4462503-bbf6-4575-8a6e-48a20ec4ddc0 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:17:38.381873 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 600/1181] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Sep 13 15:17:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:17:38.388164 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1171020-c87b-4463-828b-c9059ecbdda2 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:17:38.496137 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1171020-c87b-4463-828b-c9059ecbdda2 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:17:38.519047 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:17:38.531165 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3e079f-8ac7-430c-9fed-fe8ab1ac49bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:17:38.531781 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3e079f-8ac7-430c-9fed-fe8ab1ac49bf None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:17:38.532058 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3e079f-8ac7-430c-9fed-fe8ab1ac49bf None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:17:38.532327 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3e079f-8ac7-430c-9fed-fe8ab1ac49bf None admin] PATH_INFO: `/v3/users/f64e65f7544b4e4abdb9759a9ed93455` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:17:38.545194 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3e079f-8ac7-430c-9fed-fe8ab1ac49bf None admin] RBAC: Authorizing `identity:get_user(user_id=f64e65f7544b4e4abdb9759a9ed93455)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:17:38.546657 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3e079f-8ac7-430c-9fed-fe8ab1ac49bf None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:17:38.548237 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 582/1182] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Sep 13 15:17:38 2022] GET /identity/v3/users/f64e65f7544b4e4abdb9759a9ed93455 => generated 311 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:17:38.554164 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4462503-bbf6-4575-8a6e-48a20ec4ddc0 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:17:38.652128 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4462503-bbf6-4575-8a6e-48a20ec4ddc0 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:17:38.684754 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cdf55b-edff-4330-85b3-06a98cd862b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:17:38.685348 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cdf55b-edff-4330-85b3-06a98cd862b9 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:17:38.685811 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cdf55b-edff-4330-85b3-06a98cd862b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:17:38.686177 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cdf55b-edff-4330-85b3-06a98cd862b9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:17:38.712238 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:17:38.752804 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cdf55b-edff-4330-85b3-06a98cd862b9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:17:38.754302 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cdf55b-edff-4330-85b3-06a98cd862b9 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:17:38.848345 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 601/1183] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Sep 13 15:17:38 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 15:17:38.854255 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3e079f-8ac7-430c-9fed-fe8ab1ac49bf None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:17:38.950654 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3e079f-8ac7-430c-9fed-fe8ab1ac49bf None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:17:38.983389 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48692f42-fff4-4f24-83c7-980a3810b16c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:17:38.984013 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48692f42-fff4-4f24-83c7-980a3810b16c None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:17:38.984293 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48692f42-fff4-4f24-83c7-980a3810b16c None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:17:38.984566 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48692f42-fff4-4f24-83c7-980a3810b16c None admin] PATH_INFO: `/v3/projects/4180991d92f745dc8a510a521e788fa0` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:17:38.985769 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48692f42-fff4-4f24-83c7-980a3810b16c None admin] RBAC: Authorizing `identity:get_project(project_id=4180991d92f745dc8a510a521e788fa0)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:17:38.987182 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48692f42-fff4-4f24-83c7-980a3810b16c None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:17:38.988777 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 583/1184] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Sep 13 15:17:38 2022] GET /identity/v3/projects/4180991d92f745dc8a510a521e788fa0 => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:17:38.994938 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cdf55b-edff-4330-85b3-06a98cd862b9 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:17:39.051100 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:17:39.092943 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cdf55b-edff-4330-85b3-06a98cd862b9 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:17:39.125779 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddec027a-2baa-4f8d-93ca-45ec6e503a76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:17:39.126380 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddec027a-2baa-4f8d-93ca-45ec6e503a76 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:17:39.126663 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddec027a-2baa-4f8d-93ca-45ec6e503a76 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:17:39.126938 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddec027a-2baa-4f8d-93ca-45ec6e503a76 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:17:39.127657 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddec027a-2baa-4f8d-93ca-45ec6e503a76 None admin] RBAC: Adding query filter params (role.id=f34412ad29f1478cba775b033129f71f, scope.project.id=4180991d92f745dc8a510a521e788fa0, user.id=f64e65f7544b4e4abdb9759a9ed93455) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:17:39.127973 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddec027a-2baa-4f8d-93ca-45ec6e503a76 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:17:39.129412 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddec027a-2baa-4f8d-93ca-45ec6e503a76 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:17:39.134654 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 602/1185] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Sep 13 15:17:38 2022] GET /identity/v3/role_assignments?user.id=f64e65f7544b4e4abdb9759a9ed93455&scope.project.id=4180991d92f745dc8a510a521e788fa0&role.id=f34412ad29f1478cba775b033129f71f => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:17:41.255410 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf51a9b-69f5-41a1-a462-3be36581341a None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:17:41.255937 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf51a9b-69f5-41a1-a462-3be36581341a None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:17:41.255937 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf51a9b-69f5-41a1-a462-3be36581341a None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:17:41.257288 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 584/1186] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:17:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:17:41.262656 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56ea268-3a3c-42dd-86d2-cc2caa137710 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:17:41.263076 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56ea268-3a3c-42dd-86d2-cc2caa137710 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:17:41.263204 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56ea268-3a3c-42dd-86d2-cc2caa137710 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:17:41.282270 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-f56ea268-3a3c-42dd-86d2-cc2caa137710 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:17:41.283443 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-f56ea268-3a3c-42dd-86d2-cc2caa137710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:17:41.347080 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 603/1187] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:17:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 15:17:41.619393 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf51a9b-69f5-41a1-a462-3be36581341a None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:17:41.668881 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:17:41.719574 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf51a9b-69f5-41a1-a462-3be36581341a None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:17:41.752634 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027a46aa-a97a-42ed-b99a-235a9a7cc305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:17:41.753251 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027a46aa-a97a-42ed-b99a-235a9a7cc305 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:17:41.753530 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027a46aa-a97a-42ed-b99a-235a9a7cc305 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:17:41.753836 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027a46aa-a97a-42ed-b99a-235a9a7cc305 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:17:41.763507 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027a46aa-a97a-42ed-b99a-235a9a7cc305 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 15:17:41.768525 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-027a46aa-a97a-42ed-b99a-235a9a7cc305 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 15:17:41.768525 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:17:41.768525 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:17:41.768525 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:17:41.768525 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:17:41.768525 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:17:41.768525 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:17:41.768525 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:17:41.768525 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:17:41.768525 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:17:41.768525 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:17:41.768525 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:17:41.768525 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 15:17:41.768525 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 15:17:41.768525 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 15:17:41.768525 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 15:17:41.769627 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 15:17:41.769627 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 15:17:41.769627 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 15:17:41.769627 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 15:17:41.769627 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:17:41.769627 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:17:41.769627 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:17:41.769627 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:17:41.769627 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:17:41.769627 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:17:41.769627 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:17:41.769627 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Sep 13 15:17:41.769627 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:17:41.769627 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:17:41.769627 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:17:41.769627 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:17:41.770544 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:17:41.770544 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:17:41.770544 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:17:41.770544 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:17:41.770544 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 15:17:41.770544 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 15:17:41.770544 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 15:17:41.770544 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 15:17:41.770544 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 15:17:41.770544 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 15:17:41.770544 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 15:17:41.770544 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Sep 13 15:17:41.770544 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 585/1188] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Sep 13 15:17:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:17:41.775744 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56ea268-3a3c-42dd-86d2-cc2caa137710 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:17:41.826416 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:17:41.871954 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56ea268-3a3c-42dd-86d2-cc2caa137710 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:17:41.905877 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48079468-4157-4e4d-96bf-46de69dae2cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:17:41.906485 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48079468-4157-4e4d-96bf-46de69dae2cb None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:17:41.906766 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48079468-4157-4e4d-96bf-46de69dae2cb None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:17:41.907041 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48079468-4157-4e4d-96bf-46de69dae2cb None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:17:41.907698 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48079468-4157-4e4d-96bf-46de69dae2cb None admin] RBAC: Adding query filter params (name=admin) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:17:41.908004 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48079468-4157-4e4d-96bf-46de69dae2cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:17:41.909399 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48079468-4157-4e4d-96bf-46de69dae2cb None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:17:41.917215 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 604/1189] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Sep 13 15:17:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:17:41.923804 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027a46aa-a97a-42ed-b99a-235a9a7cc305 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:17:42.020937 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027a46aa-a97a-42ed-b99a-235a9a7cc305 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:17:42.031912 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:17:42.055431 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e21110-c2f9-4f7f-bafd-3ab73d4176a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:17:42.056048 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e21110-c2f9-4f7f-bafd-3ab73d4176a9 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:17:42.056332 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e21110-c2f9-4f7f-bafd-3ab73d4176a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:17:42.056609 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e21110-c2f9-4f7f-bafd-3ab73d4176a9 None admin] PATH_INFO: `/v3/users/f64e65f7544b4e4abdb9759a9ed93455` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:17:42.057760 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e21110-c2f9-4f7f-bafd-3ab73d4176a9 None admin] RBAC: Authorizing `identity:get_user(user_id=f64e65f7544b4e4abdb9759a9ed93455)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:17:42.059181 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e21110-c2f9-4f7f-bafd-3ab73d4176a9 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:17:42.060870 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 586/1190] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Sep 13 15:17:41 2022] GET /identity/v3/users/f64e65f7544b4e4abdb9759a9ed93455 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:17:42.066998 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48079468-4157-4e4d-96bf-46de69dae2cb None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:17:42.163894 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48079468-4157-4e4d-96bf-46de69dae2cb None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:17:42.177304 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:17:42.197662 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbeb632-04c8-4885-9e71-a79786951692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:17:42.198305 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbeb632-04c8-4885-9e71-a79786951692 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:17:42.198585 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbeb632-04c8-4885-9e71-a79786951692 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:17:42.198858 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbeb632-04c8-4885-9e71-a79786951692 None admin] PATH_INFO: `/v3/projects/4180991d92f745dc8a510a521e788fa0` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:17:42.199958 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbeb632-04c8-4885-9e71-a79786951692 None admin] RBAC: Authorizing `identity:get_project(project_id=4180991d92f745dc8a510a521e788fa0)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:17:42.201400 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbeb632-04c8-4885-9e71-a79786951692 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:17:42.203034 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 605/1191] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Sep 13 15:17:42 2022] GET /identity/v3/projects/4180991d92f745dc8a510a521e788fa0 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:17:42.208852 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e21110-c2f9-4f7f-bafd-3ab73d4176a9 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:17:42.305543 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e21110-c2f9-4f7f-bafd-3ab73d4176a9 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:17:42.338937 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8f22b8-e3e8-4000-8f52-e27dba85910a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:17:42.339579 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8f22b8-e3e8-4000-8f52-e27dba85910a None admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:17:42.339863 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8f22b8-e3e8-4000-8f52-e27dba85910a None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:17:42.340140 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8f22b8-e3e8-4000-8f52-e27dba85910a None admin] PATH_INFO: `/v3/projects/4180991d92f745dc8a510a521e788fa0/users/f64e65f7544b4e4abdb9759a9ed93455/roles/f34412ad29f1478cba775b033129f71f` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:17:42.342209 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8f22b8-e3e8-4000-8f52-e27dba85910a None admin] RBAC: Authorizing `identity:create_grant(project_id=4180991d92f745dc8a510a521e788fa0, user_id=f64e65f7544b4e4abdb9759a9ed93455, role_id=f34412ad29f1478cba775b033129f71f)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:17:42.343622 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8f22b8-e3e8-4000-8f52-e27dba85910a None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:17:42.355757 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 587/1192] 10.222.0.27 () {58 vars in 1439 bytes} [Tue Sep 13 15:17:42 2022] PUT /identity/v3/projects/4180991d92f745dc8a510a521e788fa0/users/f64e65f7544b4e4abdb9759a9ed93455/roles/f34412ad29f1478cba775b033129f71f => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:17:44.507082 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9012de6f-1007-45fd-86a2-826806e6be3e None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:17:44.507612 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9012de6f-1007-45fd-86a2-826806e6be3e None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:17:44.507612 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9012de6f-1007-45fd-86a2-826806e6be3e None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:17:44.508974 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 606/1193] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:17:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:17:44.514355 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e52cda-6b9e-4dd1-9780-1a651e346ce9 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:17:44.514756 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e52cda-6b9e-4dd1-9780-1a651e346ce9 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:17:44.514911 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e52cda-6b9e-4dd1-9780-1a651e346ce9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:17:44.532793 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-f4e52cda-6b9e-4dd1-9780-1a651e346ce9 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:17:44.534021 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-f4e52cda-6b9e-4dd1-9780-1a651e346ce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:17:44.566913 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:17:44.610512 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 588/1194] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:17:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 15:17:44.878947 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9012de6f-1007-45fd-86a2-826806e6be3e None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:17:44.978205 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9012de6f-1007-45fd-86a2-826806e6be3e None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:17:45.010689 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0539859-4efb-461c-88a6-875a0ec3d145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:17:45.011303 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0539859-4efb-461c-88a6-875a0ec3d145 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:17:45.011583 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0539859-4efb-461c-88a6-875a0ec3d145 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:17:45.011857 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0539859-4efb-461c-88a6-875a0ec3d145 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:17:45.022118 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0539859-4efb-461c-88a6-875a0ec3d145 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 15:17:45.026921 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-d0539859-4efb-461c-88a6-875a0ec3d145 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 15:17:45.026921 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:17:45.026921 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:17:45.026921 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:17:45.026921 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:17:45.026921 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:17:45.026921 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:17:45.026921 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:17:45.026921 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:17:45.026921 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:17:45.026921 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:17:45.026921 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:17:45.026921 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 15:17:45.026921 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 15:17:45.026921 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 15:17:45.026921 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 15:17:45.028026 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 15:17:45.028026 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 15:17:45.028026 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 15:17:45.028026 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 15:17:45.028026 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:17:45.028026 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:17:45.028026 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:17:45.028026 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:17:45.028026 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:17:45.028026 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:17:45.028026 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:17:45.028026 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Sep 13 15:17:45.028026 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:17:45.028026 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:17:45.028026 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:17:45.028026 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:17:45.029593 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:17:45.029593 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:17:45.029593 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:17:45.029593 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:17:45.029593 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 15:17:45.029593 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 15:17:45.029593 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 15:17:45.029593 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 15:17:45.029593 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 15:17:45.029593 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 15:17:45.029593 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 15:17:45.029593 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Sep 13 15:17:45.029593 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 607/1195] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Sep 13 15:17:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:17:45.034566 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e52cda-6b9e-4dd1-9780-1a651e346ce9 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:17:45.129941 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e52cda-6b9e-4dd1-9780-1a651e346ce9 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:17:45.162592 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8c6c58-32f6-4c12-9cc8-f03ad62f89d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:17:45.163186 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8c6c58-32f6-4c12-9cc8-f03ad62f89d6 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:17:45.163465 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8c6c58-32f6-4c12-9cc8-f03ad62f89d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:17:45.163738 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8c6c58-32f6-4c12-9cc8-f03ad62f89d6 None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:17:45.164395 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8c6c58-32f6-4c12-9cc8-f03ad62f89d6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:17:45.164698 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8c6c58-32f6-4c12-9cc8-f03ad62f89d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:17:45.166065 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8c6c58-32f6-4c12-9cc8-f03ad62f89d6 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:17:45.173814 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 589/1196] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Sep 13 15:17:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:17:45.179635 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0539859-4efb-461c-88a6-875a0ec3d145 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:17:45.222004 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:17:45.276652 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0539859-4efb-461c-88a6-875a0ec3d145 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:17:45.309185 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297287dd-ca4b-4d7a-ae77-a327c12276b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:17:45.309831 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297287dd-ca4b-4d7a-ae77-a327c12276b5 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:17:45.310156 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297287dd-ca4b-4d7a-ae77-a327c12276b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:17:45.310436 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297287dd-ca4b-4d7a-ae77-a327c12276b5 None admin] PATH_INFO: `/v3/users/f64e65f7544b4e4abdb9759a9ed93455` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:17:45.311553 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297287dd-ca4b-4d7a-ae77-a327c12276b5 None admin] RBAC: Authorizing `identity:get_user(user_id=f64e65f7544b4e4abdb9759a9ed93455)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:17:45.312982 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297287dd-ca4b-4d7a-ae77-a327c12276b5 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:17:45.314568 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 608/1197] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Sep 13 15:17:45 2022] GET /identity/v3/users/f64e65f7544b4e4abdb9759a9ed93455 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:17:45.320532 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8c6c58-32f6-4c12-9cc8-f03ad62f89d6 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:17:45.350937 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:17:45.417756 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8c6c58-32f6-4c12-9cc8-f03ad62f89d6 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:17:45.449402 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8a93d6-9c8a-4b76-b071-355b52ead222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:17:45.450022 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8a93d6-9c8a-4b76-b071-355b52ead222 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:17:45.450306 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8a93d6-9c8a-4b76-b071-355b52ead222 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:17:45.451089 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8a93d6-9c8a-4b76-b071-355b52ead222 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:17:45.514520 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8a93d6-9c8a-4b76-b071-355b52ead222 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:17:45.515947 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8a93d6-9c8a-4b76-b071-355b52ead222 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:17:45.543583 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:17:45.612821 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 590/1198] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Sep 13 15:17:45 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 15:17:45.618711 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297287dd-ca4b-4d7a-ae77-a327c12276b5 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:17:45.715863 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297287dd-ca4b-4d7a-ae77-a327c12276b5 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:17:45.726748 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:17:45.750499 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b206f33b-ce46-4875-b344-6991d37f7c3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:17:45.751114 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b206f33b-ce46-4875-b344-6991d37f7c3f None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:17:45.751391 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b206f33b-ce46-4875-b344-6991d37f7c3f None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:17:45.751664 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b206f33b-ce46-4875-b344-6991d37f7c3f None admin] PATH_INFO: `/v3/projects/4180991d92f745dc8a510a521e788fa0` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:17:45.752757 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b206f33b-ce46-4875-b344-6991d37f7c3f None admin] RBAC: Authorizing `identity:get_project(project_id=4180991d92f745dc8a510a521e788fa0)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:17:45.754212 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b206f33b-ce46-4875-b344-6991d37f7c3f None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:17:45.755805 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 609/1199] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Sep 13 15:17:45 2022] GET /identity/v3/projects/4180991d92f745dc8a510a521e788fa0 => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:17:45.761880 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8a93d6-9c8a-4b76-b071-355b52ead222 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:17:45.856603 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8a93d6-9c8a-4b76-b071-355b52ead222 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:17:45.883852 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:17:45.890280 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8a8a25-606c-4327-b0e5-c49392c55054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:17:45.890870 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8a8a25-606c-4327-b0e5-c49392c55054 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:17:45.891148 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8a8a25-606c-4327-b0e5-c49392c55054 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:17:45.891417 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8a8a25-606c-4327-b0e5-c49392c55054 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:17:45.892155 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8a8a25-606c-4327-b0e5-c49392c55054 None admin] RBAC: Adding query filter params (role.id=f34412ad29f1478cba775b033129f71f, scope.project.id=4180991d92f745dc8a510a521e788fa0, user.id=f64e65f7544b4e4abdb9759a9ed93455) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:17:45.892460 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8a8a25-606c-4327-b0e5-c49392c55054 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:17:45.893956 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8a8a25-606c-4327-b0e5-c49392c55054 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:17:45.899477 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 591/1200] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Sep 13 15:17:45 2022] GET /identity/v3/role_assignments?user.id=f64e65f7544b4e4abdb9759a9ed93455&scope.project.id=4180991d92f745dc8a510a521e788fa0&role.id=f34412ad29f1478cba775b033129f71f => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:17:55.746055 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=11 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:17:55.896952 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=3 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:18:41.382952 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bee2081-2652-4b6e-829e-ea85a0fc4ce4 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:18:41.383605 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bee2081-2652-4b6e-829e-ea85a0fc4ce4 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:18:41.383605 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bee2081-2652-4b6e-829e-ea85a0fc4ce4 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:18:41.386126 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 610/1201] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:18:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:18:41.395056 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dc8662-c0cb-485b-9cdc-17ff669da4ce None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:18:41.395713 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dc8662-c0cb-485b-9cdc-17ff669da4ce None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:18:41.395713 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dc8662-c0cb-485b-9cdc-17ff669da4ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:18:41.418024 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-e0dc8662-c0cb-485b-9cdc-17ff669da4ce None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:18:41.419300 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-e0dc8662-c0cb-485b-9cdc-17ff669da4ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:18:41.505446 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 592/1202] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:18:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 15:18:41.788264 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bee2081-2652-4b6e-829e-ea85a0fc4ce4 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:18:41.920036 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bee2081-2652-4b6e-829e-ea85a0fc4ce4 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:18:41.961414 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd809fe3-048a-4d4e-9a9c-31a54a3418f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:18:41.962158 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd809fe3-048a-4d4e-9a9c-31a54a3418f6 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:18:41.962557 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd809fe3-048a-4d4e-9a9c-31a54a3418f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:18:41.962921 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd809fe3-048a-4d4e-9a9c-31a54a3418f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:18:41.974674 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd809fe3-048a-4d4e-9a9c-31a54a3418f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:18:41.976305 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd809fe3-048a-4d4e-9a9c-31a54a3418f6 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:18:41.995866 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-bd809fe3-048a-4d4e-9a9c-31a54a3418f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 15:18:41.995866 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:18:41.995866 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:18:41.995866 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:18:41.995866 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:18:41.995866 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:18:41.995866 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:18:41.995866 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:18:41.995866 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:18:41.995866 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:18:41.995866 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:18:41.995866 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:18:41.995866 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 15:18:41.995866 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 15:18:41.995866 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 15:18:41.995866 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 15:18:41.997023 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:18:41.997023 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:18:41.997023 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:18:41.997023 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:18:41.997023 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:18:41.997023 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:18:41.997023 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:18:41.997023 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Sep 13 15:18:41.997023 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:18:41.997023 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:18:41.997023 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:18:41.997023 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:18:41.997023 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:18:41.997023 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:18:41.997023 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:18:41.997023 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:18:41.997023 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 15:18:41.998080 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 15:18:41.998080 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 15:18:41.998080 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Sep 13 15:18:42.002275 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 611/1203] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 13 15:18:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:18:42.003459 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dc8662-c0cb-485b-9cdc-17ff669da4ce None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:18:42.142494 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dc8662-c0cb-485b-9cdc-17ff669da4ce None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:18:42.182217 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:18:42.189450 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaedf8ae-f06a-4433-8970-f1b501934f9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:18:42.190193 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaedf8ae-f06a-4433-8970-f1b501934f9d None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:18:42.190499 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaedf8ae-f06a-4433-8970-f1b501934f9d None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:18:42.190779 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaedf8ae-f06a-4433-8970-f1b501934f9d None admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:18:42.191485 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaedf8ae-f06a-4433-8970-f1b501934f9d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:18:42.191797 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaedf8ae-f06a-4433-8970-f1b501934f9d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:18:42.193170 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaedf8ae-f06a-4433-8970-f1b501934f9d None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:18:42.215359 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 593/1204] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Sep 13 15:18:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:18:42.221426 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd809fe3-048a-4d4e-9a9c-31a54a3418f6 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:18:42.306196 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:18:42.371111 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd809fe3-048a-4d4e-9a9c-31a54a3418f6 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:18:42.413437 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217dc50e-f36c-4408-bec1-fd4d31735ed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:18:42.414847 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217dc50e-f36c-4408-bec1-fd4d31735ed7 None admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:18:42.415131 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217dc50e-f36c-4408-bec1-fd4d31735ed7 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:18:42.415927 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217dc50e-f36c-4408-bec1-fd4d31735ed7 None admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:18:42.416577 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217dc50e-f36c-4408-bec1-fd4d31735ed7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:18:42.418210 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217dc50e-f36c-4408-bec1-fd4d31735ed7 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:18:42.447382 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 612/1205] 10.222.0.27 () {60 vars in 1132 bytes} [Tue Sep 13 15:18:42 2022] POST /identity/v3/users => generated 251 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:18:44.896010 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2181957e-af8d-4c7f-9b45-3bd197c6edb8 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:18:44.896578 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2181957e-af8d-4c7f-9b45-3bd197c6edb8 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:18:44.896578 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2181957e-af8d-4c7f-9b45-3bd197c6edb8 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:18:44.898234 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 594/1206] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:18:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 15:18:44.904854 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec7d0f1-adb7-4f40-8793-258b61929b25 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:18:44.905401 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec7d0f1-adb7-4f40-8793-258b61929b25 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:18:44.905494 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec7d0f1-adb7-4f40-8793-258b61929b25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:18:44.929736 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-0ec7d0f1-adb7-4f40-8793-258b61929b25 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:18:44.929736 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-0ec7d0f1-adb7-4f40-8793-258b61929b25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:18:45.010660 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 613/1207] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:18:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 15:18:45.282525 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2181957e-af8d-4c7f-9b45-3bd197c6edb8 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:18:45.395651 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2181957e-af8d-4c7f-9b45-3bd197c6edb8 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:18:45.440293 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa75f72-bf17-4a54-a655-ec9ddf08c09c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:18:45.441059 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa75f72-bf17-4a54-a655-ec9ddf08c09c None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:18:45.442655 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa75f72-bf17-4a54-a655-ec9ddf08c09c None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:18:45.442655 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa75f72-bf17-4a54-a655-ec9ddf08c09c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:18:45.453958 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa75f72-bf17-4a54-a655-ec9ddf08c09c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 15:18:45.459747 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-8fa75f72-bf17-4a54-a655-ec9ddf08c09c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 15:18:45.459747 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:18:45.459747 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:18:45.459747 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:18:45.459747 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:18:45.459747 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:18:45.459747 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:18:45.459747 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:18:45.459747 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:18:45.459747 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:18:45.459747 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:18:45.459747 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:18:45.459747 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 15:18:45.459747 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 15:18:45.459747 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 15:18:45.459747 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 15:18:45.460778 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 15:18:45.460778 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 15:18:45.460778 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 15:18:45.460778 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 15:18:45.460778 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:18:45.460778 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:18:45.460778 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:18:45.460778 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:18:45.460778 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:18:45.460778 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:18:45.460778 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:18:45.460778 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Sep 13 15:18:45.460778 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:18:45.460778 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:18:45.460778 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:18:45.460778 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:18:45.461630 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:18:45.461630 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:18:45.461630 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:18:45.461630 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:18:45.461630 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 15:18:45.461630 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 15:18:45.461630 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 15:18:45.461630 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 15:18:45.461630 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 15:18:45.461630 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 15:18:45.461630 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 15:18:45.461630 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Sep 13 15:18:45.461630 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 595/1208] 10.222.0.27 () {56 vars in 1102 bytes} [Tue Sep 13 15:18:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:18:45.468629 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec7d0f1-adb7-4f40-8793-258b61929b25 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:18:45.519013 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:18:45.591125 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec7d0f1-adb7-4f40-8793-258b61929b25 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:18:45.633977 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60573ed5-0c36-4fd8-849d-517f88667934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:18:45.634620 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60573ed5-0c36-4fd8-849d-517f88667934 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:18:45.635049 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60573ed5-0c36-4fd8-849d-517f88667934 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:18:45.635359 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60573ed5-0c36-4fd8-849d-517f88667934 None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:18:45.636003 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60573ed5-0c36-4fd8-849d-517f88667934 None admin] RBAC: Adding query filter params (name=service) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:18:45.636433 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60573ed5-0c36-4fd8-849d-517f88667934 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:18:45.637972 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60573ed5-0c36-4fd8-849d-517f88667934 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:18:45.647935 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 614/1209] 10.222.0.27 () {56 vars in 1103 bytes} [Tue Sep 13 15:18:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:18:45.655336 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa75f72-bf17-4a54-a655-ec9ddf08c09c None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:18:45.714172 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:18:45.773481 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa75f72-bf17-4a54-a655-ec9ddf08c09c None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:18:45.812388 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c79af9a-6515-49dc-b2d9-47322623c0d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:18:45.813114 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c79af9a-6515-49dc-b2d9-47322623c0d3 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:18:45.813742 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c79af9a-6515-49dc-b2d9-47322623c0d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:18:45.814090 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c79af9a-6515-49dc-b2d9-47322623c0d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:18:45.826182 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c79af9a-6515-49dc-b2d9-47322623c0d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:18:45.827860 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c79af9a-6515-49dc-b2d9-47322623c0d3 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:18:45.844108 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-8c79af9a-6515-49dc-b2d9-47322623c0d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 15:18:45.844108 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:18:45.844108 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:18:45.844108 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:18:45.844108 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:18:45.844108 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:18:45.844108 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:18:45.844108 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:18:45.844108 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:18:45.844108 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:18:45.844108 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:18:45.844108 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:18:45.844108 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 15:18:45.844108 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 15:18:45.844108 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 15:18:45.844108 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 15:18:45.845443 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:18:45.845443 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:18:45.845443 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:18:45.845443 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:18:45.845443 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:18:45.845443 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:18:45.845443 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:18:45.845443 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Sep 13 15:18:45.845443 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:18:45.845443 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:18:45.845443 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:18:45.845443 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:18:45.845443 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:18:45.845443 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:18:45.845443 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:18:45.845443 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:18:45.845443 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 15:18:45.846628 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 15:18:45.846628 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 15:18:45.846628 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Sep 13 15:18:45.846628 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 596/1210] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 13 15:18:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 15:18:45.853873 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60573ed5-0c36-4fd8-849d-517f88667934 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:18:45.970799 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:18:45.974537 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60573ed5-0c36-4fd8-849d-517f88667934 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:18:46.016963 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d97886-a1a8-404c-b395-b94054f2bae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:18:46.017734 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d97886-a1a8-404c-b395-b94054f2bae3 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:18:46.018038 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d97886-a1a8-404c-b395-b94054f2bae3 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:18:46.018330 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d97886-a1a8-404c-b395-b94054f2bae3 None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:18:46.019108 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d97886-a1a8-404c-b395-b94054f2bae3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:18:46.019447 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d97886-a1a8-404c-b395-b94054f2bae3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:18:46.021040 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d97886-a1a8-404c-b395-b94054f2bae3 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:18:46.049734 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 615/1211] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Sep 13 15:18:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:18:46.049952 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c79af9a-6515-49dc-b2d9-47322623c0d3 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:18:46.160914 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c79af9a-6515-49dc-b2d9-47322623c0d3 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:18:46.162792 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:18:46.204530 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5a7281-8541-43a4-a7f7-fea94928d7ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:18:46.205159 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5a7281-8541-43a4-a7f7-fea94928d7ce None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:18:46.205441 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5a7281-8541-43a4-a7f7-fea94928d7ce None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:18:46.205734 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5a7281-8541-43a4-a7f7-fea94928d7ce None admin] PATH_INFO: `/v3/users/placement` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:18:46.214019 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5a7281-8541-43a4-a7f7-fea94928d7ce None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:18:46.215448 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5a7281-8541-43a4-a7f7-fea94928d7ce None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:18:46.227591 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-cc5a7281-8541-43a4-a7f7-fea94928d7ce None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 13 15:18:46.227591 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:18:46.227591 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:18:46.227591 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:18:46.227591 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:18:46.227591 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:18:46.227591 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:18:46.227591 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:18:46.227591 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:18:46.227591 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:18:46.227591 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:18:46.227591 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:18:46.227591 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 15:18:46.227591 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 15:18:46.227591 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 15:18:46.227591 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 15:18:46.229114 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:18:46.229114 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:18:46.229114 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 15:18:46.229114 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 15:18:46.229114 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 15:18:46.229114 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 15:18:46.229114 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:18:46.229114 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:18:46.229114 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:18:46.229114 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:18:46.229114 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:18:46.229114 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Sep 13 15:18:46.229114 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:18:46.229114 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:18:46.229114 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:18:46.229114 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:18:46.229114 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:18:46.229114 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:18:46.230121 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:18:46.230121 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:18:46.230121 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 15:18:46.230121 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 15:18:46.230121 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 15:18:46.230121 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 15:18:46.230121 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 15:18:46.230121 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 15:18:46.230121 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 13 15:18:46.230121 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Sep 13 15:18:46.230121 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 597/1212] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 13 15:18:46 2022] GET /identity/v3/users/placement => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 15:18:46.235603 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d97886-a1a8-404c-b395-b94054f2bae3 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:18:46.366794 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d97886-a1a8-404c-b395-b94054f2bae3 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:18:46.407043 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8146848a-d385-46a3-9114-81290e33eade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:18:46.407789 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8146848a-d385-46a3-9114-81290e33eade None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:18:46.408105 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8146848a-d385-46a3-9114-81290e33eade None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:18:46.408417 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8146848a-d385-46a3-9114-81290e33eade None admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:18:46.409272 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8146848a-d385-46a3-9114-81290e33eade None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:18:46.409590 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8146848a-d385-46a3-9114-81290e33eade None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:18:46.411241 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8146848a-d385-46a3-9114-81290e33eade None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:18:46.437649 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 616/1213] 10.222.0.27 () {56 vars in 1143 bytes} [Tue Sep 13 15:18:46 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:18:46.439308 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5a7281-8541-43a4-a7f7-fea94928d7ce None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:18:46.557672 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5a7281-8541-43a4-a7f7-fea94928d7ce None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:18:46.600595 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7ba6fb-56fa-471f-81d3-96e066a0258f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:18:46.601680 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7ba6fb-56fa-471f-81d3-96e066a0258f None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:18:46.602174 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7ba6fb-56fa-471f-81d3-96e066a0258f None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:18:46.603408 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7ba6fb-56fa-471f-81d3-96e066a0258f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:18:46.636436 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:18:46.682312 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7ba6fb-56fa-471f-81d3-96e066a0258f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:18:46.684011 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7ba6fb-56fa-471f-81d3-96e066a0258f None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:18:46.825790 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 598/1214] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Sep 13 15:18:46 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 15:18:46.827591 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8146848a-d385-46a3-9114-81290e33eade None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:18:46.851379 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:18:46.956636 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8146848a-d385-46a3-9114-81290e33eade None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:18:46.998509 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a036a325-18b3-42e4-b36c-8153e57c8e68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:18:46.999176 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a036a325-18b3-42e4-b36c-8153e57c8e68 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:18:46.999418 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a036a325-18b3-42e4-b36c-8153e57c8e68 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:18:46.999682 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a036a325-18b3-42e4-b36c-8153e57c8e68 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:18:47.011308 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a036a325-18b3-42e4-b36c-8153e57c8e68 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:18:47.012776 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a036a325-18b3-42e4-b36c-8153e57c8e68 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:18:47.028789 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-a036a325-18b3-42e4-b36c-8153e57c8e68 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 15:18:47.028789 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:18:47.028789 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:18:47.028789 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:18:47.028789 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:18:47.028789 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:18:47.028789 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:18:47.028789 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:18:47.028789 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:18:47.028789 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:18:47.028789 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:18:47.028789 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:18:47.028789 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 15:18:47.028789 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 15:18:47.028789 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 15:18:47.028789 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 15:18:47.030287 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:18:47.030287 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:18:47.030287 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:18:47.030287 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:18:47.030287 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:18:47.030287 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:18:47.030287 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:18:47.030287 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Sep 13 15:18:47.030287 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:18:47.030287 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:18:47.030287 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:18:47.030287 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:18:47.030287 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:18:47.030287 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:18:47.030287 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:18:47.030287 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:18:47.030287 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 15:18:47.031208 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 15:18:47.031208 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 15:18:47.031208 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Sep 13 15:18:47.031208 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 617/1215] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 13 15:18:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:18:47.036008 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7ba6fb-56fa-471f-81d3-96e066a0258f None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:18:47.115770 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:18:47.162789 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7ba6fb-56fa-471f-81d3-96e066a0258f None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:18:47.203261 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26055c7-ca27-4184-9685-94108c8942ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:18:47.203916 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26055c7-ca27-4184-9685-94108c8942ad None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:18:47.204198 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26055c7-ca27-4184-9685-94108c8942ad None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:18:47.204473 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26055c7-ca27-4184-9685-94108c8942ad None admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:18:47.205114 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26055c7-ca27-4184-9685-94108c8942ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:18:47.205420 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26055c7-ca27-4184-9685-94108c8942ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:18:47.206897 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26055c7-ca27-4184-9685-94108c8942ad None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:18:47.220137 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 599/1216] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Sep 13 15:18:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:18:47.226053 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a036a325-18b3-42e4-b36c-8153e57c8e68 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:18:47.300638 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:18:47.333074 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a036a325-18b3-42e4-b36c-8153e57c8e68 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:18:47.369889 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cd5f58-9a68-43c0-84e4-71bbd5e8b3d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:18:47.370532 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cd5f58-9a68-43c0-84e4-71bbd5e8b3d1 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:18:47.370819 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cd5f58-9a68-43c0-84e4-71bbd5e8b3d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:18:47.371098 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cd5f58-9a68-43c0-84e4-71bbd5e8b3d1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:18:47.378080 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cd5f58-9a68-43c0-84e4-71bbd5e8b3d1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:18:47.379786 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cd5f58-9a68-43c0-84e4-71bbd5e8b3d1 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:18:47.395840 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-95cd5f58-9a68-43c0-84e4-71bbd5e8b3d1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 15:18:47.395840 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:18:47.395840 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:18:47.395840 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:18:47.395840 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:18:47.395840 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:18:47.395840 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:18:47.395840 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:18:47.395840 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:18:47.395840 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:18:47.395840 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:18:47.395840 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:18:47.395840 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 15:18:47.395840 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 15:18:47.395840 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 15:18:47.397052 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 15:18:47.397052 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:18:47.397052 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:18:47.397052 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:18:47.397052 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:18:47.397052 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:18:47.397052 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:18:47.397052 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:18:47.397052 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Sep 13 15:18:47.397052 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:18:47.397052 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:18:47.397052 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:18:47.397052 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:18:47.397052 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:18:47.397052 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:18:47.397052 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:18:47.397052 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:18:47.398069 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 15:18:47.398069 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 15:18:47.398069 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 15:18:47.398069 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 15:18:47.398069 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 15:18:47.398069 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 15:18:47.398069 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 15:18:47.398069 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Sep 13 15:18:47.398069 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 618/1217] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Sep 13 15:18:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:18:47.404378 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26055c7-ca27-4184-9685-94108c8942ad None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:18:47.516042 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26055c7-ca27-4184-9685-94108c8942ad None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:18:47.540884 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:18:47.554097 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e4bb13-26bb-4ac0-b026-156d821abc99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:18:47.554824 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e4bb13-26bb-4ac0-b026-156d821abc99 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:18:47.555109 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e4bb13-26bb-4ac0-b026-156d821abc99 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:18:47.555417 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e4bb13-26bb-4ac0-b026-156d821abc99 None admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:18:47.556385 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e4bb13-26bb-4ac0-b026-156d821abc99 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:18:47.556697 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e4bb13-26bb-4ac0-b026-156d821abc99 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:18:47.558276 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e4bb13-26bb-4ac0-b026-156d821abc99 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:18:47.572918 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 600/1218] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Sep 13 15:18:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:18:47.579185 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cd5f58-9a68-43c0-84e4-71bbd5e8b3d1 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:18:47.683508 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cd5f58-9a68-43c0-84e4-71bbd5e8b3d1 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:18:47.718026 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:18:47.725864 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77beb23b-5c46-420c-9ba1-7c1766993508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:18:47.726605 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77beb23b-5c46-420c-9ba1-7c1766993508 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:18:47.726915 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77beb23b-5c46-420c-9ba1-7c1766993508 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:18:47.727905 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77beb23b-5c46-420c-9ba1-7c1766993508 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:18:47.728747 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77beb23b-5c46-420c-9ba1-7c1766993508 None admin] RBAC: Adding query filter params (role.id=470736c596a14fa5ac78200239aa1104, scope.project.id=3d6e00339cfa47d2a6fa8724c587035f, user.id=5b56f96cb3184a3ba82c8a0c3427e268) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:18:47.729062 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77beb23b-5c46-420c-9ba1-7c1766993508 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:18:47.730538 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77beb23b-5c46-420c-9ba1-7c1766993508 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:18:47.736904 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 619/1219] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Sep 13 15:18:47 2022] GET /identity/v3/role_assignments?user.id=5b56f96cb3184a3ba82c8a0c3427e268&scope.project.id=3d6e00339cfa47d2a6fa8724c587035f&role.id=470736c596a14fa5ac78200239aa1104 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 15:18:50.037473 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db67fc7-954a-46a8-94b9-d03a4251c003 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:18:50.038103 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db67fc7-954a-46a8-94b9-d03a4251c003 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:18:50.038103 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db67fc7-954a-46a8-94b9-d03a4251c003 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:18:50.039334 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 601/1220] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:18:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:18:50.045272 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd2be96-093d-4461-808c-61a31f1fe4e8 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:18:50.045746 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd2be96-093d-4461-808c-61a31f1fe4e8 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:18:50.045856 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd2be96-093d-4461-808c-61a31f1fe4e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:18:50.067306 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-7bd2be96-093d-4461-808c-61a31f1fe4e8 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:18:50.068493 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-7bd2be96-093d-4461-808c-61a31f1fe4e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:18:50.143419 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 620/1221] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:18:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 15:18:50.450651 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db67fc7-954a-46a8-94b9-d03a4251c003 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:18:50.562115 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db67fc7-954a-46a8-94b9-d03a4251c003 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:18:50.598326 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8027dfb-95ca-484d-a37e-eed909d262eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:18:50.598972 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8027dfb-95ca-484d-a37e-eed909d262eb None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:18:50.599220 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8027dfb-95ca-484d-a37e-eed909d262eb None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:18:50.599488 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8027dfb-95ca-484d-a37e-eed909d262eb None admin] PATH_INFO: `/v3/roles/service` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:18:50.610363 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8027dfb-95ca-484d-a37e-eed909d262eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 15:18:50.615133 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-a8027dfb-95ca-484d-a37e-eed909d262eb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 15:18:50.615133 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:18:50.615133 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:18:50.615133 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:18:50.615133 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:18:50.615133 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:18:50.615133 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:18:50.615133 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:18:50.615133 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:18:50.615133 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:18:50.615133 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:18:50.615133 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:18:50.615133 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 15:18:50.615133 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 15:18:50.615133 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 15:18:50.615133 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 15:18:50.616176 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 15:18:50.616176 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 15:18:50.616176 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 15:18:50.616176 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 15:18:50.616176 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:18:50.616176 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:18:50.616176 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:18:50.616176 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:18:50.616176 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:18:50.616176 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:18:50.616176 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:18:50.616176 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Sep 13 15:18:50.616176 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:18:50.616176 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:18:50.616176 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:18:50.616176 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:18:50.617046 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:18:50.617046 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:18:50.617046 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:18:50.617046 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:18:50.617046 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 15:18:50.617046 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 15:18:50.617046 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 15:18:50.617046 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 15:18:50.617046 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 15:18:50.617046 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 15:18:50.617046 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 15:18:50.617046 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Sep 13 15:18:50.617046 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 602/1222] 10.222.0.27 () {56 vars in 1102 bytes} [Tue Sep 13 15:18:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:18:50.623095 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd2be96-093d-4461-808c-61a31f1fe4e8 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:18:50.730202 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd2be96-093d-4461-808c-61a31f1fe4e8 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:18:50.762619 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:18:50.778091 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2b18f0-d207-4e72-9109-323c6188a042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:18:50.778726 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2b18f0-d207-4e72-9109-323c6188a042 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:18:50.779073 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2b18f0-d207-4e72-9109-323c6188a042 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:18:50.779351 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2b18f0-d207-4e72-9109-323c6188a042 None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:18:50.780078 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2b18f0-d207-4e72-9109-323c6188a042 None admin] RBAC: Adding query filter params (name=service) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:18:50.780384 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2b18f0-d207-4e72-9109-323c6188a042 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:18:50.781912 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2b18f0-d207-4e72-9109-323c6188a042 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:18:50.796529 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 621/1223] 10.222.0.27 () {56 vars in 1103 bytes} [Tue Sep 13 15:18:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:18:50.797769 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8027dfb-95ca-484d-a37e-eed909d262eb None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:18:50.846273 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:18:50.913007 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8027dfb-95ca-484d-a37e-eed909d262eb None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:18:50.951082 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080df43d-55a7-4e06-b4b9-0acea30bdf76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:18:50.951751 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080df43d-55a7-4e06-b4b9-0acea30bdf76 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:18:50.952024 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080df43d-55a7-4e06-b4b9-0acea30bdf76 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:18:50.952314 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080df43d-55a7-4e06-b4b9-0acea30bdf76 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:18:50.968476 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080df43d-55a7-4e06-b4b9-0acea30bdf76 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:18:50.968476 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080df43d-55a7-4e06-b4b9-0acea30bdf76 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:18:50.984529 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-080df43d-55a7-4e06-b4b9-0acea30bdf76 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 15:18:50.984529 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:18:50.984529 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:18:50.984529 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:18:50.984529 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:18:50.984529 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:18:50.984529 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:18:50.984529 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:18:50.984529 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:18:50.984529 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:18:50.984529 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:18:50.984529 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:18:50.984529 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 15:18:50.984529 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 15:18:50.984529 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 15:18:50.984529 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 15:18:50.985553 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:18:50.985553 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:18:50.985553 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:18:50.985553 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:18:50.985553 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:18:50.985553 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:18:50.985553 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:18:50.985553 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Sep 13 15:18:50.985553 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:18:50.985553 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:18:50.985553 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:18:50.985553 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:18:50.985553 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:18:50.985553 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:18:50.985553 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:18:50.985553 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:18:50.985553 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 15:18:50.986891 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 15:18:50.986891 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 15:18:50.986891 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Sep 13 15:18:50.986891 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 603/1224] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 13 15:18:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 15:18:50.991561 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2b18f0-d207-4e72-9109-323c6188a042 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:18:51.103176 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2b18f0-d207-4e72-9109-323c6188a042 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:18:51.141574 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af63227-1f0d-4975-9a2f-f7fd225fad2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:18:51.142214 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af63227-1f0d-4975-9a2f-f7fd225fad2d None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:18:51.142492 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af63227-1f0d-4975-9a2f-f7fd225fad2d None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:18:51.142762 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af63227-1f0d-4975-9a2f-f7fd225fad2d None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:18:51.143393 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af63227-1f0d-4975-9a2f-f7fd225fad2d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:18:51.143695 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af63227-1f0d-4975-9a2f-f7fd225fad2d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:18:51.145050 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af63227-1f0d-4975-9a2f-f7fd225fad2d None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:18:51.158433 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 622/1225] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Sep 13 15:18:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:18:51.164169 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080df43d-55a7-4e06-b4b9-0acea30bdf76 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:18:51.260464 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:18:51.267100 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080df43d-55a7-4e06-b4b9-0acea30bdf76 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:18:51.304435 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270771e5-c060-4c5c-a318-eaeaa365a539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:18:51.305809 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270771e5-c060-4c5c-a318-eaeaa365a539 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:18:51.306275 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270771e5-c060-4c5c-a318-eaeaa365a539 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:18:51.306536 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270771e5-c060-4c5c-a318-eaeaa365a539 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:18:51.315229 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270771e5-c060-4c5c-a318-eaeaa365a539 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:18:51.316656 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270771e5-c060-4c5c-a318-eaeaa365a539 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:18:51.329395 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-270771e5-c060-4c5c-a318-eaeaa365a539 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 13 15:18:51.329395 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:18:51.329395 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:18:51.329395 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:18:51.329395 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:18:51.329395 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:18:51.329395 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:18:51.329395 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:18:51.329395 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:18:51.329395 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:18:51.329395 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:18:51.329395 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:18:51.329395 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 15:18:51.329395 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 15:18:51.329395 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 15:18:51.329395 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 15:18:51.330601 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:18:51.330601 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:18:51.330601 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 15:18:51.330601 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 15:18:51.330601 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 15:18:51.330601 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 15:18:51.330601 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:18:51.330601 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:18:51.330601 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:18:51.330601 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:18:51.330601 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:18:51.330601 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Sep 13 15:18:51.330601 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:18:51.330601 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:18:51.330601 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:18:51.330601 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:18:51.330601 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:18:51.330601 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:18:51.332060 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:18:51.332060 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:18:51.332060 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 15:18:51.332060 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 15:18:51.332060 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 15:18:51.332060 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 15:18:51.332060 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 15:18:51.332060 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 15:18:51.332060 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 13 15:18:51.332060 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Sep 13 15:18:51.332060 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 604/1226] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 13 15:18:51 2022] GET /identity/v3/users/placement => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:18:51.336962 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af63227-1f0d-4975-9a2f-f7fd225fad2d None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:18:51.390245 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:18:51.457686 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af63227-1f0d-4975-9a2f-f7fd225fad2d None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:18:51.495800 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebf50be-bbaf-47fc-8ff9-3d1825ad0316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:18:51.496414 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebf50be-bbaf-47fc-8ff9-3d1825ad0316 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:18:51.496703 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebf50be-bbaf-47fc-8ff9-3d1825ad0316 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:18:51.496976 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebf50be-bbaf-47fc-8ff9-3d1825ad0316 None admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:18:51.497723 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebf50be-bbaf-47fc-8ff9-3d1825ad0316 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:18:51.498058 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebf50be-bbaf-47fc-8ff9-3d1825ad0316 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:18:51.499510 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebf50be-bbaf-47fc-8ff9-3d1825ad0316 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:18:51.518332 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 623/1227] 10.222.0.27 () {56 vars in 1143 bytes} [Tue Sep 13 15:18:51 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:18:51.524854 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270771e5-c060-4c5c-a318-eaeaa365a539 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:18:51.630433 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270771e5-c060-4c5c-a318-eaeaa365a539 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:18:51.666897 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd09beb-33cf-44bd-8b96-be443e3df552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:18:51.667565 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd09beb-33cf-44bd-8b96-be443e3df552 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:18:51.667886 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd09beb-33cf-44bd-8b96-be443e3df552 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:18:51.668221 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd09beb-33cf-44bd-8b96-be443e3df552 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:18:51.679081 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd09beb-33cf-44bd-8b96-be443e3df552 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:18:51.680632 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd09beb-33cf-44bd-8b96-be443e3df552 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:18:51.695826 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-bcd09beb-33cf-44bd-8b96-be443e3df552 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 15:18:51.695826 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:18:51.695826 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:18:51.695826 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:18:51.695826 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:18:51.695826 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:18:51.695826 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:18:51.695826 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:18:51.695826 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:18:51.695826 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:18:51.695826 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:18:51.695826 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:18:51.695826 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 15:18:51.695826 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 15:18:51.695826 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 15:18:51.695826 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 15:18:51.697158 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:18:51.697158 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:18:51.697158 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:18:51.697158 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:18:51.697158 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:18:51.697158 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:18:51.697158 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:18:51.697158 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Sep 13 15:18:51.697158 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:18:51.697158 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:18:51.697158 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:18:51.697158 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:18:51.697158 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:18:51.697158 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:18:51.697158 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:18:51.697158 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:18:51.697158 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 15:18:51.698370 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 15:18:51.698370 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 15:18:51.698370 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Sep 13 15:18:51.698370 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 605/1228] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 13 15:18:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:18:51.702877 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebf50be-bbaf-47fc-8ff9-3d1825ad0316 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:18:51.812839 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebf50be-bbaf-47fc-8ff9-3d1825ad0316 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:18:51.815528 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:18:51.850863 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5fcb5c-0805-4c4f-a869-3ea77cac9f74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:18:51.851695 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5fcb5c-0805-4c4f-a869-3ea77cac9f74 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:18:51.852649 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5fcb5c-0805-4c4f-a869-3ea77cac9f74 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:18:51.852977 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5fcb5c-0805-4c4f-a869-3ea77cac9f74 None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:18:51.853616 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5fcb5c-0805-4c4f-a869-3ea77cac9f74 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:18:51.853960 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5fcb5c-0805-4c4f-a869-3ea77cac9f74 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:18:51.855465 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5fcb5c-0805-4c4f-a869-3ea77cac9f74 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:18:51.868805 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 624/1229] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Sep 13 15:18:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:18:51.874989 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd09beb-33cf-44bd-8b96-be443e3df552 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:18:51.886192 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:18:52.003112 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd09beb-33cf-44bd-8b96-be443e3df552 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:18:52.040311 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dc6f3c-f1a3-46a7-89bd-e12042681b58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:18:52.040941 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dc6f3c-f1a3-46a7-89bd-e12042681b58 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:18:52.041224 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dc6f3c-f1a3-46a7-89bd-e12042681b58 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:18:52.041495 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dc6f3c-f1a3-46a7-89bd-e12042681b58 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:18:52.048353 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dc6f3c-f1a3-46a7-89bd-e12042681b58 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:18:52.049821 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dc6f3c-f1a3-46a7-89bd-e12042681b58 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:18:52.064046 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-d9dc6f3c-f1a3-46a7-89bd-e12042681b58 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 15:18:52.064046 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:18:52.064046 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:18:52.064046 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:18:52.064046 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:18:52.064046 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:18:52.064046 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:18:52.064046 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:18:52.064046 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:18:52.064046 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:18:52.064046 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:18:52.064046 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:18:52.064046 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 15:18:52.064046 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 15:18:52.064046 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 15:18:52.065134 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 15:18:52.065134 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:18:52.065134 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:18:52.065134 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:18:52.065134 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:18:52.065134 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:18:52.065134 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:18:52.065134 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:18:52.065134 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Sep 13 15:18:52.065134 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:18:52.065134 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:18:52.065134 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:18:52.065134 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:18:52.065134 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:18:52.065134 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:18:52.065134 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:18:52.065134 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:18:52.066464 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 15:18:52.066464 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 15:18:52.066464 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 15:18:52.066464 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 15:18:52.066464 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 15:18:52.066464 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 15:18:52.066464 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 15:18:52.066464 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Sep 13 15:18:52.066464 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 606/1230] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Sep 13 15:18:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:18:52.072022 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5fcb5c-0805-4c4f-a869-3ea77cac9f74 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:18:52.177215 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5fcb5c-0805-4c4f-a869-3ea77cac9f74 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:18:52.213843 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780b46de-5c6a-42e0-9b48-fe49ac42cb32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:18:52.214688 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780b46de-5c6a-42e0-9b48-fe49ac42cb32 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:18:52.215106 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780b46de-5c6a-42e0-9b48-fe49ac42cb32 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:18:52.215415 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780b46de-5c6a-42e0-9b48-fe49ac42cb32 None admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:18:52.216130 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780b46de-5c6a-42e0-9b48-fe49ac42cb32 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:18:52.216452 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780b46de-5c6a-42e0-9b48-fe49ac42cb32 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:18:52.217901 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780b46de-5c6a-42e0-9b48-fe49ac42cb32 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:18:52.239979 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 625/1231] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Sep 13 15:18:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:18:52.242026 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dc6f3c-f1a3-46a7-89bd-e12042681b58 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:18:52.314643 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:18:52.357130 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dc6f3c-f1a3-46a7-89bd-e12042681b58 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:18:52.400375 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91092dd-60d5-4e26-a5d2-b1df962d1613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:18:52.401053 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91092dd-60d5-4e26-a5d2-b1df962d1613 None admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:18:52.401430 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91092dd-60d5-4e26-a5d2-b1df962d1613 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:18:52.401611 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91092dd-60d5-4e26-a5d2-b1df962d1613 None admin] PATH_INFO: `/v3/projects/3d6e00339cfa47d2a6fa8724c587035f/users/5b56f96cb3184a3ba82c8a0c3427e268/roles/470736c596a14fa5ac78200239aa1104` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:18:52.418632 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91092dd-60d5-4e26-a5d2-b1df962d1613 None admin] RBAC: Authorizing `identity:create_grant(project_id=3d6e00339cfa47d2a6fa8724c587035f, user_id=5b56f96cb3184a3ba82c8a0c3427e268, role_id=470736c596a14fa5ac78200239aa1104)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:18:52.420323 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91092dd-60d5-4e26-a5d2-b1df962d1613 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:18:52.435623 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 607/1232] 10.222.0.27 () {58 vars in 1439 bytes} [Tue Sep 13 15:18:52 2022] PUT /identity/v3/projects/3d6e00339cfa47d2a6fa8724c587035f/users/5b56f96cb3184a3ba82c8a0c3427e268/roles/470736c596a14fa5ac78200239aa1104 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:18:54.630221 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00eb65a-60f0-44b3-88b7-f7854e5eeb22 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:18:54.630768 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00eb65a-60f0-44b3-88b7-f7854e5eeb22 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:18:54.630768 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00eb65a-60f0-44b3-88b7-f7854e5eeb22 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:18:54.632237 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 626/1233] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:18:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:18:54.639128 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032207b7-1914-4a0e-b80c-c630df17b3ee None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:18:54.639592 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032207b7-1914-4a0e-b80c-c630df17b3ee None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:18:54.639708 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032207b7-1914-4a0e-b80c-c630df17b3ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:18:54.659764 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-032207b7-1914-4a0e-b80c-c630df17b3ee None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:18:54.661131 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-032207b7-1914-4a0e-b80c-c630df17b3ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:18:54.739210 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 608/1234] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:18:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 15:18:55.059810 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00eb65a-60f0-44b3-88b7-f7854e5eeb22 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:18:55.085617 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:18:55.164005 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00eb65a-60f0-44b3-88b7-f7854e5eeb22 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:18:55.202296 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c074ca3-57dc-4c94-88c6-68888b379160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:18:55.202939 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c074ca3-57dc-4c94-88c6-68888b379160 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:18:55.203322 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c074ca3-57dc-4c94-88c6-68888b379160 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:18:55.203664 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c074ca3-57dc-4c94-88c6-68888b379160 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:18:55.218006 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c074ca3-57dc-4c94-88c6-68888b379160 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 15:18:55.222934 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-4c074ca3-57dc-4c94-88c6-68888b379160 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 15:18:55.222934 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:18:55.222934 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:18:55.222934 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:18:55.222934 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:18:55.222934 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:18:55.222934 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:18:55.222934 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:18:55.222934 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:18:55.222934 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:18:55.222934 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:18:55.222934 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:18:55.222934 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 15:18:55.222934 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 15:18:55.222934 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 15:18:55.222934 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 15:18:55.224287 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 15:18:55.224287 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 15:18:55.224287 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 15:18:55.224287 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 15:18:55.224287 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:18:55.224287 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:18:55.224287 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:18:55.224287 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:18:55.224287 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:18:55.224287 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:18:55.224287 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:18:55.224287 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Sep 13 15:18:55.224287 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:18:55.224287 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:18:55.224287 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:18:55.224287 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:18:55.225750 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:18:55.225750 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:18:55.225750 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:18:55.225750 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:18:55.225750 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 15:18:55.225750 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 15:18:55.225750 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 15:18:55.225750 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 15:18:55.225750 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 15:18:55.225750 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 15:18:55.225750 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 15:18:55.225750 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Sep 13 15:18:55.225750 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 627/1235] 10.222.0.27 () {56 vars in 1102 bytes} [Tue Sep 13 15:18:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:18:55.230475 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032207b7-1914-4a0e-b80c-c630df17b3ee None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:18:55.280182 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:18:55.335864 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032207b7-1914-4a0e-b80c-c630df17b3ee None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:18:55.372879 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6816da1-eb24-4402-bac7-9cc28e88abcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:18:55.373486 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6816da1-eb24-4402-bac7-9cc28e88abcf None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:18:55.373793 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6816da1-eb24-4402-bac7-9cc28e88abcf None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:18:55.374073 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6816da1-eb24-4402-bac7-9cc28e88abcf None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:18:55.374758 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6816da1-eb24-4402-bac7-9cc28e88abcf None admin] RBAC: Adding query filter params (name=service) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:18:55.375076 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6816da1-eb24-4402-bac7-9cc28e88abcf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:18:55.376426 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6816da1-eb24-4402-bac7-9cc28e88abcf None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:18:55.385737 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 609/1236] 10.222.0.27 () {56 vars in 1103 bytes} [Tue Sep 13 15:18:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:18:55.391347 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c074ca3-57dc-4c94-88c6-68888b379160 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:18:55.497083 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:18:55.517620 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c074ca3-57dc-4c94-88c6-68888b379160 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:18:55.557295 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6065513-29cb-4d4e-8670-212a6fffd986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:18:55.558141 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6065513-29cb-4d4e-8670-212a6fffd986 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:18:55.558425 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6065513-29cb-4d4e-8670-212a6fffd986 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:18:55.558698 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6065513-29cb-4d4e-8670-212a6fffd986 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:18:55.569437 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6065513-29cb-4d4e-8670-212a6fffd986 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:18:55.571124 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6065513-29cb-4d4e-8670-212a6fffd986 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:18:55.589243 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-f6065513-29cb-4d4e-8670-212a6fffd986 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 15:18:55.589243 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:18:55.589243 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:18:55.589243 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:18:55.589243 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:18:55.589243 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:18:55.589243 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:18:55.589243 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:18:55.589243 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:18:55.589243 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:18:55.589243 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:18:55.589243 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:18:55.589243 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 15:18:55.589243 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 15:18:55.589243 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 15:18:55.589243 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 15:18:55.590449 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:18:55.590449 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:18:55.590449 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:18:55.590449 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:18:55.590449 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:18:55.590449 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:18:55.590449 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:18:55.590449 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Sep 13 15:18:55.590449 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:18:55.590449 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:18:55.590449 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:18:55.590449 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:18:55.590449 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:18:55.590449 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:18:55.590449 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:18:55.590449 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:18:55.590449 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 15:18:55.591612 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 15:18:55.591612 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 15:18:55.591612 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Sep 13 15:18:55.591612 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 628/1237] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 13 15:18:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:18:55.597107 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6816da1-eb24-4402-bac7-9cc28e88abcf None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:18:55.707362 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6816da1-eb24-4402-bac7-9cc28e88abcf None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:18:55.717034 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:18:55.745194 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfc70a8-6c1c-450d-b4f9-2151fd411fdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:18:55.745858 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfc70a8-6c1c-450d-b4f9-2151fd411fdc None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:18:55.746142 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfc70a8-6c1c-450d-b4f9-2151fd411fdc None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:18:55.746416 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfc70a8-6c1c-450d-b4f9-2151fd411fdc None admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:18:55.747079 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfc70a8-6c1c-450d-b4f9-2151fd411fdc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:18:55.747380 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfc70a8-6c1c-450d-b4f9-2151fd411fdc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:18:55.748723 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfc70a8-6c1c-450d-b4f9-2151fd411fdc None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:18:55.761416 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 610/1238] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Sep 13 15:18:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:18:55.767159 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6065513-29cb-4d4e-8670-212a6fffd986 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:18:55.880178 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6065513-29cb-4d4e-8670-212a6fffd986 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:18:55.919769 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c57744d-a464-416c-889b-79ec335bdde4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:18:55.920605 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c57744d-a464-416c-889b-79ec335bdde4 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:18:55.920943 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c57744d-a464-416c-889b-79ec335bdde4 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:18:55.921226 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c57744d-a464-416c-889b-79ec335bdde4 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:18:55.924435 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:18:55.930794 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c57744d-a464-416c-889b-79ec335bdde4 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:18:55.932543 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c57744d-a464-416c-889b-79ec335bdde4 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:18:55.944274 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-4c57744d-a464-416c-889b-79ec335bdde4 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 13 15:18:55.944274 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:18:55.944274 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:18:55.944274 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:18:55.944274 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:18:55.944274 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:18:55.944274 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:18:55.944274 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:18:55.944274 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:18:55.944274 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:18:55.944274 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:18:55.944274 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:18:55.944274 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 15:18:55.944274 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 15:18:55.944274 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 15:18:55.944274 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 15:18:55.945552 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:18:55.945552 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:18:55.945552 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 15:18:55.945552 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 15:18:55.945552 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 15:18:55.945552 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 15:18:55.945552 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:18:55.945552 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:18:55.945552 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:18:55.945552 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:18:55.945552 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:18:55.945552 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Sep 13 15:18:55.945552 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:18:55.945552 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:18:55.945552 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:18:55.945552 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:18:55.945552 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:18:55.945552 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:18:55.946810 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:18:55.946810 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:18:55.946810 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 15:18:55.946810 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 15:18:55.946810 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 15:18:55.946810 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 15:18:55.946810 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 15:18:55.946810 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 15:18:55.946810 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 13 15:18:55.946810 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Sep 13 15:18:55.946810 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 629/1239] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 13 15:18:55 2022] GET /identity/v3/users/placement => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:18:55.951424 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfc70a8-6c1c-450d-b4f9-2151fd411fdc None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:18:56.061183 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfc70a8-6c1c-450d-b4f9-2151fd411fdc None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:18:56.097684 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4aab58-d97c-4bc5-a63a-efcd264df17b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:18:56.098510 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4aab58-d97c-4bc5-a63a-efcd264df17b None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:18:56.098793 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4aab58-d97c-4bc5-a63a-efcd264df17b None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:18:56.099071 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4aab58-d97c-4bc5-a63a-efcd264df17b None admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:18:56.099798 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4aab58-d97c-4bc5-a63a-efcd264df17b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:18:56.100140 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4aab58-d97c-4bc5-a63a-efcd264df17b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:18:56.101581 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4aab58-d97c-4bc5-a63a-efcd264df17b None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:18:56.121968 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 611/1240] 10.222.0.27 () {56 vars in 1143 bytes} [Tue Sep 13 15:18:55 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:18:56.127955 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c57744d-a464-416c-889b-79ec335bdde4 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:18:56.241495 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c57744d-a464-416c-889b-79ec335bdde4 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:18:56.283727 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cbc410-fa7d-4bbd-b6ea-f4d697083b2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:18:56.284352 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cbc410-fa7d-4bbd-b6ea-f4d697083b2e None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:18:56.284767 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cbc410-fa7d-4bbd-b6ea-f4d697083b2e None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:18:56.285167 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cbc410-fa7d-4bbd-b6ea-f4d697083b2e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:18:56.357037 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:18:56.364031 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cbc410-fa7d-4bbd-b6ea-f4d697083b2e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:18:56.365485 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cbc410-fa7d-4bbd-b6ea-f4d697083b2e None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:18:56.493594 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 630/1241] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Sep 13 15:18:56 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 15:18:56.499485 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4aab58-d97c-4bc5-a63a-efcd264df17b None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:18:56.530928 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:18:56.615917 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4aab58-d97c-4bc5-a63a-efcd264df17b None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:18:56.656388 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8744632-5fba-4930-897a-e8c24fcdaabf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:18:56.657022 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8744632-5fba-4930-897a-e8c24fcdaabf None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:18:56.657306 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8744632-5fba-4930-897a-e8c24fcdaabf None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:18:56.657580 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8744632-5fba-4930-897a-e8c24fcdaabf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:18:56.669142 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8744632-5fba-4930-897a-e8c24fcdaabf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:18:56.670742 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8744632-5fba-4930-897a-e8c24fcdaabf None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:18:56.687196 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-d8744632-5fba-4930-897a-e8c24fcdaabf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 15:18:56.687196 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:18:56.687196 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:18:56.687196 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:18:56.687196 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:18:56.687196 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:18:56.687196 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:18:56.687196 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:18:56.687196 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:18:56.687196 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:18:56.687196 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:18:56.687196 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:18:56.687196 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 15:18:56.687196 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 15:18:56.687196 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 15:18:56.687196 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 15:18:56.694082 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:18:56.694082 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:18:56.694082 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:18:56.694082 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:18:56.694082 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:18:56.694082 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:18:56.694082 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:18:56.694082 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Sep 13 15:18:56.694082 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:18:56.694082 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:18:56.694082 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:18:56.694082 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:18:56.694082 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:18:56.694082 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:18:56.694082 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:18:56.694082 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:18:56.694082 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 15:18:56.695123 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 15:18:56.695123 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 15:18:56.695123 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Sep 13 15:18:56.695123 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 612/1242] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 13 15:18:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:18:56.695893 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cbc410-fa7d-4bbd-b6ea-f4d697083b2e None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:18:56.795318 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:18:56.801654 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cbc410-fa7d-4bbd-b6ea-f4d697083b2e None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:18:56.839280 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b09313-a5c0-4e81-813c-75f4a8eca4a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:18:56.839894 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b09313-a5c0-4e81-813c-75f4a8eca4a8 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:18:56.840173 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b09313-a5c0-4e81-813c-75f4a8eca4a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:18:56.840445 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b09313-a5c0-4e81-813c-75f4a8eca4a8 None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:18:56.841089 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b09313-a5c0-4e81-813c-75f4a8eca4a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:18:56.841392 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b09313-a5c0-4e81-813c-75f4a8eca4a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:18:56.842794 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b09313-a5c0-4e81-813c-75f4a8eca4a8 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:18:56.854472 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 631/1243] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Sep 13 15:18:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 15:18:56.860291 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8744632-5fba-4930-897a-e8c24fcdaabf None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:18:56.946509 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:18:56.973542 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8744632-5fba-4930-897a-e8c24fcdaabf None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:18:57.011681 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4715198-da52-49aa-ac3f-2367a95d2cc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:18:57.012435 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4715198-da52-49aa-ac3f-2367a95d2cc4 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:18:57.012710 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4715198-da52-49aa-ac3f-2367a95d2cc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:18:57.013018 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4715198-da52-49aa-ac3f-2367a95d2cc4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:18:57.020394 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4715198-da52-49aa-ac3f-2367a95d2cc4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:18:57.022115 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4715198-da52-49aa-ac3f-2367a95d2cc4 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:18:57.035466 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-f4715198-da52-49aa-ac3f-2367a95d2cc4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 15:18:57.035466 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:18:57.035466 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:18:57.035466 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:18:57.035466 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:18:57.035466 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:18:57.035466 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:18:57.035466 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:18:57.035466 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:18:57.035466 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:18:57.035466 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:18:57.035466 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:18:57.035466 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 15:18:57.035466 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 15:18:57.035466 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 15:18:57.036590 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 15:18:57.036590 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:18:57.036590 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:18:57.036590 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:18:57.036590 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:18:57.036590 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:18:57.036590 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:18:57.036590 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:18:57.036590 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Sep 13 15:18:57.036590 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:18:57.036590 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:18:57.036590 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:18:57.036590 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:18:57.036590 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:18:57.036590 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:18:57.036590 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:18:57.036590 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:18:57.037502 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 15:18:57.037502 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 15:18:57.037502 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 15:18:57.037502 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 15:18:57.037502 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 15:18:57.037502 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 15:18:57.037502 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 15:18:57.037502 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Sep 13 15:18:57.037502 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 613/1244] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Sep 13 15:18:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:18:57.042987 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b09313-a5c0-4e81-813c-75f4a8eca4a8 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:18:57.152734 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b09313-a5c0-4e81-813c-75f4a8eca4a8 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:18:57.188305 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35aa45be-5172-408d-a174-e97e03271dc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:18:57.188912 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aa45be-5172-408d-a174-e97e03271dc9 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:18:57.189195 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aa45be-5172-408d-a174-e97e03271dc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:18:57.189461 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aa45be-5172-408d-a174-e97e03271dc9 None admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:18:57.190179 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35aa45be-5172-408d-a174-e97e03271dc9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:18:57.190483 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35aa45be-5172-408d-a174-e97e03271dc9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:18:57.191899 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35aa45be-5172-408d-a174-e97e03271dc9 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:18:57.205267 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 632/1245] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Sep 13 15:18:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:18:57.212620 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4715198-da52-49aa-ac3f-2367a95d2cc4 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:18:57.319834 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4715198-da52-49aa-ac3f-2367a95d2cc4 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:18:57.355610 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41e246d-ffa3-4da1-a602-61eb854aac2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:18:57.356200 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41e246d-ffa3-4da1-a602-61eb854aac2b None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:18:57.356487 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41e246d-ffa3-4da1-a602-61eb854aac2b None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:18:57.356752 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41e246d-ffa3-4da1-a602-61eb854aac2b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:18:57.357461 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41e246d-ffa3-4da1-a602-61eb854aac2b None admin] RBAC: Adding query filter params (role.id=470736c596a14fa5ac78200239aa1104, scope.project.id=3d6e00339cfa47d2a6fa8724c587035f, user.id=5b56f96cb3184a3ba82c8a0c3427e268) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:18:57.357795 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41e246d-ffa3-4da1-a602-61eb854aac2b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:18:57.359196 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41e246d-ffa3-4da1-a602-61eb854aac2b None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:18:57.365054 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 614/1246] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Sep 13 15:18:57 2022] GET /identity/v3/role_assignments?user.id=5b56f96cb3184a3ba82c8a0c3427e268&scope.project.id=3d6e00339cfa47d2a6fa8724c587035f&role.id=470736c596a14fa5ac78200239aa1104 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:18:59.682747 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2221beb7-c108-41b1-bb9b-ce25b093f751 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:18:59.683298 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2221beb7-c108-41b1-bb9b-ce25b093f751 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:18:59.683412 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2221beb7-c108-41b1-bb9b-ce25b093f751 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:18:59.684816 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 633/1247] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:18:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:18:59.690401 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f052e8-2800-4cd1-9e40-f29ae5606246 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:18:59.690868 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f052e8-2800-4cd1-9e40-f29ae5606246 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:18:59.690990 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f052e8-2800-4cd1-9e40-f29ae5606246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:18:59.698210 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:18:59.713399 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-c7f052e8-2800-4cd1-9e40-f29ae5606246 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:18:59.714779 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-c7f052e8-2800-4cd1-9e40-f29ae5606246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:18:59.787475 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 615/1248] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:18:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 15:19:00.072608 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2221beb7-c108-41b1-bb9b-ce25b093f751 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:19:00.092389 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:19:00.189031 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2221beb7-c108-41b1-bb9b-ce25b093f751 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:19:00.229535 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f705f0-bc3d-44c5-89bd-808a80bf012e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:19:00.230204 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f705f0-bc3d-44c5-89bd-808a80bf012e None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:19:00.230476 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f705f0-bc3d-44c5-89bd-808a80bf012e None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:19:00.230749 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f705f0-bc3d-44c5-89bd-808a80bf012e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:19:00.241279 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f705f0-bc3d-44c5-89bd-808a80bf012e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 15:19:00.247715 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-43f705f0-bc3d-44c5-89bd-808a80bf012e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 15:19:00.247715 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:19:00.247715 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:19:00.247715 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:19:00.247715 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:19:00.247715 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:19:00.247715 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:19:00.247715 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:19:00.247715 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:19:00.247715 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:19:00.247715 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:19:00.247715 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:19:00.247715 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 15:19:00.247715 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 15:19:00.247715 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 15:19:00.247715 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 15:19:00.248699 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 15:19:00.248699 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 15:19:00.248699 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 15:19:00.248699 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 15:19:00.248699 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:19:00.248699 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:19:00.248699 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:19:00.248699 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:19:00.248699 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:19:00.248699 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:19:00.248699 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:19:00.248699 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Sep 13 15:19:00.248699 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:19:00.248699 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:19:00.248699 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:19:00.248699 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:19:00.249557 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:19:00.249557 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:19:00.249557 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:19:00.249557 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:19:00.249557 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 15:19:00.249557 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 15:19:00.249557 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 15:19:00.249557 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 15:19:00.249557 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 15:19:00.249557 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 15:19:00.249557 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 15:19:00.249557 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Sep 13 15:19:00.249557 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 634/1249] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Sep 13 15:19:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:19:00.255760 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f052e8-2800-4cd1-9e40-f29ae5606246 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:19:00.370572 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f052e8-2800-4cd1-9e40-f29ae5606246 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:19:00.408974 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:19:00.416042 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91e768b-eb46-42cd-ac2b-21ae2f33e336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:19:00.417186 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91e768b-eb46-42cd-ac2b-21ae2f33e336 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:19:00.417573 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91e768b-eb46-42cd-ac2b-21ae2f33e336 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:19:00.418150 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91e768b-eb46-42cd-ac2b-21ae2f33e336 None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:19:00.418933 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91e768b-eb46-42cd-ac2b-21ae2f33e336 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:19:00.419371 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91e768b-eb46-42cd-ac2b-21ae2f33e336 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:19:00.421348 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91e768b-eb46-42cd-ac2b-21ae2f33e336 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:19:00.440478 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 616/1250] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Sep 13 15:19:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:19:00.442179 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f705f0-bc3d-44c5-89bd-808a80bf012e None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:19:00.534718 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:19:00.560289 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f705f0-bc3d-44c5-89bd-808a80bf012e None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:19:00.597292 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7536ea1-9e15-438d-a100-30d8b0656726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:19:00.597973 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7536ea1-9e15-438d-a100-30d8b0656726 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:19:00.598255 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7536ea1-9e15-438d-a100-30d8b0656726 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:19:00.598532 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7536ea1-9e15-438d-a100-30d8b0656726 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:19:00.610439 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7536ea1-9e15-438d-a100-30d8b0656726 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:19:00.611912 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7536ea1-9e15-438d-a100-30d8b0656726 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:19:00.627387 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-e7536ea1-9e15-438d-a100-30d8b0656726 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 15:19:00.627387 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:19:00.627387 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:19:00.627387 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:19:00.627387 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:19:00.627387 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:19:00.627387 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:19:00.627387 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:19:00.627387 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:19:00.627387 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:19:00.627387 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:19:00.627387 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:19:00.627387 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 15:19:00.627387 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 15:19:00.627387 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 15:19:00.627387 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 15:19:00.628567 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:19:00.628567 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:19:00.628567 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:19:00.628567 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:19:00.628567 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:19:00.628567 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:19:00.628567 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:19:00.628567 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Sep 13 15:19:00.628567 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:19:00.628567 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:19:00.628567 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:19:00.628567 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:19:00.628567 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:19:00.628567 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:19:00.628567 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:19:00.628567 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:19:00.628567 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 15:19:00.629725 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 15:19:00.629725 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 15:19:00.629725 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Sep 13 15:19:00.629725 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 635/1251] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 13 15:19:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:19:00.635533 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91e768b-eb46-42cd-ac2b-21ae2f33e336 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:19:00.743353 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91e768b-eb46-42cd-ac2b-21ae2f33e336 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:19:00.779011 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f64a160-ffa3-424b-b6f3-858864eff026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:19:00.779802 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f64a160-ffa3-424b-b6f3-858864eff026 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:19:00.780322 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f64a160-ffa3-424b-b6f3-858864eff026 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:19:00.780845 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f64a160-ffa3-424b-b6f3-858864eff026 None admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:19:00.781539 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f64a160-ffa3-424b-b6f3-858864eff026 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:19:00.781903 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f64a160-ffa3-424b-b6f3-858864eff026 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:19:00.783336 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f64a160-ffa3-424b-b6f3-858864eff026 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:19:00.797794 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 617/1252] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Sep 13 15:19:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:19:00.803657 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7536ea1-9e15-438d-a100-30d8b0656726 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:19:00.908399 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7536ea1-9e15-438d-a100-30d8b0656726 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:19:00.937179 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:19:00.946045 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c529ed1-29f0-4f16-8a41-d02f87e918fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:19:00.946678 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c529ed1-29f0-4f16-8a41-d02f87e918fb None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:19:00.946961 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c529ed1-29f0-4f16-8a41-d02f87e918fb None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:19:00.947235 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c529ed1-29f0-4f16-8a41-d02f87e918fb None admin] PATH_INFO: `/v3/users/placement` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:19:00.955096 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c529ed1-29f0-4f16-8a41-d02f87e918fb None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:19:00.956547 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c529ed1-29f0-4f16-8a41-d02f87e918fb None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:19:00.968092 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-3c529ed1-29f0-4f16-8a41-d02f87e918fb None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 13 15:19:00.968092 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:19:00.968092 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:19:00.968092 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:19:00.968092 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:19:00.968092 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:19:00.968092 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:19:00.968092 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:19:00.968092 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:19:00.968092 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:19:00.968092 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:19:00.968092 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:19:00.968092 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 15:19:00.968092 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 15:19:00.968092 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 15:19:00.968092 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 15:19:00.969251 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:19:00.969251 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:19:00.969251 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 15:19:00.969251 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 15:19:00.969251 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 15:19:00.969251 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 15:19:00.969251 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:19:00.969251 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:19:00.969251 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:19:00.969251 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:19:00.969251 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:19:00.969251 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Sep 13 15:19:00.969251 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:19:00.969251 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:19:00.969251 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:19:00.969251 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:19:00.969251 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:19:00.969251 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:19:00.970638 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:19:00.970638 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:19:00.970638 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 15:19:00.970638 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 15:19:00.970638 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 15:19:00.970638 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 15:19:00.970638 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 15:19:00.970638 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 15:19:00.970638 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 13 15:19:00.970638 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Sep 13 15:19:00.970638 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 636/1253] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 13 15:19:00 2022] GET /identity/v3/users/placement => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:19:00.975252 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f64a160-ffa3-424b-b6f3-858864eff026 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:19:01.034130 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:19:01.079349 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f64a160-ffa3-424b-b6f3-858864eff026 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:19:01.113992 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5502efaf-2d36-4bf3-b8f5-fd9ea9d6531e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:19:01.114603 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5502efaf-2d36-4bf3-b8f5-fd9ea9d6531e None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:19:01.114887 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5502efaf-2d36-4bf3-b8f5-fd9ea9d6531e None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:19:01.115160 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5502efaf-2d36-4bf3-b8f5-fd9ea9d6531e None admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:19:01.115891 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5502efaf-2d36-4bf3-b8f5-fd9ea9d6531e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:19:01.116199 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5502efaf-2d36-4bf3-b8f5-fd9ea9d6531e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:19:01.117740 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5502efaf-2d36-4bf3-b8f5-fd9ea9d6531e None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:19:01.135492 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 618/1254] 10.222.0.27 () {56 vars in 1143 bytes} [Tue Sep 13 15:19:00 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:19:01.141511 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c529ed1-29f0-4f16-8a41-d02f87e918fb None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:19:01.241767 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c529ed1-29f0-4f16-8a41-d02f87e918fb None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:19:01.275444 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99a452e-e736-4560-a140-2d98011efb84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:19:01.276040 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99a452e-e736-4560-a140-2d98011efb84 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:19:01.276320 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99a452e-e736-4560-a140-2d98011efb84 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:19:01.276594 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99a452e-e736-4560-a140-2d98011efb84 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:19:01.330116 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:19:01.342294 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99a452e-e736-4560-a140-2d98011efb84 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:19:01.343737 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99a452e-e736-4560-a140-2d98011efb84 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:19:01.449950 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 637/1255] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Sep 13 15:19:01 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 15:19:01.455777 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5502efaf-2d36-4bf3-b8f5-fd9ea9d6531e None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:19:01.551373 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5502efaf-2d36-4bf3-b8f5-fd9ea9d6531e None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:19:01.564566 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:19:01.585989 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9730c8-802b-4196-bef7-4ed58c96139b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:19:01.586620 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9730c8-802b-4196-bef7-4ed58c96139b None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:19:01.586903 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9730c8-802b-4196-bef7-4ed58c96139b None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:19:01.587211 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9730c8-802b-4196-bef7-4ed58c96139b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:19:01.596955 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9730c8-802b-4196-bef7-4ed58c96139b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:19:01.598446 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9730c8-802b-4196-bef7-4ed58c96139b None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:19:01.613149 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-bc9730c8-802b-4196-bef7-4ed58c96139b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 15:19:01.613149 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:19:01.613149 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:19:01.613149 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:19:01.613149 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:19:01.613149 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:19:01.613149 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:19:01.613149 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:19:01.613149 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:19:01.613149 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:19:01.613149 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:19:01.613149 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:19:01.613149 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 15:19:01.613149 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 15:19:01.613149 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 15:19:01.613149 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 15:19:01.614392 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:19:01.614392 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:19:01.614392 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:19:01.614392 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:19:01.614392 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:19:01.614392 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:19:01.614392 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:19:01.614392 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Sep 13 15:19:01.614392 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:19:01.614392 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:19:01.614392 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:19:01.614392 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:19:01.614392 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:19:01.614392 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:19:01.614392 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:19:01.614392 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:19:01.614392 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 15:19:01.615446 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 15:19:01.615446 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 15:19:01.615446 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Sep 13 15:19:01.615446 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 619/1256] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 13 15:19:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:19:01.620846 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99a452e-e736-4560-a140-2d98011efb84 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:19:01.704874 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:19:01.717199 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99a452e-e736-4560-a140-2d98011efb84 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:19:01.751890 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67718559-fefd-4aa8-a277-0cf78c43aa47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:19:01.752483 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67718559-fefd-4aa8-a277-0cf78c43aa47 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:19:01.752759 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67718559-fefd-4aa8-a277-0cf78c43aa47 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:19:01.753030 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67718559-fefd-4aa8-a277-0cf78c43aa47 None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:19:01.753656 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67718559-fefd-4aa8-a277-0cf78c43aa47 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:19:01.753985 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67718559-fefd-4aa8-a277-0cf78c43aa47 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:19:01.755340 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67718559-fefd-4aa8-a277-0cf78c43aa47 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:19:01.766272 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 638/1257] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Sep 13 15:19:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:19:01.771871 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9730c8-802b-4196-bef7-4ed58c96139b None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:19:01.870418 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9730c8-802b-4196-bef7-4ed58c96139b None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:19:01.902225 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9ea8bd-2c77-47ee-97e2-f44f9ab031e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:19:01.902836 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9ea8bd-2c77-47ee-97e2-f44f9ab031e8 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:19:01.903117 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9ea8bd-2c77-47ee-97e2-f44f9ab031e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:19:01.903393 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9ea8bd-2c77-47ee-97e2-f44f9ab031e8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:19:01.909776 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9ea8bd-2c77-47ee-97e2-f44f9ab031e8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:19:01.911232 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9ea8bd-2c77-47ee-97e2-f44f9ab031e8 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:19:01.923707 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-fd9ea8bd-2c77-47ee-97e2-f44f9ab031e8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 15:19:01.923707 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:19:01.923707 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:19:01.923707 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:19:01.923707 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:19:01.923707 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:19:01.923707 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:19:01.923707 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:19:01.923707 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:19:01.923707 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:19:01.923707 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:19:01.923707 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:19:01.923707 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 15:19:01.923707 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 15:19:01.923707 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 15:19:01.924747 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 15:19:01.924747 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:19:01.924747 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:19:01.924747 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:19:01.924747 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:19:01.924747 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:19:01.924747 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:19:01.924747 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:19:01.924747 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Sep 13 15:19:01.924747 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:19:01.924747 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:19:01.924747 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:19:01.924747 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:19:01.924747 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:19:01.924747 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:19:01.924747 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:19:01.924747 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:19:01.926080 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 15:19:01.926080 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 15:19:01.926080 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 15:19:01.926080 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 15:19:01.926080 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 15:19:01.926080 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 15:19:01.926080 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 15:19:01.926080 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Sep 13 15:19:01.926080 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 620/1258] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Sep 13 15:19:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:19:01.931261 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67718559-fefd-4aa8-a277-0cf78c43aa47 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:19:02.027271 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67718559-fefd-4aa8-a277-0cf78c43aa47 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:19:02.059450 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93612e06-d233-4c3e-bb1c-c03451cf3594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:19:02.060043 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93612e06-d233-4c3e-bb1c-c03451cf3594 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:19:02.060326 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93612e06-d233-4c3e-bb1c-c03451cf3594 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:19:02.060602 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93612e06-d233-4c3e-bb1c-c03451cf3594 None admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:19:02.061286 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93612e06-d233-4c3e-bb1c-c03451cf3594 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:19:02.061594 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93612e06-d233-4c3e-bb1c-c03451cf3594 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:19:02.063301 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93612e06-d233-4c3e-bb1c-c03451cf3594 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:19:02.075358 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 639/1259] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Sep 13 15:19:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:19:02.081326 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9ea8bd-2c77-47ee-97e2-f44f9ab031e8 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:19:02.106607 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:19:02.179992 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9ea8bd-2c77-47ee-97e2-f44f9ab031e8 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:19:02.212883 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f06bc7-587d-40c5-a6b5-2db520fab150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:19:02.213478 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f06bc7-587d-40c5-a6b5-2db520fab150 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:19:02.213788 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f06bc7-587d-40c5-a6b5-2db520fab150 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:19:02.214069 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f06bc7-587d-40c5-a6b5-2db520fab150 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:19:02.214786 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f06bc7-587d-40c5-a6b5-2db520fab150 None admin] RBAC: Adding query filter params (role.id=f34412ad29f1478cba775b033129f71f, scope.project.id=3d6e00339cfa47d2a6fa8724c587035f, user.id=5b56f96cb3184a3ba82c8a0c3427e268) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:19:02.215099 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f06bc7-587d-40c5-a6b5-2db520fab150 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:19:02.216507 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f06bc7-587d-40c5-a6b5-2db520fab150 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:19:02.221723 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 621/1260] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Sep 13 15:19:02 2022] GET /identity/v3/role_assignments?user.id=5b56f96cb3184a3ba82c8a0c3427e268&scope.project.id=3d6e00339cfa47d2a6fa8724c587035f&role.id=f34412ad29f1478cba775b033129f71f => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:19:04.333285 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf89e96b-e6d8-4c71-bc28-0578487cdc54 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:19:04.333852 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf89e96b-e6d8-4c71-bc28-0578487cdc54 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:19:04.333852 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf89e96b-e6d8-4c71-bc28-0578487cdc54 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:19:04.335190 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 640/1261] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:19:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:19:04.340706 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc93faab-9317-4ba0-be4a-cf845b5b2a27 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:19:04.341126 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc93faab-9317-4ba0-be4a-cf845b5b2a27 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:19:04.341233 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc93faab-9317-4ba0-be4a-cf845b5b2a27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:19:04.359822 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-cc93faab-9317-4ba0-be4a-cf845b5b2a27 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:19:04.361013 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-cc93faab-9317-4ba0-be4a-cf845b5b2a27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:19:04.427088 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 622/1262] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:19:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 15:19:04.698979 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf89e96b-e6d8-4c71-bc28-0578487cdc54 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:19:04.709837 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:19:04.802893 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf89e96b-e6d8-4c71-bc28-0578487cdc54 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:19:04.836782 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecbc9ad-c748-437c-8130-949269d34f6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:19:04.837398 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecbc9ad-c748-437c-8130-949269d34f6b None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:19:04.837674 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecbc9ad-c748-437c-8130-949269d34f6b None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:19:04.837972 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecbc9ad-c748-437c-8130-949269d34f6b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:19:04.847580 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecbc9ad-c748-437c-8130-949269d34f6b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 15:19:04.853248 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-fecbc9ad-c748-437c-8130-949269d34f6b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 15:19:04.853248 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:19:04.853248 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:19:04.853248 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:19:04.853248 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:19:04.853248 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:19:04.853248 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:19:04.853248 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:19:04.853248 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:19:04.853248 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:19:04.853248 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:19:04.853248 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:19:04.853248 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 15:19:04.853248 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 15:19:04.853248 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 15:19:04.853248 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 15:19:04.854378 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 15:19:04.854378 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 15:19:04.854378 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 15:19:04.854378 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 15:19:04.854378 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:19:04.854378 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:19:04.854378 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:19:04.854378 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:19:04.854378 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:19:04.854378 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:19:04.854378 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:19:04.854378 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Sep 13 15:19:04.854378 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:19:04.854378 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:19:04.854378 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:19:04.854378 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:19:04.855639 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:19:04.855639 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:19:04.855639 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:19:04.855639 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:19:04.855639 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 15:19:04.855639 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 15:19:04.855639 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 15:19:04.855639 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 15:19:04.855639 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 15:19:04.855639 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 15:19:04.855639 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 15:19:04.855639 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Sep 13 15:19:04.855639 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 641/1263] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Sep 13 15:19:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:19:04.860414 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc93faab-9317-4ba0-be4a-cf845b5b2a27 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:19:04.878996 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:19:04.957824 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc93faab-9317-4ba0-be4a-cf845b5b2a27 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:19:04.990759 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e892d246-90ae-4c9f-a464-8eced5290e18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:19:04.991407 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e892d246-90ae-4c9f-a464-8eced5290e18 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:19:04.992287 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e892d246-90ae-4c9f-a464-8eced5290e18 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:19:04.992801 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e892d246-90ae-4c9f-a464-8eced5290e18 None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:19:04.993470 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e892d246-90ae-4c9f-a464-8eced5290e18 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:19:04.993800 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e892d246-90ae-4c9f-a464-8eced5290e18 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:19:04.995146 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e892d246-90ae-4c9f-a464-8eced5290e18 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:19:05.002878 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 623/1264] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Sep 13 15:19:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:19:05.009311 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecbc9ad-c748-437c-8130-949269d34f6b None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:19:05.076012 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:19:05.107899 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecbc9ad-c748-437c-8130-949269d34f6b None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:19:05.141115 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870a4e59-0834-4b55-9b86-14036faa97d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:19:05.141744 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870a4e59-0834-4b55-9b86-14036faa97d5 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:19:05.142030 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870a4e59-0834-4b55-9b86-14036faa97d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:19:05.142306 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870a4e59-0834-4b55-9b86-14036faa97d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:19:05.151869 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870a4e59-0834-4b55-9b86-14036faa97d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:19:05.153309 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870a4e59-0834-4b55-9b86-14036faa97d5 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:19:05.167437 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-870a4e59-0834-4b55-9b86-14036faa97d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 15:19:05.167437 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:19:05.167437 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:19:05.167437 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:19:05.167437 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:19:05.167437 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:19:05.167437 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:19:05.167437 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:19:05.167437 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:19:05.167437 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:19:05.167437 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:19:05.167437 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:19:05.167437 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 15:19:05.167437 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 15:19:05.167437 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 15:19:05.167437 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 15:19:05.168523 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:19:05.168523 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:19:05.168523 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:19:05.168523 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:19:05.168523 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:19:05.168523 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:19:05.168523 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:19:05.168523 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Sep 13 15:19:05.168523 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:19:05.168523 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:19:05.168523 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:19:05.168523 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:19:05.168523 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:19:05.168523 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:19:05.168523 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:19:05.168523 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:19:05.168523 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 15:19:05.169454 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 15:19:05.169454 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 15:19:05.169454 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Sep 13 15:19:05.169454 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 642/1265] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 13 15:19:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:19:05.174271 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e892d246-90ae-4c9f-a464-8eced5290e18 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:19:05.253237 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:19:05.271624 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e892d246-90ae-4c9f-a464-8eced5290e18 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:19:05.305407 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76ea7d2-646d-43d6-a3ca-87098b6f04cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:19:05.306027 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76ea7d2-646d-43d6-a3ca-87098b6f04cb None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:19:05.306311 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76ea7d2-646d-43d6-a3ca-87098b6f04cb None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:19:05.306586 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76ea7d2-646d-43d6-a3ca-87098b6f04cb None admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:19:05.307222 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76ea7d2-646d-43d6-a3ca-87098b6f04cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:19:05.307527 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76ea7d2-646d-43d6-a3ca-87098b6f04cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:19:05.308873 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76ea7d2-646d-43d6-a3ca-87098b6f04cb None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:19:05.321044 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 624/1266] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Sep 13 15:19:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:19:05.326594 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870a4e59-0834-4b55-9b86-14036faa97d5 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:19:05.431181 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870a4e59-0834-4b55-9b86-14036faa97d5 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:19:05.450598 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:19:05.464477 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f60aaa-712f-4a3b-8c2b-f68a28e4dacc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:19:05.465091 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f60aaa-712f-4a3b-8c2b-f68a28e4dacc None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:19:05.465394 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f60aaa-712f-4a3b-8c2b-f68a28e4dacc None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:19:05.465769 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f60aaa-712f-4a3b-8c2b-f68a28e4dacc None admin] PATH_INFO: `/v3/users/placement` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:19:05.473582 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f60aaa-712f-4a3b-8c2b-f68a28e4dacc None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:19:05.475046 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f60aaa-712f-4a3b-8c2b-f68a28e4dacc None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:19:05.486592 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-69f60aaa-712f-4a3b-8c2b-f68a28e4dacc None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 13 15:19:05.486592 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:19:05.486592 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:19:05.486592 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:19:05.486592 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:19:05.486592 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:19:05.486592 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:19:05.486592 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:19:05.486592 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:19:05.486592 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:19:05.486592 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:19:05.486592 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:19:05.486592 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 15:19:05.486592 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 15:19:05.486592 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 15:19:05.486592 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 15:19:05.487741 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:19:05.487741 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:19:05.487741 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 15:19:05.487741 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 15:19:05.487741 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 15:19:05.487741 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 15:19:05.487741 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:19:05.487741 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:19:05.487741 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:19:05.487741 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:19:05.487741 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:19:05.487741 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Sep 13 15:19:05.487741 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:19:05.487741 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:19:05.487741 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:19:05.487741 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:19:05.487741 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:19:05.487741 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:19:05.488727 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:19:05.488727 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:19:05.488727 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 15:19:05.488727 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 15:19:05.488727 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 15:19:05.488727 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 15:19:05.488727 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 15:19:05.488727 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 15:19:05.488727 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 13 15:19:05.488727 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Sep 13 15:19:05.488727 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 643/1267] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 13 15:19:05 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:19:05.494298 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76ea7d2-646d-43d6-a3ca-87098b6f04cb None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:19:05.592408 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76ea7d2-646d-43d6-a3ca-87098b6f04cb None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:19:05.624647 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ccfd6c-7b16-4fd8-a164-2baa095bb010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:19:05.625244 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ccfd6c-7b16-4fd8-a164-2baa095bb010 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:19:05.625527 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ccfd6c-7b16-4fd8-a164-2baa095bb010 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:19:05.625829 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ccfd6c-7b16-4fd8-a164-2baa095bb010 None admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:19:05.626549 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ccfd6c-7b16-4fd8-a164-2baa095bb010 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:19:05.626859 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ccfd6c-7b16-4fd8-a164-2baa095bb010 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:19:05.628285 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ccfd6c-7b16-4fd8-a164-2baa095bb010 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:19:05.637165 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:19:05.646201 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 625/1268] 10.222.0.27 () {56 vars in 1143 bytes} [Tue Sep 13 15:19:05 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:19:05.652836 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f60aaa-712f-4a3b-8c2b-f68a28e4dacc None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:19:05.750251 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f60aaa-712f-4a3b-8c2b-f68a28e4dacc None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:19:05.782521 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f0ef43-0f8a-4fdb-8b5a-29a2d5c6f7ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:19:05.783148 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f0ef43-0f8a-4fdb-8b5a-29a2d5c6f7ca None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:19:05.783431 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f0ef43-0f8a-4fdb-8b5a-29a2d5c6f7ca None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:19:05.783734 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f0ef43-0f8a-4fdb-8b5a-29a2d5c6f7ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:19:05.793894 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f0ef43-0f8a-4fdb-8b5a-29a2d5c6f7ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:19:05.795327 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f0ef43-0f8a-4fdb-8b5a-29a2d5c6f7ca None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:19:05.809566 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-e8f0ef43-0f8a-4fdb-8b5a-29a2d5c6f7ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 15:19:05.809566 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:19:05.809566 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:19:05.809566 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:19:05.809566 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:19:05.809566 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:19:05.809566 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:19:05.809566 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:19:05.809566 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:19:05.809566 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:19:05.809566 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:19:05.809566 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:19:05.809566 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 15:19:05.809566 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 15:19:05.809566 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 15:19:05.809566 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 15:19:05.810514 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:19:05.810514 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:19:05.810514 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:19:05.810514 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:19:05.810514 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:19:05.810514 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:19:05.810514 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:19:05.810514 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Sep 13 15:19:05.810514 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:19:05.810514 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:19:05.810514 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:19:05.810514 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:19:05.810514 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:19:05.810514 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:19:05.810514 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:19:05.810514 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:19:05.810514 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 15:19:05.811467 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 15:19:05.811467 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 15:19:05.811467 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Sep 13 15:19:05.811467 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 644/1269] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 13 15:19:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:19:05.816670 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ccfd6c-7b16-4fd8-a164-2baa095bb010 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:19:05.912893 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ccfd6c-7b16-4fd8-a164-2baa095bb010 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:19:05.945995 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03435b81-3e43-4c18-ae89-707e737590b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:19:05.946593 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03435b81-3e43-4c18-ae89-707e737590b8 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:19:05.946876 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03435b81-3e43-4c18-ae89-707e737590b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:19:05.947158 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03435b81-3e43-4c18-ae89-707e737590b8 None admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:19:05.947794 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03435b81-3e43-4c18-ae89-707e737590b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:19:05.948101 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03435b81-3e43-4c18-ae89-707e737590b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:19:05.949453 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03435b81-3e43-4c18-ae89-707e737590b8 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:19:05.960200 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 626/1270] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Sep 13 15:19:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:19:05.966386 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f0ef43-0f8a-4fdb-8b5a-29a2d5c6f7ca None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:19:05.997374 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:19:06.064610 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f0ef43-0f8a-4fdb-8b5a-29a2d5c6f7ca None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:19:06.096821 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8459adef-f9fc-4090-ae9c-e68ba283c5d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:19:06.097436 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8459adef-f9fc-4090-ae9c-e68ba283c5d2 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:19:06.097738 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8459adef-f9fc-4090-ae9c-e68ba283c5d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:19:06.098019 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8459adef-f9fc-4090-ae9c-e68ba283c5d2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:19:06.105005 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8459adef-f9fc-4090-ae9c-e68ba283c5d2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:19:06.106462 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8459adef-f9fc-4090-ae9c-e68ba283c5d2 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:19:06.117370 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-8459adef-f9fc-4090-ae9c-e68ba283c5d2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 15:19:06.117370 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:19:06.117370 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:19:06.117370 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:19:06.117370 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:19:06.117370 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:19:06.117370 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:19:06.117370 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:19:06.117370 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:19:06.117370 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:19:06.117370 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:19:06.117370 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:19:06.117370 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 15:19:06.117370 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 15:19:06.117370 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 15:19:06.118446 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 15:19:06.118446 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:19:06.118446 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:19:06.118446 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:19:06.118446 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:19:06.118446 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:19:06.118446 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:19:06.118446 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:19:06.118446 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Sep 13 15:19:06.118446 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:19:06.118446 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:19:06.118446 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:19:06.118446 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:19:06.118446 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:19:06.118446 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:19:06.118446 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:19:06.118446 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:19:06.119565 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 15:19:06.119565 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 15:19:06.119565 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 15:19:06.119565 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 15:19:06.119565 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 15:19:06.119565 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 15:19:06.119565 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 15:19:06.119565 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Sep 13 15:19:06.119565 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 645/1271] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Sep 13 15:19:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:19:06.124461 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03435b81-3e43-4c18-ae89-707e737590b8 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:19:06.181953 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:19:06.223463 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03435b81-3e43-4c18-ae89-707e737590b8 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:19:06.256713 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4ab050-88ed-45b1-8aac-cedc0d950c8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:19:06.257311 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4ab050-88ed-45b1-8aac-cedc0d950c8d None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:19:06.257590 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4ab050-88ed-45b1-8aac-cedc0d950c8d None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:19:06.257895 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4ab050-88ed-45b1-8aac-cedc0d950c8d None admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:19:06.258581 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4ab050-88ed-45b1-8aac-cedc0d950c8d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:19:06.258890 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4ab050-88ed-45b1-8aac-cedc0d950c8d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:19:06.260293 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4ab050-88ed-45b1-8aac-cedc0d950c8d None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:19:06.271869 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 627/1272] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Sep 13 15:19:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:19:06.278171 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8459adef-f9fc-4090-ae9c-e68ba283c5d2 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:19:06.366199 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:19:06.375663 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8459adef-f9fc-4090-ae9c-e68ba283c5d2 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:19:06.410952 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd57db15-7b4b-40fe-ab12-92a4d00c63f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:19:06.411752 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd57db15-7b4b-40fe-ab12-92a4d00c63f5 None admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:19:06.412157 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd57db15-7b4b-40fe-ab12-92a4d00c63f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:19:06.412474 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd57db15-7b4b-40fe-ab12-92a4d00c63f5 None admin] PATH_INFO: `/v3/projects/3d6e00339cfa47d2a6fa8724c587035f/users/5b56f96cb3184a3ba82c8a0c3427e268/roles/f34412ad29f1478cba775b033129f71f` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:19:06.415786 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd57db15-7b4b-40fe-ab12-92a4d00c63f5 None admin] RBAC: Authorizing `identity:create_grant(project_id=3d6e00339cfa47d2a6fa8724c587035f, user_id=5b56f96cb3184a3ba82c8a0c3427e268, role_id=f34412ad29f1478cba775b033129f71f)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:19:06.417259 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd57db15-7b4b-40fe-ab12-92a4d00c63f5 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:19:06.432226 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 646/1273] 10.222.0.27 () {58 vars in 1439 bytes} [Tue Sep 13 15:19:06 2022] PUT /identity/v3/projects/3d6e00339cfa47d2a6fa8724c587035f/users/5b56f96cb3184a3ba82c8a0c3427e268/roles/f34412ad29f1478cba775b033129f71f => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:19:08.572996 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8310325b-689d-4da8-89eb-b05cc99b9bb5 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:19:08.573532 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8310325b-689d-4da8-89eb-b05cc99b9bb5 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:19:08.573532 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8310325b-689d-4da8-89eb-b05cc99b9bb5 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:19:08.574920 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 628/1274] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:19:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:19:08.579946 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc3228c-f74d-4873-a908-43375b0c05e2 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:19:08.580361 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc3228c-f74d-4873-a908-43375b0c05e2 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:19:08.580520 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc3228c-f74d-4873-a908-43375b0c05e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:19:08.598898 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-adc3228c-f74d-4873-a908-43375b0c05e2 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:19:08.600072 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-adc3228c-f74d-4873-a908-43375b0c05e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:19:08.664269 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 647/1275] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:19:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 15:19:08.930587 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8310325b-689d-4da8-89eb-b05cc99b9bb5 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:19:09.028856 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8310325b-689d-4da8-89eb-b05cc99b9bb5 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:19:09.045431 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:19:09.063108 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e700ea6-f47a-4d77-9ec1-ec456ac3948f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:19:09.063720 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e700ea6-f47a-4d77-9ec1-ec456ac3948f None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:19:09.064000 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e700ea6-f47a-4d77-9ec1-ec456ac3948f None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:19:09.064271 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e700ea6-f47a-4d77-9ec1-ec456ac3948f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:19:09.074819 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e700ea6-f47a-4d77-9ec1-ec456ac3948f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 15:19:09.079617 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-2e700ea6-f47a-4d77-9ec1-ec456ac3948f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 15:19:09.079617 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:19:09.079617 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:19:09.079617 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:19:09.079617 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:19:09.079617 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:19:09.079617 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:19:09.079617 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:19:09.079617 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:19:09.079617 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:19:09.079617 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:19:09.079617 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:19:09.079617 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 15:19:09.079617 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 15:19:09.079617 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 15:19:09.079617 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 15:19:09.080817 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 15:19:09.080817 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 15:19:09.080817 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 15:19:09.080817 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 15:19:09.080817 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:19:09.080817 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:19:09.080817 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:19:09.080817 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:19:09.080817 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:19:09.080817 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:19:09.080817 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:19:09.080817 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Sep 13 15:19:09.080817 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:19:09.080817 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:19:09.080817 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:19:09.080817 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:19:09.081912 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:19:09.081912 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:19:09.081912 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:19:09.081912 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:19:09.081912 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 15:19:09.081912 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 15:19:09.081912 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 15:19:09.081912 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 15:19:09.081912 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 15:19:09.081912 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 15:19:09.081912 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 15:19:09.081912 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Sep 13 15:19:09.081912 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 629/1276] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Sep 13 15:19:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:19:09.086694 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc3228c-f74d-4873-a908-43375b0c05e2 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:19:09.165627 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:19:09.184481 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc3228c-f74d-4873-a908-43375b0c05e2 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:19:09.217670 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9244c4-c105-4e6b-a3af-7dca8dd35d31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:19:09.218297 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9244c4-c105-4e6b-a3af-7dca8dd35d31 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:19:09.218586 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9244c4-c105-4e6b-a3af-7dca8dd35d31 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:19:09.218858 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9244c4-c105-4e6b-a3af-7dca8dd35d31 None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:19:09.219513 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9244c4-c105-4e6b-a3af-7dca8dd35d31 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:19:09.219818 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9244c4-c105-4e6b-a3af-7dca8dd35d31 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:19:09.221181 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9244c4-c105-4e6b-a3af-7dca8dd35d31 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:19:09.229683 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 648/1277] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Sep 13 15:19:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:19:09.235478 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e700ea6-f47a-4d77-9ec1-ec456ac3948f None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:19:09.333827 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e700ea6-f47a-4d77-9ec1-ec456ac3948f None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:19:09.366071 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f7e892-8dd9-4408-81e9-f2baaa034bed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:19:09.367293 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f7e892-8dd9-4408-81e9-f2baaa034bed None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:19:09.367617 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f7e892-8dd9-4408-81e9-f2baaa034bed None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:19:09.367885 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f7e892-8dd9-4408-81e9-f2baaa034bed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:19:09.377398 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f7e892-8dd9-4408-81e9-f2baaa034bed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:19:09.378951 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f7e892-8dd9-4408-81e9-f2baaa034bed None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:19:09.393295 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-d5f7e892-8dd9-4408-81e9-f2baaa034bed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 15:19:09.393295 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:19:09.393295 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:19:09.393295 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:19:09.393295 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:19:09.393295 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:19:09.393295 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:19:09.393295 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:19:09.393295 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:19:09.393295 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:19:09.393295 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:19:09.393295 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:19:09.393295 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 15:19:09.393295 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 15:19:09.393295 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 15:19:09.393295 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 15:19:09.394361 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:19:09.394361 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:19:09.394361 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:19:09.394361 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:19:09.394361 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:19:09.394361 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:19:09.394361 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:19:09.394361 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Sep 13 15:19:09.394361 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:19:09.394361 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:19:09.394361 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:19:09.394361 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:19:09.394361 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:19:09.394361 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:19:09.394361 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:19:09.394361 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:19:09.394361 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 15:19:09.395262 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 15:19:09.395262 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 15:19:09.395262 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Sep 13 15:19:09.395262 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 630/1278] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 13 15:19:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:19:09.400749 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9244c4-c105-4e6b-a3af-7dca8dd35d31 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:19:09.513351 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9244c4-c105-4e6b-a3af-7dca8dd35d31 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:19:09.546189 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b53f9f4-4218-4ab7-a7e7-06e3c863064c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:19:09.546795 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b53f9f4-4218-4ab7-a7e7-06e3c863064c None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:19:09.547079 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b53f9f4-4218-4ab7-a7e7-06e3c863064c None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:19:09.547357 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b53f9f4-4218-4ab7-a7e7-06e3c863064c None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:19:09.547992 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b53f9f4-4218-4ab7-a7e7-06e3c863064c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:19:09.548297 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b53f9f4-4218-4ab7-a7e7-06e3c863064c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:19:09.549671 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b53f9f4-4218-4ab7-a7e7-06e3c863064c None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:19:09.561103 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 649/1279] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Sep 13 15:19:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:19:09.567075 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f7e892-8dd9-4408-81e9-f2baaa034bed None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:19:09.598364 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:19:09.666263 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f7e892-8dd9-4408-81e9-f2baaa034bed None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:19:09.698249 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ff3a44-1089-4d5c-ae2e-784abafd1d07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:19:09.698924 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ff3a44-1089-4d5c-ae2e-784abafd1d07 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:19:09.699205 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ff3a44-1089-4d5c-ae2e-784abafd1d07 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:19:09.699474 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ff3a44-1089-4d5c-ae2e-784abafd1d07 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:19:09.706497 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ff3a44-1089-4d5c-ae2e-784abafd1d07 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:19:09.707915 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ff3a44-1089-4d5c-ae2e-784abafd1d07 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:19:09.719569 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-71ff3a44-1089-4d5c-ae2e-784abafd1d07 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 13 15:19:09.719569 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:19:09.719569 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:19:09.719569 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:19:09.719569 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:19:09.719569 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:19:09.719569 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:19:09.719569 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:19:09.719569 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:19:09.719569 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:19:09.719569 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:19:09.719569 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:19:09.719569 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 15:19:09.719569 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 15:19:09.719569 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 15:19:09.719569 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 15:19:09.720602 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:19:09.720602 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:19:09.720602 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 15:19:09.720602 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 15:19:09.720602 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 15:19:09.720602 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 15:19:09.720602 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:19:09.720602 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:19:09.720602 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:19:09.720602 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:19:09.720602 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:19:09.720602 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Sep 13 15:19:09.720602 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:19:09.720602 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:19:09.720602 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:19:09.720602 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:19:09.720602 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:19:09.720602 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:19:09.721673 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:19:09.721673 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:19:09.721673 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 15:19:09.721673 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 15:19:09.721673 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 15:19:09.721673 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 15:19:09.721673 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 15:19:09.721673 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 15:19:09.721673 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 13 15:19:09.721673 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Sep 13 15:19:09.721673 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 631/1280] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 13 15:19:09 2022] GET /identity/v3/users/placement => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:19:09.727044 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b53f9f4-4218-4ab7-a7e7-06e3c863064c None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:19:09.731173 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:19:09.824451 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b53f9f4-4218-4ab7-a7e7-06e3c863064c None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:19:09.857784 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688d924a-e4b8-4b9f-91e5-2c0a2bed9703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:19:09.858374 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688d924a-e4b8-4b9f-91e5-2c0a2bed9703 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:19:09.858651 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688d924a-e4b8-4b9f-91e5-2c0a2bed9703 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:19:09.858923 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688d924a-e4b8-4b9f-91e5-2c0a2bed9703 None admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:19:09.859634 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688d924a-e4b8-4b9f-91e5-2c0a2bed9703 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:19:09.859940 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688d924a-e4b8-4b9f-91e5-2c0a2bed9703 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:19:09.861355 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688d924a-e4b8-4b9f-91e5-2c0a2bed9703 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:19:09.877709 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 650/1281] 10.222.0.27 () {56 vars in 1143 bytes} [Tue Sep 13 15:19:09 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:19:09.884055 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ff3a44-1089-4d5c-ae2e-784abafd1d07 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:19:09.973322 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:19:09.983537 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ff3a44-1089-4d5c-ae2e-784abafd1d07 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:19:10.016033 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafb32d9-6a5d-4e9a-900b-a98784fdb7a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:19:10.016633 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafb32d9-6a5d-4e9a-900b-a98784fdb7a4 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:19:10.016918 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafb32d9-6a5d-4e9a-900b-a98784fdb7a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:19:10.017195 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafb32d9-6a5d-4e9a-900b-a98784fdb7a4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:19:10.081881 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafb32d9-6a5d-4e9a-900b-a98784fdb7a4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:19:10.083249 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafb32d9-6a5d-4e9a-900b-a98784fdb7a4 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:19:10.168002 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:19:10.178275 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 632/1282] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Sep 13 15:19:09 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 15:19:10.184221 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688d924a-e4b8-4b9f-91e5-2c0a2bed9703 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:19:10.244785 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:19:10.282678 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688d924a-e4b8-4b9f-91e5-2c0a2bed9703 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:19:10.315572 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748c90bb-892e-4fd0-a5ff-c37697f50d68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:19:10.316186 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748c90bb-892e-4fd0-a5ff-c37697f50d68 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:19:10.316467 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748c90bb-892e-4fd0-a5ff-c37697f50d68 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:19:10.316740 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748c90bb-892e-4fd0-a5ff-c37697f50d68 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:19:10.326980 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748c90bb-892e-4fd0-a5ff-c37697f50d68 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:19:10.328403 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748c90bb-892e-4fd0-a5ff-c37697f50d68 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:19:10.342601 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-748c90bb-892e-4fd0-a5ff-c37697f50d68 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 15:19:10.342601 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:19:10.342601 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:19:10.342601 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:19:10.342601 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:19:10.342601 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:19:10.342601 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:19:10.342601 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:19:10.342601 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:19:10.342601 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:19:10.342601 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:19:10.342601 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:19:10.342601 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 15:19:10.342601 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 15:19:10.342601 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 15:19:10.342601 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 15:19:10.343735 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:19:10.343735 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:19:10.343735 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:19:10.343735 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:19:10.343735 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:19:10.343735 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:19:10.343735 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:19:10.343735 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Sep 13 15:19:10.343735 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:19:10.343735 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:19:10.343735 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:19:10.343735 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:19:10.343735 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:19:10.343735 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:19:10.343735 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:19:10.343735 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:19:10.343735 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 15:19:10.345044 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 15:19:10.345044 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 15:19:10.345044 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Sep 13 15:19:10.345044 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 651/1283] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 13 15:19:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:19:10.349261 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafb32d9-6a5d-4e9a-900b-a98784fdb7a4 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:19:10.446539 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafb32d9-6a5d-4e9a-900b-a98784fdb7a4 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:19:10.478682 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a4f4dd-f6ea-4726-9d11-b3cdc8a1dc46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:19:10.479285 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a4f4dd-f6ea-4726-9d11-b3cdc8a1dc46 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:19:10.479570 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a4f4dd-f6ea-4726-9d11-b3cdc8a1dc46 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:19:10.479848 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a4f4dd-f6ea-4726-9d11-b3cdc8a1dc46 None admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:19:10.480485 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a4f4dd-f6ea-4726-9d11-b3cdc8a1dc46 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:19:10.480789 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a4f4dd-f6ea-4726-9d11-b3cdc8a1dc46 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:19:10.482179 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a4f4dd-f6ea-4726-9d11-b3cdc8a1dc46 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:19:10.493711 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 633/1284] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Sep 13 15:19:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:19:10.499376 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748c90bb-892e-4fd0-a5ff-c37697f50d68 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:19:10.596188 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748c90bb-892e-4fd0-a5ff-c37697f50d68 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:19:10.609639 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:19:10.630682 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812a4aab-d9f3-44bd-927b-6f5bb00feaf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:19:10.631298 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812a4aab-d9f3-44bd-927b-6f5bb00feaf2 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:19:10.631590 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812a4aab-d9f3-44bd-927b-6f5bb00feaf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:19:10.631951 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812a4aab-d9f3-44bd-927b-6f5bb00feaf2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:19:10.638388 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812a4aab-d9f3-44bd-927b-6f5bb00feaf2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:19:10.639818 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812a4aab-d9f3-44bd-927b-6f5bb00feaf2 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:19:10.651848 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-812a4aab-d9f3-44bd-927b-6f5bb00feaf2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 15:19:10.651848 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:19:10.651848 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:19:10.651848 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:19:10.651848 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:19:10.651848 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:19:10.651848 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:19:10.651848 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:19:10.651848 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:19:10.651848 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:19:10.651848 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:19:10.651848 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:19:10.651848 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 15:19:10.651848 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 15:19:10.651848 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 15:19:10.652903 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 15:19:10.652903 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:19:10.652903 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:19:10.652903 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:19:10.652903 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:19:10.652903 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:19:10.652903 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:19:10.652903 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:19:10.652903 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Sep 13 15:19:10.652903 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:19:10.652903 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:19:10.652903 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:19:10.652903 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:19:10.652903 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:19:10.652903 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:19:10.652903 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:19:10.652903 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:19:10.654055 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 15:19:10.654055 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 15:19:10.654055 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 15:19:10.654055 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 15:19:10.654055 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 15:19:10.654055 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 15:19:10.654055 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 15:19:10.654055 dv-cinder-857434-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Sep 13 15:19:10.654055 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 652/1285] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Sep 13 15:19:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:19:10.658771 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a4f4dd-f6ea-4726-9d11-b3cdc8a1dc46 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:19:10.708027 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:19:10.757656 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a4f4dd-f6ea-4726-9d11-b3cdc8a1dc46 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:19:10.789670 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188b1a08-7042-40d5-98e8-01299765f2ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:19:10.790302 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188b1a08-7042-40d5-98e8-01299765f2ac None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:19:10.790584 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188b1a08-7042-40d5-98e8-01299765f2ac None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:19:10.790860 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188b1a08-7042-40d5-98e8-01299765f2ac None admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:19:10.791540 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188b1a08-7042-40d5-98e8-01299765f2ac None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:19:10.791848 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188b1a08-7042-40d5-98e8-01299765f2ac None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:19:10.793265 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188b1a08-7042-40d5-98e8-01299765f2ac None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:19:10.806114 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 634/1286] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Sep 13 15:19:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 15:19:10.812289 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812a4aab-d9f3-44bd-927b-6f5bb00feaf2 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:19:10.907136 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812a4aab-d9f3-44bd-927b-6f5bb00feaf2 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:19:10.939594 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cf2325-106c-47aa-b615-675459bcc8c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:19:10.940181 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cf2325-106c-47aa-b615-675459bcc8c2 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:19:10.940456 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cf2325-106c-47aa-b615-675459bcc8c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:19:10.940727 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cf2325-106c-47aa-b615-675459bcc8c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:19:10.941434 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cf2325-106c-47aa-b615-675459bcc8c2 None admin] RBAC: Adding query filter params (role.id=f34412ad29f1478cba775b033129f71f, scope.project.id=3d6e00339cfa47d2a6fa8724c587035f, user.id=5b56f96cb3184a3ba82c8a0c3427e268) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:19:10.941763 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cf2325-106c-47aa-b615-675459bcc8c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:19:10.943178 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cf2325-106c-47aa-b615-675459bcc8c2 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:19:10.948890 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 653/1287] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Sep 13 15:19:10 2022] GET /identity/v3/role_assignments?user.id=5b56f96cb3184a3ba82c8a0c3427e268&scope.project.id=3d6e00339cfa47d2a6fa8724c587035f&role.id=f34412ad29f1478cba775b033129f71f => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:19:13.101656 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812e2f4c-293c-496e-af3e-a6b27ec8dcd0 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:19:13.102223 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812e2f4c-293c-496e-af3e-a6b27ec8dcd0 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:19:13.102223 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812e2f4c-293c-496e-af3e-a6b27ec8dcd0 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:19:13.103480 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 635/1288] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:19:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:19:13.108590 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22154d6-e6ac-4606-a511-ce815d461d1c None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:19:13.109010 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22154d6-e6ac-4606-a511-ce815d461d1c None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:19:13.109144 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22154d6-e6ac-4606-a511-ce815d461d1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:19:13.127093 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-c22154d6-e6ac-4606-a511-ce815d461d1c None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:19:13.128285 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-c22154d6-e6ac-4606-a511-ce815d461d1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:19:13.157513 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:19:13.193550 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 654/1289] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:19:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 15:19:13.461095 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812e2f4c-293c-496e-af3e-a6b27ec8dcd0 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:19:13.560294 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812e2f4c-293c-496e-af3e-a6b27ec8dcd0 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:19:13.571424 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:19:13.594455 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ff9352-aa59-4825-a842-33d66085ac70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:19:13.595079 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ff9352-aa59-4825-a842-33d66085ac70 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:19:13.595365 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ff9352-aa59-4825-a842-33d66085ac70 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:19:13.595642 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ff9352-aa59-4825-a842-33d66085ac70 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:19:13.596221 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ff9352-aa59-4825-a842-33d66085ac70 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:19:13.597577 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ff9352-aa59-4825-a842-33d66085ac70 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:19:13.606830 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-f7ff9352-aa59-4825-a842-33d66085ac70 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 13 15:19:13.606830 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:19:13.606830 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 15:19:13.606830 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 15:19:13.606830 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 15:19:13.606830 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 15:19:13.606830 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 15:19:13.606830 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 15:19:13.606830 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 13 15:19:13.606830 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Sep 13 15:19:13.606830 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 15:19:13.606830 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Sep 13 15:19:13.606830 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:19:13.606830 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:19:13.606830 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:19:13.606830 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:19:13.606830 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:19:13.608049 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:19:13.608049 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:19:13.608049 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:19:13.608049 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:19:13.608049 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:19:13.608049 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:19:13.608049 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 15:19:13.608049 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 15:19:13.608049 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 15:19:13.608049 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 15:19:13.608049 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:19:13.608049 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:19:13.608049 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:19:13.608049 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:19:13.608049 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:19:13.608049 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:19:13.609056 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:19:13.609056 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Sep 13 15:19:13.609056 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:19:13.609056 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:19:13.609056 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:19:13.609056 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:19:13.609056 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:19:13.609056 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:19:13.609056 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:19:13.609056 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:19:13.609056 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 15:19:13.609056 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 15:19:13.609056 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 13 15:19:13.609056 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Sep 13 15:19:13.609056 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 636/1290] 10.222.0.27 () {56 vars in 1117 bytes} [Tue Sep 13 15:19:13 2022] GET /identity/v3/services/placement => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:19:13.613826 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22154d6-e6ac-4606-a511-ce815d461d1c None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:19:13.709691 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22154d6-e6ac-4606-a511-ce815d461d1c None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:19:13.743136 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db4896e-294c-48ea-b540-c8e3af666335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:19:13.743742 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db4896e-294c-48ea-b540-c8e3af666335 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:19:13.744026 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db4896e-294c-48ea-b540-c8e3af666335 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:19:13.744303 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db4896e-294c-48ea-b540-c8e3af666335 None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:19:13.744929 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db4896e-294c-48ea-b540-c8e3af666335 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:19:13.745238 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db4896e-294c-48ea-b540-c8e3af666335 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:19:13.746639 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db4896e-294c-48ea-b540-c8e3af666335 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:19:13.751299 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 655/1291] 10.222.0.27 () {56 vars in 1116 bytes} [Tue Sep 13 15:19:13 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:19:13.757718 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ff9352-aa59-4825-a842-33d66085ac70 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:19:13.854170 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ff9352-aa59-4825-a842-33d66085ac70 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:19:13.886292 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e8244a-0001-47fb-bd2d-0ec3b006a415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:19:13.886883 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e8244a-0001-47fb-bd2d-0ec3b006a415 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:19:13.887164 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e8244a-0001-47fb-bd2d-0ec3b006a415 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:19:13.887438 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e8244a-0001-47fb-bd2d-0ec3b006a415 None admin] PATH_INFO: `/v3/services` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:19:13.888053 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e8244a-0001-47fb-bd2d-0ec3b006a415 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:19:13.888357 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e8244a-0001-47fb-bd2d-0ec3b006a415 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:19:13.889734 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e8244a-0001-47fb-bd2d-0ec3b006a415 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:19:13.893987 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 637/1292] 10.222.0.27 () {56 vars in 1116 bytes} [Tue Sep 13 15:19:13 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:19:16.002398 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68109b0-21f1-4c9b-852e-dd9b776c6542 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:19:16.002903 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68109b0-21f1-4c9b-852e-dd9b776c6542 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:19:16.002903 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68109b0-21f1-4c9b-852e-dd9b776c6542 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:19:16.004224 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 656/1293] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:19:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:19:16.010070 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b7031d-0f9f-42ff-8f7c-30f9bd3404a7 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:19:16.010470 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b7031d-0f9f-42ff-8f7c-30f9bd3404a7 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:19:16.010619 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b7031d-0f9f-42ff-8f7c-30f9bd3404a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:19:16.028957 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-c7b7031d-0f9f-42ff-8f7c-30f9bd3404a7 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:19:16.030181 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-c7b7031d-0f9f-42ff-8f7c-30f9bd3404a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:19:16.058448 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:19:16.096095 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 638/1294] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:19:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 15:19:16.361861 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68109b0-21f1-4c9b-852e-dd9b776c6542 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:19:16.393084 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:19:16.463939 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68109b0-21f1-4c9b-852e-dd9b776c6542 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:19:16.496491 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746e2589-70b3-44d1-b567-a7d14b2a293a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:19:16.497084 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746e2589-70b3-44d1-b567-a7d14b2a293a None admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:19:16.497360 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746e2589-70b3-44d1-b567-a7d14b2a293a None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:19:16.497630 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746e2589-70b3-44d1-b567-a7d14b2a293a None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:19:16.498302 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746e2589-70b3-44d1-b567-a7d14b2a293a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:19:16.499665 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746e2589-70b3-44d1-b567-a7d14b2a293a None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:19:16.514183 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 657/1295] 10.222.0.27 () {60 vars in 1141 bytes} [Tue Sep 13 15:19:16 2022] POST /identity/v3/services => generated 246 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:19:18.640011 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362f7efb-0fe8-43c1-86c3-7a24b9769cbc None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:19:18.640546 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362f7efb-0fe8-43c1-86c3-7a24b9769cbc None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:19:18.640546 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362f7efb-0fe8-43c1-86c3-7a24b9769cbc None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:19:18.641967 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 639/1296] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:19:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:19:18.647704 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016c3bb5-254d-41cf-b315-c231e6cdbf12 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:19:18.648194 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016c3bb5-254d-41cf-b315-c231e6cdbf12 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:19:18.648285 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016c3bb5-254d-41cf-b315-c231e6cdbf12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:19:18.666523 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-016c3bb5-254d-41cf-b315-c231e6cdbf12 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:19:18.667706 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-016c3bb5-254d-41cf-b315-c231e6cdbf12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:19:18.738603 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 658/1297] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:19:18 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 15:19:19.003004 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362f7efb-0fe8-43c1-86c3-7a24b9769cbc None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:19:19.101718 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362f7efb-0fe8-43c1-86c3-7a24b9769cbc None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:19:19.135065 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13960d0-9032-437b-9c27-682ce6151842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:19:19.135681 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13960d0-9032-437b-9c27-682ce6151842 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:19:19.135957 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13960d0-9032-437b-9c27-682ce6151842 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:19:19.136227 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13960d0-9032-437b-9c27-682ce6151842 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:19:19.136829 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13960d0-9032-437b-9c27-682ce6151842 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:19:19.138206 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13960d0-9032-437b-9c27-682ce6151842 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:19:19.146767 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-c13960d0-9032-437b-9c27-682ce6151842 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 13 15:19:19.146767 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:19:19.146767 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 15:19:19.146767 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 15:19:19.146767 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 15:19:19.146767 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 15:19:19.146767 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 15:19:19.146767 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 15:19:19.146767 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 13 15:19:19.146767 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Sep 13 15:19:19.146767 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 15:19:19.146767 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Sep 13 15:19:19.146767 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:19:19.146767 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:19:19.146767 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:19:19.146767 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:19:19.146767 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:19:19.148024 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:19:19.148024 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:19:19.148024 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:19:19.148024 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:19:19.148024 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:19:19.148024 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:19:19.148024 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 15:19:19.148024 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 15:19:19.148024 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 15:19:19.148024 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 15:19:19.148024 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:19:19.148024 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:19:19.148024 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:19:19.148024 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:19:19.148024 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:19:19.148024 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:19:19.149084 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:19:19.149084 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Sep 13 15:19:19.149084 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:19:19.149084 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:19:19.149084 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:19:19.149084 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:19:19.149084 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:19:19.149084 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:19:19.149084 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:19:19.149084 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:19:19.149084 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 15:19:19.149084 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 15:19:19.149084 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 13 15:19:19.149084 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Sep 13 15:19:19.149084 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 640/1298] 10.222.0.27 () {56 vars in 1117 bytes} [Tue Sep 13 15:19:19 2022] GET /identity/v3/services/placement => generated 90 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:19:19.153932 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016c3bb5-254d-41cf-b315-c231e6cdbf12 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:19:19.171873 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:19:19.251324 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016c3bb5-254d-41cf-b315-c231e6cdbf12 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:19:19.284153 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b0a8f3-001e-432c-95e0-0a54bc19ebcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:19:19.284960 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b0a8f3-001e-432c-95e0-0a54bc19ebcf None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:19:19.285234 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b0a8f3-001e-432c-95e0-0a54bc19ebcf None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:19:19.285502 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b0a8f3-001e-432c-95e0-0a54bc19ebcf None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:19:19.286141 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b0a8f3-001e-432c-95e0-0a54bc19ebcf None admin] RBAC: Adding query filter params (name=placement) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:19:19.286441 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b0a8f3-001e-432c-95e0-0a54bc19ebcf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:19:19.288097 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b0a8f3-001e-432c-95e0-0a54bc19ebcf None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:19:19.293098 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 659/1299] 10.222.0.27 () {56 vars in 1116 bytes} [Tue Sep 13 15:19:19 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:19:19.298951 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13960d0-9032-437b-9c27-682ce6151842 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:19:19.331081 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:19:19.400494 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13960d0-9032-437b-9c27-682ce6151842 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:19:19.441987 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ba3811-2274-45b4-b1de-04ddbde0d62f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:19:19.442652 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ba3811-2274-45b4-b1de-04ddbde0d62f None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:19:19.442932 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ba3811-2274-45b4-b1de-04ddbde0d62f None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:19:19.443274 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ba3811-2274-45b4-b1de-04ddbde0d62f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:19:19.444877 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ba3811-2274-45b4-b1de-04ddbde0d62f None admin] RBAC: Adding query filter params (interface=public, service_id=2ce6fd54ba71441fba6adfde7b6ae9a5, region_id=RegionOne) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:19:19.445240 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ba3811-2274-45b4-b1de-04ddbde0d62f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:19:19.446893 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ba3811-2274-45b4-b1de-04ddbde0d62f None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:19:19.452829 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 641/1300] 10.222.0.27 () {56 vars in 1251 bytes} [Tue Sep 13 15:19:19 2022] GET /identity/v3/endpoints?service_id=2ce6fd54ba71441fba6adfde7b6ae9a5&interface=public®ion_id=RegionOne => generated 194 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:19:19.459899 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b0a8f3-001e-432c-95e0-0a54bc19ebcf None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:19:19.540335 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:19:19.558968 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b0a8f3-001e-432c-95e0-0a54bc19ebcf None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:19:19.591739 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58a84a1-d498-4fb6-8d55-6aa2420304ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:19:19.592332 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58a84a1-d498-4fb6-8d55-6aa2420304ec None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:19:19.592610 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58a84a1-d498-4fb6-8d55-6aa2420304ec None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:19:19.592880 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58a84a1-d498-4fb6-8d55-6aa2420304ec None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:19:19.593492 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58a84a1-d498-4fb6-8d55-6aa2420304ec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:19:19.594973 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58a84a1-d498-4fb6-8d55-6aa2420304ec None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:19:19.602399 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 660/1301] 10.222.0.27 () {56 vars in 1087 bytes} [Tue Sep 13 15:19:19 2022] GET /identity/v3/services => generated 2191 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 15:19:21.730091 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb566de-4236-45c2-b0bc-ddc438e51e99 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:19:21.730544 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb566de-4236-45c2-b0bc-ddc438e51e99 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:19:21.730648 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb566de-4236-45c2-b0bc-ddc438e51e99 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:19:21.731986 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 642/1302] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:19:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:19:21.737150 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946759d7-53c0-4055-a944-e568ee5b7912 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:19:21.737557 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946759d7-53c0-4055-a944-e568ee5b7912 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:19:21.737734 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946759d7-53c0-4055-a944-e568ee5b7912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:19:21.755499 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-946759d7-53c0-4055-a944-e568ee5b7912 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:19:21.756995 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-946759d7-53c0-4055-a944-e568ee5b7912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:19:21.822470 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 661/1303] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:19:21 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 15:19:22.087190 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb566de-4236-45c2-b0bc-ddc438e51e99 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:19:22.179141 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:19:22.185966 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb566de-4236-45c2-b0bc-ddc438e51e99 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:19:22.218806 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88718be8-c7a9-408e-b7cd-c0cd4d055287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:19:22.219414 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88718be8-c7a9-408e-b7cd-c0cd4d055287 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:19:22.219692 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88718be8-c7a9-408e-b7cd-c0cd4d055287 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:19:22.219959 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88718be8-c7a9-408e-b7cd-c0cd4d055287 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:19:22.220531 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88718be8-c7a9-408e-b7cd-c0cd4d055287 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:19:22.221898 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88718be8-c7a9-408e-b7cd-c0cd4d055287 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:19:22.230459 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-88718be8-c7a9-408e-b7cd-c0cd4d055287 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 13 15:19:22.230459 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:19:22.230459 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 15:19:22.230459 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 15:19:22.230459 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 15:19:22.230459 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 15:19:22.230459 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 15:19:22.230459 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 15:19:22.230459 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 13 15:19:22.230459 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Sep 13 15:19:22.230459 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 15:19:22.230459 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Sep 13 15:19:22.230459 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 15:19:22.230459 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 15:19:22.230459 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 15:19:22.230459 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 15:19:22.230459 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 15:19:22.231619 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 15:19:22.231619 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 15:19:22.231619 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 15:19:22.231619 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 15:19:22.231619 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 15:19:22.231619 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 15:19:22.231619 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 15:19:22.231619 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 15:19:22.231619 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 15:19:22.231619 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 15:19:22.231619 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 15:19:22.231619 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 15:19:22.231619 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 15:19:22.231619 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 15:19:22.231619 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 15:19:22.231619 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 15:19:22.232474 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 15:19:22.232474 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Sep 13 15:19:22.232474 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 15:19:22.232474 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Sep 13 15:19:22.232474 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 15:19:22.232474 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 15:19:22.232474 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 15:19:22.232474 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Sep 13 15:19:22.232474 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 15:19:22.232474 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Sep 13 15:19:22.232474 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 15:19:22.232474 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 15:19:22.232474 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 13 15:19:22.232474 dv-cinder-857434-2-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Sep 13 15:19:22.232474 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 643/1304] 10.222.0.27 () {56 vars in 1117 bytes} [Tue Sep 13 15:19:22 2022] GET /identity/v3/services/placement => generated 90 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 15:19:22.237600 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946759d7-53c0-4055-a944-e568ee5b7912 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:19:22.311329 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:19:22.338878 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946759d7-53c0-4055-a944-e568ee5b7912 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:19:22.374202 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e4a5d0-7923-4600-9cd5-a97d98883c01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:19:22.374796 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e4a5d0-7923-4600-9cd5-a97d98883c01 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:19:22.375073 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e4a5d0-7923-4600-9cd5-a97d98883c01 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:19:22.375343 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e4a5d0-7923-4600-9cd5-a97d98883c01 None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:19:22.375958 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e4a5d0-7923-4600-9cd5-a97d98883c01 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:19:22.376257 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e4a5d0-7923-4600-9cd5-a97d98883c01 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:19:22.377608 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e4a5d0-7923-4600-9cd5-a97d98883c01 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:19:22.383528 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 662/1305] 10.222.0.27 () {56 vars in 1116 bytes} [Tue Sep 13 15:19:22 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:19:22.389324 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88718be8-c7a9-408e-b7cd-c0cd4d055287 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:19:22.499056 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88718be8-c7a9-408e-b7cd-c0cd4d055287 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:19:22.532054 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a253b10-7eb5-4ad4-8f11-d9d4851e2977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:19:22.532647 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a253b10-7eb5-4ad4-8f11-d9d4851e2977 None admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:19:22.532925 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a253b10-7eb5-4ad4-8f11-d9d4851e2977 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:19:22.533197 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a253b10-7eb5-4ad4-8f11-d9d4851e2977 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:19:22.533886 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a253b10-7eb5-4ad4-8f11-d9d4851e2977 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:19:22.535227 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a253b10-7eb5-4ad4-8f11-d9d4851e2977 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:19:22.555683 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 644/1306] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 13 15:19:22 2022] POST /identity/v3/endpoints => generated 331 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:19:32.379620 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=30 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:19:32.550574 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:20:26.354578 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48f08b9-4475-416c-8de9-1ec21e593d7c None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:20:26.355662 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48f08b9-4475-416c-8de9-1ec21e593d7c None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:20:26.356163 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48f08b9-4475-416c-8de9-1ec21e593d7c None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:20:26.358371 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 663/1307] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:20:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:20:26.364198 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752e79e1-1bc3-4b29-90ea-ad3ab510b454 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:20:26.366476 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752e79e1-1bc3-4b29-90ea-ad3ab510b454 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:20:26.368234 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752e79e1-1bc3-4b29-90ea-ad3ab510b454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:20:26.585633 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-752e79e1-1bc3-4b29-90ea-ad3ab510b454 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:20:26.587469 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-752e79e1-1bc3-4b29-90ea-ad3ab510b454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:20:26.743305 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 645/1308] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:20:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 380 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:20:27.036517 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b9a835-fc90-4809-903f-da1609d16eee None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:20:27.037262 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b9a835-fc90-4809-903f-da1609d16eee None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:20:27.037789 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b9a835-fc90-4809-903f-da1609d16eee None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:20:27.039732 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 664/1309] 10.222.0.27 () {54 vars in 965 bytes} [Tue Sep 13 15:20:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:20:27.045941 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42034dcf-fc4f-46e6-8d92-d12796c67ba7 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:20:27.046234 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42034dcf-fc4f-46e6-8d92-d12796c67ba7 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:20:27.046729 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42034dcf-fc4f-46e6-8d92-d12796c67ba7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:20:27.145183 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-42034dcf-fc4f-46e6-8d92-d12796c67ba7 None None] MFA Rules not processed for user `41675154bbba47388040966f75d84c3c`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:20:27.146462 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-42034dcf-fc4f-46e6-8d92-d12796c67ba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:20:27.169666 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:20:27.234045 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 646/1310] 10.222.0.27 () {58 vars in 1062 bytes} [Tue Sep 13 15:20:27 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:20:27.243673 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b9a835-fc90-4809-903f-da1609d16eee None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:20:27.245854 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-07b9a835-fc90-4809-903f-da1609d16eee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:20:27.364115 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b9a835-fc90-4809-903f-da1609d16eee None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:20:27.445795 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c4f8a9-4a89-47e1-8492-acfa7ece22ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41675154bbba47388040966f75d84c3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:20:27.446811 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c4f8a9-4a89-47e1-8492-acfa7ece22ec service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:20:27.447318 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c4f8a9-4a89-47e1-8492-acfa7ece22ec service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:20:27.447796 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c4f8a9-4a89-47e1-8492-acfa7ece22ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:20:27.449653 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-e3c4f8a9-4a89-47e1-8492-acfa7ece22ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:20:27.517514 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:20:27.582504 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c4f8a9-4a89-47e1-8492-acfa7ece22ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:20:27.584133 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c4f8a9-4a89-47e1-8492-acfa7ece22ec service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:20:27.604453 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 665/1311] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:20:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:20:30.071148 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fd8a02-ad65-4feb-b6a5-a71ba0742cb8 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:20:30.071694 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fd8a02-ad65-4feb-b6a5-a71ba0742cb8 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:20:30.071694 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fd8a02-ad65-4feb-b6a5-a71ba0742cb8 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:20:30.072984 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 647/1312] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:20:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:20:30.078297 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c40ca4f-c09c-4910-948d-bc254d8f13aa None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:20:30.078694 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c40ca4f-c09c-4910-948d-bc254d8f13aa None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:20:30.078979 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c40ca4f-c09c-4910-948d-bc254d8f13aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:20:30.152619 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-1c40ca4f-c09c-4910-948d-bc254d8f13aa None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:20:30.153859 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-1c40ca4f-c09c-4910-948d-bc254d8f13aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:20:30.253618 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 666/1313] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:20:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:20:30.536353 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fd8a02-ad65-4feb-b6a5-a71ba0742cb8 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:20:30.538009 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-36fd8a02-ad65-4feb-b6a5-a71ba0742cb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:20:30.648593 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fd8a02-ad65-4feb-b6a5-a71ba0742cb8 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:20:30.728413 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:20:30.730778 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1b8e91-d91a-4d42-8a71-204f1f4955f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41675154bbba47388040966f75d84c3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:20:30.731417 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1b8e91-d91a-4d42-8a71-204f1f4955f9 service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:20:30.731964 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1b8e91-d91a-4d42-8a71-204f1f4955f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:20:30.732467 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1b8e91-d91a-4d42-8a71-204f1f4955f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:20:30.734458 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-8c1b8e91-d91a-4d42-8a71-204f1f4955f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:20:30.851230 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1b8e91-d91a-4d42-8a71-204f1f4955f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:20:30.852670 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1b8e91-d91a-4d42-8a71-204f1f4955f9 service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:20:30.872350 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 648/1314] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:20:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:20:33.338228 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556996d1-d47d-4de2-9870-20a0d724fc83 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:20:33.338773 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556996d1-d47d-4de2-9870-20a0d724fc83 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:20:33.338773 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556996d1-d47d-4de2-9870-20a0d724fc83 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:20:33.340153 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 667/1315] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:20:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:20:33.345454 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3650009-bcc5-47c7-8d18-7ff905b7eb03 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:20:33.346512 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3650009-bcc5-47c7-8d18-7ff905b7eb03 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:20:33.347143 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3650009-bcc5-47c7-8d18-7ff905b7eb03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:20:33.413550 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-d3650009-bcc5-47c7-8d18-7ff905b7eb03 None None] MFA Rules not processed for user `5b2e21c1e08c42f18233d33bd9c6be68`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:20:33.414765 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-d3650009-bcc5-47c7-8d18-7ff905b7eb03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:20:33.465558 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:20:33.511653 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 649/1316] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:20:33 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:20:33.804255 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556996d1-d47d-4de2-9870-20a0d724fc83 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:20:33.805835 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-556996d1-d47d-4de2-9870-20a0d724fc83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:20:33.815835 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:20:33.908943 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556996d1-d47d-4de2-9870-20a0d724fc83 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:20:33.981395 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccd0724-b91a-4667-acd5-70d5d51b893d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41675154bbba47388040966f75d84c3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:20:33.981953 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccd0724-b91a-4667-acd5-70d5d51b893d service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:20:33.982237 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccd0724-b91a-4667-acd5-70d5d51b893d service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:20:33.982513 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccd0724-b91a-4667-acd5-70d5d51b893d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:20:33.984096 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-7ccd0724-b91a-4667-acd5-70d5d51b893d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:20:34.047124 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:20:34.093782 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccd0724-b91a-4667-acd5-70d5d51b893d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:20:34.095231 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccd0724-b91a-4667-acd5-70d5d51b893d service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:20:34.113930 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 668/1317] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:20:33 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:20:36.994019 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92e0438-abc4-4293-b59e-33dd49497f75 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:20:36.994530 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92e0438-abc4-4293-b59e-33dd49497f75 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:20:36.994530 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92e0438-abc4-4293-b59e-33dd49497f75 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:20:36.995842 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 650/1318] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:20:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:20:37.001248 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fd9717-3431-4824-84e2-6fc9a44cf515 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:20:37.001640 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fd9717-3431-4824-84e2-6fc9a44cf515 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:20:37.002473 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fd9717-3431-4824-84e2-6fc9a44cf515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:20:37.067605 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-20fd9717-3431-4824-84e2-6fc9a44cf515 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:20:37.068817 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-20fd9717-3431-4824-84e2-6fc9a44cf515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:20:37.161814 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 669/1319] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:20:36 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:20:37.453309 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92e0438-abc4-4293-b59e-33dd49497f75 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:20:37.454881 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-f92e0438-abc4-4293-b59e-33dd49497f75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:20:37.557213 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92e0438-abc4-4293-b59e-33dd49497f75 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:20:37.629499 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66003128-4522-4c92-8ff4-1e30b8ec787d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41675154bbba47388040966f75d84c3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:20:37.630127 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66003128-4522-4c92-8ff4-1e30b8ec787d service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:20:37.630405 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66003128-4522-4c92-8ff4-1e30b8ec787d service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:20:37.630675 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66003128-4522-4c92-8ff4-1e30b8ec787d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:20:37.632244 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-66003128-4522-4c92-8ff4-1e30b8ec787d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:20:37.638966 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:20:37.741876 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66003128-4522-4c92-8ff4-1e30b8ec787d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:20:37.743317 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66003128-4522-4c92-8ff4-1e30b8ec787d service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:20:37.761340 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 651/1320] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:20:37 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:20:40.572711 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ba5e46-31da-42a0-a021-bd08d4e102fe None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:20:40.573253 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ba5e46-31da-42a0-a021-bd08d4e102fe None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:20:40.573253 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ba5e46-31da-42a0-a021-bd08d4e102fe None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:20:40.574660 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 670/1321] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:20:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:20:40.580005 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d928511-3392-4b69-9138-c8f90ca74299 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:20:40.580524 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d928511-3392-4b69-9138-c8f90ca74299 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:20:40.580828 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d928511-3392-4b69-9138-c8f90ca74299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:20:40.656379 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-3d928511-3392-4b69-9138-c8f90ca74299 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:20:40.657684 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-3d928511-3392-4b69-9138-c8f90ca74299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:20:40.722513 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:20:40.765132 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 652/1322] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:20:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:20:41.056094 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ba5e46-31da-42a0-a021-bd08d4e102fe None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:20:41.057661 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-32ba5e46-31da-42a0-a021-bd08d4e102fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:20:41.078329 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:20:41.162891 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ba5e46-31da-42a0-a021-bd08d4e102fe None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:20:41.237231 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b662194-4ecd-482f-994b-657bba96d11d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41675154bbba47388040966f75d84c3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:20:41.237875 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b662194-4ecd-482f-994b-657bba96d11d service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:20:41.238156 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b662194-4ecd-482f-994b-657bba96d11d service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:20:41.238442 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b662194-4ecd-482f-994b-657bba96d11d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:20:41.240001 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-6b662194-4ecd-482f-994b-657bba96d11d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:20:41.311326 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:20:41.349631 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b662194-4ecd-482f-994b-657bba96d11d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:20:41.351111 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b662194-4ecd-482f-994b-657bba96d11d service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:20:41.369649 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 671/1323] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:20:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:20:43.583814 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35186f5-ff05-4b7e-8e6b-6ff79527072f None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:20:43.584339 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35186f5-ff05-4b7e-8e6b-6ff79527072f None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:20:43.584459 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35186f5-ff05-4b7e-8e6b-6ff79527072f None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:20:43.585720 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 653/1324] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:20:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:20:43.591022 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a2f26a-3da0-4033-afeb-2c53c77ce30f None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:20:43.591419 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a2f26a-3da0-4033-afeb-2c53c77ce30f None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:20:43.591575 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a2f26a-3da0-4033-afeb-2c53c77ce30f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:20:43.656935 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-16a2f26a-3da0-4033-afeb-2c53c77ce30f None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:20:43.658227 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-16a2f26a-3da0-4033-afeb-2c53c77ce30f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:20:43.767539 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 672/1325] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:20:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:20:44.050392 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35186f5-ff05-4b7e-8e6b-6ff79527072f None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:20:44.052098 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-b35186f5-ff05-4b7e-8e6b-6ff79527072f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:20:44.155900 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35186f5-ff05-4b7e-8e6b-6ff79527072f None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:20:44.230699 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79b3c64-4ac8-4d6e-b2f9-a60b5cb32513 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41675154bbba47388040966f75d84c3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:20:44.231309 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79b3c64-4ac8-4d6e-b2f9-a60b5cb32513 service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:20:44.231587 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79b3c64-4ac8-4d6e-b2f9-a60b5cb32513 service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:20:44.231858 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79b3c64-4ac8-4d6e-b2f9-a60b5cb32513 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:20:44.233428 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-f79b3c64-4ac8-4d6e-b2f9-a60b5cb32513 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:20:44.251352 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:20:44.347270 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79b3c64-4ac8-4d6e-b2f9-a60b5cb32513 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:20:44.348699 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79b3c64-4ac8-4d6e-b2f9-a60b5cb32513 service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:20:44.367493 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 654/1326] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:20:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:20:46.584150 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0acdb3-54b7-49a9-bb33-486bf306d1cc None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:20:46.584657 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0acdb3-54b7-49a9-bb33-486bf306d1cc None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:20:46.584657 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0acdb3-54b7-49a9-bb33-486bf306d1cc None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:20:46.585998 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 673/1327] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:20:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:20:46.591200 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e579ac9a-3447-4afb-ab64-e6a7f0b45552 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:20:46.591674 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e579ac9a-3447-4afb-ab64-e6a7f0b45552 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:20:46.591769 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e579ac9a-3447-4afb-ab64-e6a7f0b45552 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:20:46.658768 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-e579ac9a-3447-4afb-ab64-e6a7f0b45552 None None] MFA Rules not processed for user `5b2e21c1e08c42f18233d33bd9c6be68`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:20:46.659992 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-e579ac9a-3447-4afb-ab64-e6a7f0b45552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:20:46.728090 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:20:46.761366 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 655/1328] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:20:46 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 15:20:47.051001 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0acdb3-54b7-49a9-bb33-486bf306d1cc None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:20:47.052564 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-be0acdb3-54b7-49a9-bb33-486bf306d1cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:20:47.085865 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:20:47.162477 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0acdb3-54b7-49a9-bb33-486bf306d1cc None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:20:47.236785 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aca07ab-5c20-43f5-bb44-fd87d1bf3285 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41675154bbba47388040966f75d84c3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:20:47.237303 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aca07ab-5c20-43f5-bb44-fd87d1bf3285 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:20:47.237580 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aca07ab-5c20-43f5-bb44-fd87d1bf3285 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:20:47.237887 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aca07ab-5c20-43f5-bb44-fd87d1bf3285 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:20:47.239455 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-0aca07ab-5c20-43f5-bb44-fd87d1bf3285 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:20:47.316985 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:20:47.349535 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aca07ab-5c20-43f5-bb44-fd87d1bf3285 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:20:47.351002 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aca07ab-5c20-43f5-bb44-fd87d1bf3285 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:20:47.369638 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 674/1329] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:20:47 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:20:49.781939 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599367c7-d856-4ec1-8f6f-cc5897cdea02 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:20:49.782525 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599367c7-d856-4ec1-8f6f-cc5897cdea02 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:20:49.783134 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599367c7-d856-4ec1-8f6f-cc5897cdea02 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:20:49.784607 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 656/1330] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:20:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:20:49.790082 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5c993f-6d5d-4ec6-a6fa-8858508f0956 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:20:49.790486 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5c993f-6d5d-4ec6-a6fa-8858508f0956 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:20:49.790643 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5c993f-6d5d-4ec6-a6fa-8858508f0956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:20:49.857213 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-2b5c993f-6d5d-4ec6-a6fa-8858508f0956 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:20:49.858477 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-2b5c993f-6d5d-4ec6-a6fa-8858508f0956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:20:49.960917 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 675/1331] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:20:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 15:20:50.245351 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599367c7-d856-4ec1-8f6f-cc5897cdea02 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:20:50.246980 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-599367c7-d856-4ec1-8f6f-cc5897cdea02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:20:50.351199 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599367c7-d856-4ec1-8f6f-cc5897cdea02 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:20:50.425987 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdc3227-14a4-46e6-8599-7138e4617322 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41675154bbba47388040966f75d84c3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:20:50.426601 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdc3227-14a4-46e6-8599-7138e4617322 service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:20:50.426883 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdc3227-14a4-46e6-8599-7138e4617322 service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:20:50.427157 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdc3227-14a4-46e6-8599-7138e4617322 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:20:50.428740 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-5fdc3227-14a4-46e6-8599-7138e4617322 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:20:50.455589 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:20:50.536592 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdc3227-14a4-46e6-8599-7138e4617322 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:20:50.537955 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdc3227-14a4-46e6-8599-7138e4617322 service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:20:50.556042 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 657/1332] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:20:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:20:52.740706 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc638a45-5105-4cab-a043-5f7773ec8416 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:20:52.741206 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc638a45-5105-4cab-a043-5f7773ec8416 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:20:52.741319 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc638a45-5105-4cab-a043-5f7773ec8416 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:20:52.742622 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 676/1333] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:20:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:20:52.747891 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e072f8-bce4-428f-b1c7-98a8ec390cca None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:20:52.748278 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e072f8-bce4-428f-b1c7-98a8ec390cca None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:20:52.748436 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e072f8-bce4-428f-b1c7-98a8ec390cca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:20:52.813719 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-06e072f8-bce4-428f-b1c7-98a8ec390cca None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:20:52.814954 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-06e072f8-bce4-428f-b1c7-98a8ec390cca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:20:52.888393 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:20:52.912937 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 658/1334] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:20:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 15:20:53.202977 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc638a45-5105-4cab-a043-5f7773ec8416 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:20:53.205120 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-bc638a45-5105-4cab-a043-5f7773ec8416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:20:53.245716 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:20:53.309519 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc638a45-5105-4cab-a043-5f7773ec8416 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:20:53.382367 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32be1961-f90f-4180-87d3-035c3ae32188 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41675154bbba47388040966f75d84c3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:20:53.382971 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32be1961-f90f-4180-87d3-035c3ae32188 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:20:53.383266 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32be1961-f90f-4180-87d3-035c3ae32188 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:20:53.383523 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32be1961-f90f-4180-87d3-035c3ae32188 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:20:53.385111 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-32be1961-f90f-4180-87d3-035c3ae32188 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:20:53.468921 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:20:53.494612 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32be1961-f90f-4180-87d3-035c3ae32188 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:20:53.496090 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32be1961-f90f-4180-87d3-035c3ae32188 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:20:53.514614 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 677/1335] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:20:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:20:56.028607 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0027c41-bb90-4531-9818-dcbfed5e8db9 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:20:56.029169 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0027c41-bb90-4531-9818-dcbfed5e8db9 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:20:56.029169 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0027c41-bb90-4531-9818-dcbfed5e8db9 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:20:56.030443 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 659/1336] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:20:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:20:56.036161 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb7f57c-dcdb-4afb-b52d-a0309438f01c None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:20:56.036597 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb7f57c-dcdb-4afb-b52d-a0309438f01c None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:20:56.036723 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb7f57c-dcdb-4afb-b52d-a0309438f01c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:20:56.101609 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-abb7f57c-dcdb-4afb-b52d-a0309438f01c None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:20:56.102861 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-abb7f57c-dcdb-4afb-b52d-a0309438f01c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:20:56.198713 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 678/1337] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:20:56 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 15:20:56.485684 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0027c41-bb90-4531-9818-dcbfed5e8db9 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:20:56.487256 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-c0027c41-bb90-4531-9818-dcbfed5e8db9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:20:56.589149 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0027c41-bb90-4531-9818-dcbfed5e8db9 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:20:56.664004 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2bcd33-40d4-470b-965f-ca3db756171b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41675154bbba47388040966f75d84c3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:20:56.665076 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2bcd33-40d4-470b-965f-ca3db756171b service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:20:56.665358 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2bcd33-40d4-470b-965f-ca3db756171b service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:20:56.665631 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2bcd33-40d4-470b-965f-ca3db756171b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:20:56.667295 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-3b2bcd33-40d4-470b-965f-ca3db756171b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:20:56.703419 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:20:56.777790 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2bcd33-40d4-470b-965f-ca3db756171b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:20:56.779180 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2bcd33-40d4-470b-965f-ca3db756171b service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:20:56.796973 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 660/1338] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:20:56 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:21:00.885780 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9d2a3f-9659-4353-8490-46ad2be7aaaa None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:21:00.886317 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9d2a3f-9659-4353-8490-46ad2be7aaaa None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:21:00.886416 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9d2a3f-9659-4353-8490-46ad2be7aaaa None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:21:00.887704 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 679/1339] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:21:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:21:00.893935 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb55991d-6adf-4295-93c3-e5b30de75def None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:21:00.894344 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb55991d-6adf-4295-93c3-e5b30de75def None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:21:00.894528 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb55991d-6adf-4295-93c3-e5b30de75def None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:21:00.963077 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-eb55991d-6adf-4295-93c3-e5b30de75def None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:21:00.964206 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-eb55991d-6adf-4295-93c3-e5b30de75def None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:21:01.049926 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:21:01.061854 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 661/1340] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:21:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:21:01.349981 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9d2a3f-9659-4353-8490-46ad2be7aaaa None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:21:01.351598 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-7d9d2a3f-9659-4353-8490-46ad2be7aaaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:21:01.401427 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:21:01.459588 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9d2a3f-9659-4353-8490-46ad2be7aaaa None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:21:01.532067 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c013c17b-73b6-4b6c-bf3f-493dfe59c480 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41675154bbba47388040966f75d84c3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:21:01.532673 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c013c17b-73b6-4b6c-bf3f-493dfe59c480 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:21:01.532952 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c013c17b-73b6-4b6c-bf3f-493dfe59c480 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:21:01.533226 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c013c17b-73b6-4b6c-bf3f-493dfe59c480 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:21:01.534849 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-c013c17b-73b6-4b6c-bf3f-493dfe59c480 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:21:01.629536 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:21:01.647169 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c013c17b-73b6-4b6c-bf3f-493dfe59c480 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:21:01.648622 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c013c17b-73b6-4b6c-bf3f-493dfe59c480 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:21:01.667295 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 680/1341] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:21:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:21:04.499553 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f143d9-5ec3-467a-81b7-4bdc77fedfc3 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:21:04.500946 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f143d9-5ec3-467a-81b7-4bdc77fedfc3 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:21:04.500946 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f143d9-5ec3-467a-81b7-4bdc77fedfc3 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:21:04.502169 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 662/1342] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:21:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:21:04.507394 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbecddb4-2206-4cce-a7e6-152e5ff686bc None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:21:04.507809 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbecddb4-2206-4cce-a7e6-152e5ff686bc None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:21:04.508075 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbecddb4-2206-4cce-a7e6-152e5ff686bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:21:04.573905 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-fbecddb4-2206-4cce-a7e6-152e5ff686bc None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:21:04.575117 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-fbecddb4-2206-4cce-a7e6-152e5ff686bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:21:04.673131 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 681/1343] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:21:04 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:21:04.958958 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f143d9-5ec3-467a-81b7-4bdc77fedfc3 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:21:04.960628 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-76f143d9-5ec3-467a-81b7-4bdc77fedfc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:21:05.073566 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f143d9-5ec3-467a-81b7-4bdc77fedfc3 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:21:05.149408 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a7e223-677e-480b-aa21-ba2299d9fd5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41675154bbba47388040966f75d84c3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:21:05.150043 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a7e223-677e-480b-aa21-ba2299d9fd5c service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:21:05.150319 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a7e223-677e-480b-aa21-ba2299d9fd5c service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:21:05.150592 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a7e223-677e-480b-aa21-ba2299d9fd5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:21:05.152179 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-69a7e223-677e-480b-aa21-ba2299d9fd5c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:21:05.196006 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:21:05.268634 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a7e223-677e-480b-aa21-ba2299d9fd5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:21:05.270119 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a7e223-677e-480b-aa21-ba2299d9fd5c service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:21:05.288425 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 663/1344] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:21:04 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:21:09.446764 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e71619b-b36a-4e39-94a3-1bb522ece10d None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:21:09.447288 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e71619b-b36a-4e39-94a3-1bb522ece10d None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:21:09.447403 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e71619b-b36a-4e39-94a3-1bb522ece10d None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:21:09.448674 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 682/1345] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:21:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:21:09.454832 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb98cad3-efbe-4f42-a05c-f6193bfec6b2 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:21:09.455280 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb98cad3-efbe-4f42-a05c-f6193bfec6b2 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:21:09.455377 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb98cad3-efbe-4f42-a05c-f6193bfec6b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:21:09.524047 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-bb98cad3-efbe-4f42-a05c-f6193bfec6b2 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:21:09.525276 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-bb98cad3-efbe-4f42-a05c-f6193bfec6b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:21:09.622398 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:21:09.625609 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 664/1346] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:21:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:21:09.907285 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e71619b-b36a-4e39-94a3-1bb522ece10d None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:21:09.908855 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-8e71619b-b36a-4e39-94a3-1bb522ece10d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:21:09.967744 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:21:10.019635 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e71619b-b36a-4e39-94a3-1bb522ece10d None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:21:10.094866 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1171a4c7-8cbc-4020-8c15-93d097f6abec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41675154bbba47388040966f75d84c3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:21:10.095473 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1171a4c7-8cbc-4020-8c15-93d097f6abec service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:21:10.095756 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1171a4c7-8cbc-4020-8c15-93d097f6abec service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:21:10.096031 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1171a4c7-8cbc-4020-8c15-93d097f6abec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:21:10.097625 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-1171a4c7-8cbc-4020-8c15-93d097f6abec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:21:10.202758 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:21:10.206646 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1171a4c7-8cbc-4020-8c15-93d097f6abec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:21:10.208092 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1171a4c7-8cbc-4020-8c15-93d097f6abec service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:21:10.226846 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 683/1347] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:21:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:21:15.103486 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c373c7a6-3c6e-4a08-bd0e-468e40d1482a None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:21:15.103897 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c373c7a6-3c6e-4a08-bd0e-468e40d1482a None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:21:15.104263 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c373c7a6-3c6e-4a08-bd0e-468e40d1482a None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:21:15.106125 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 665/1348] 10.222.0.27 () {54 vars in 921 bytes} [Tue Sep 13 15:21:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:21:15.111779 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dae37c7-58bc-4c89-8716-2a5923446504 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:21:15.112215 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dae37c7-58bc-4c89-8716-2a5923446504 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:21:15.112368 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dae37c7-58bc-4c89-8716-2a5923446504 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:21:15.249863 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-7dae37c7-58bc-4c89-8716-2a5923446504 None None] MFA Rules not processed for user `5b56f96cb3184a3ba82c8a0c3427e268`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:21:15.251322 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-7dae37c7-58bc-4c89-8716-2a5923446504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:21:15.382615 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 684/1349] 10.222.0.27 () {58 vars in 1018 bytes} [Tue Sep 13 15:21:15 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:21:19.413283 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2b1bf0-9310-4f47-8011-1bcfb774dbf3 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:21:19.413850 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2b1bf0-9310-4f47-8011-1bcfb774dbf3 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:21:19.414127 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2b1bf0-9310-4f47-8011-1bcfb774dbf3 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:21:19.415764 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 666/1350] 10.222.0.27 () {54 vars in 921 bytes} [Tue Sep 13 15:21:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:21:19.420742 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1c3ae0-ba70-4743-87bb-036a78a16c88 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:21:19.421514 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1c3ae0-ba70-4743-87bb-036a78a16c88 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:21:19.421837 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1c3ae0-ba70-4743-87bb-036a78a16c88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:21:19.480707 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:21:19.505185 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-7e1c3ae0-ba70-4743-87bb-036a78a16c88 None None] MFA Rules not processed for user `5b56f96cb3184a3ba82c8a0c3427e268`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:21:19.506428 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-7e1c3ae0-ba70-4743-87bb-036a78a16c88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:21:19.619325 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 685/1351] 10.222.0.27 () {58 vars in 1018 bytes} [Tue Sep 13 15:21:19 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:21:21.143112 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2583a4-c9c0-4021-b575-65ac41e562bd None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:21:21.143642 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2583a4-c9c0-4021-b575-65ac41e562bd None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:21:21.143730 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2583a4-c9c0-4021-b575-65ac41e562bd None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:21:21.145033 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 667/1352] 10.222.0.27 () {54 vars in 921 bytes} [Tue Sep 13 15:21:21 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:21:21.150473 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0a9ceb-21da-4588-a943-872bb3d9e95f None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:21:21.150883 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0a9ceb-21da-4588-a943-872bb3d9e95f None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:21:21.151031 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0a9ceb-21da-4588-a943-872bb3d9e95f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:21:21.230168 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-aa0a9ceb-21da-4588-a943-872bb3d9e95f None None] MFA Rules not processed for user `5b56f96cb3184a3ba82c8a0c3427e268`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:21:21.231553 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-aa0a9ceb-21da-4588-a943-872bb3d9e95f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:21:21.273907 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:21:21.339113 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 686/1353] 10.222.0.27 () {58 vars in 1018 bytes} [Tue Sep 13 15:21:21 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:21:24.941184 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b75cd46-8ac5-454d-94d5-462c03f08a8b None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:21:24.941855 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b75cd46-8ac5-454d-94d5-462c03f08a8b None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:21:24.941855 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b75cd46-8ac5-454d-94d5-462c03f08a8b None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:21:24.943098 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 668/1354] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:21:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 15:21:24.948372 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c34ef4-ee28-461a-83fa-e94c7fb97973 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:21:24.948805 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c34ef4-ee28-461a-83fa-e94c7fb97973 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:21:24.948931 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c34ef4-ee28-461a-83fa-e94c7fb97973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:21:25.027500 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-c0c34ef4-ee28-461a-83fa-e94c7fb97973 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:21:25.028999 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-c0c34ef4-ee28-461a-83fa-e94c7fb97973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:21:25.135842 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 687/1355] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:21:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:21:25.440836 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e444a27-a6f5-497b-8896-a4833aeb6d35 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:21:25.441448 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e444a27-a6f5-497b-8896-a4833aeb6d35 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:21:25.441973 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e444a27-a6f5-497b-8896-a4833aeb6d35 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:21:25.443636 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 669/1356] 10.222.0.27 () {54 vars in 962 bytes} [Tue Sep 13 15:21:25 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 15:21:25.451822 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd373336-16e1-46b1-9077-4bf743a45ff2 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:21:25.452111 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd373336-16e1-46b1-9077-4bf743a45ff2 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:21:25.452397 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd373336-16e1-46b1-9077-4bf743a45ff2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:21:25.478837 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:21:25.549655 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-cd373336-16e1-46b1-9077-4bf743a45ff2 None None] MFA Rules not processed for user `62aad71c6c1a4469805762bba330bf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:21:25.551003 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-cd373336-16e1-46b1-9077-4bf743a45ff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:21:25.684178 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 688/1357] 10.222.0.27 () {58 vars in 1059 bytes} [Tue Sep 13 15:21:25 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 15:21:25.692654 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e444a27-a6f5-497b-8896-a4833aeb6d35 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:21:25.694179 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-9e444a27-a6f5-497b-8896-a4833aeb6d35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:21:25.871932 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e444a27-a6f5-497b-8896-a4833aeb6d35 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:21:25.949751 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:21:25.991541 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174d8058-3da5-42e6-8395-07b7f49285ad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62aad71c6c1a4469805762bba330bf0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:21:25.992151 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174d8058-3da5-42e6-8395-07b7f49285ad service nova] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:21:25.992480 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174d8058-3da5-42e6-8395-07b7f49285ad service nova] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:21:25.992750 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174d8058-3da5-42e6-8395-07b7f49285ad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:21:25.994391 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-174d8058-3da5-42e6-8395-07b7f49285ad service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:21:26.096296 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174d8058-3da5-42e6-8395-07b7f49285ad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:21:26.097927 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174d8058-3da5-42e6-8395-07b7f49285ad service nova] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:21:26.117567 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 670/1358] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:21:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 15:21:28.512333 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dd4456-e6da-4549-a865-0677a13e84dc None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:21:28.512333 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dd4456-e6da-4549-a865-0677a13e84dc None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:21:28.513218 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dd4456-e6da-4549-a865-0677a13e84dc None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:21:28.518484 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 689/1359] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:21:28 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:21:28.519868 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95704753-3465-4191-a40b-d6b70576b137 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:21:28.520415 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95704753-3465-4191-a40b-d6b70576b137 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:21:28.520415 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95704753-3465-4191-a40b-d6b70576b137 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:21:28.599929 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-95704753-3465-4191-a40b-d6b70576b137 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:21:28.601385 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-95704753-3465-4191-a40b-d6b70576b137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:21:28.645381 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:21:28.709066 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 671/1360] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:21:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:21:29.000762 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dd4456-e6da-4549-a865-0677a13e84dc None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:21:29.002809 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-e6dd4456-e6da-4549-a865-0677a13e84dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:21:29.082500 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:21:29.200879 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dd4456-e6da-4549-a865-0677a13e84dc None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:21:29.334777 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338546a2-4a6e-498b-a63f-bdce2dbfeec9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62aad71c6c1a4469805762bba330bf0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:21:29.335401 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338546a2-4a6e-498b-a63f-bdce2dbfeec9 service nova] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:21:29.335813 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338546a2-4a6e-498b-a63f-bdce2dbfeec9 service nova] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:21:29.336120 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338546a2-4a6e-498b-a63f-bdce2dbfeec9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:21:29.337840 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-338546a2-4a6e-498b-a63f-bdce2dbfeec9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:21:29.361877 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:21:29.436295 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338546a2-4a6e-498b-a63f-bdce2dbfeec9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:21:29.438207 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338546a2-4a6e-498b-a63f-bdce2dbfeec9 service nova] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:21:29.457137 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 690/1361] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:21:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:21:31.968638 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0ebad8-e43b-4e53-b6d7-292efccdeb8e None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:21:31.969219 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0ebad8-e43b-4e53-b6d7-292efccdeb8e None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:21:31.969219 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0ebad8-e43b-4e53-b6d7-292efccdeb8e None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:21:31.970761 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 672/1362] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:21:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:21:31.975789 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afb7482-6f68-442a-846d-5c00ccdcb2cd None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:21:31.976191 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afb7482-6f68-442a-846d-5c00ccdcb2cd None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:21:31.976392 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afb7482-6f68-442a-846d-5c00ccdcb2cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:21:32.044700 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-8afb7482-6f68-442a-846d-5c00ccdcb2cd None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:21:32.046282 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-8afb7482-6f68-442a-846d-5c00ccdcb2cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:21:32.149567 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:21:32.157748 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 691/1363] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:21:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:21:32.452810 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1292fbc6-d2c5-4003-a176-5d9e604eb58b None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:21:32.453236 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1292fbc6-d2c5-4003-a176-5d9e604eb58b None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:21:32.453638 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1292fbc6-d2c5-4003-a176-5d9e604eb58b None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:21:32.456714 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 673/1364] 10.222.0.27 () {54 vars in 962 bytes} [Tue Sep 13 15:21:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:21:32.462652 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f1974f-52b6-43cb-967b-8a74cd253453 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:21:32.462946 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f1974f-52b6-43cb-967b-8a74cd253453 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:21:32.463229 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f1974f-52b6-43cb-967b-8a74cd253453 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:21:32.544032 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-c3f1974f-52b6-43cb-967b-8a74cd253453 None None] MFA Rules not processed for user `62aad71c6c1a4469805762bba330bf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:21:32.545482 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-c3f1974f-52b6-43cb-967b-8a74cd253453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:21:32.670632 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 692/1365] 10.222.0.27 () {58 vars in 1059 bytes} [Tue Sep 13 15:21:32 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:21:32.678977 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1292fbc6-d2c5-4003-a176-5d9e604eb58b None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:21:32.680494 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-1292fbc6-d2c5-4003-a176-5d9e604eb58b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:21:32.855025 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1292fbc6-d2c5-4003-a176-5d9e604eb58b None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:21:32.878408 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:21:32.981533 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6eac68-35ea-47f0-aa54-a31ca274d007 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62aad71c6c1a4469805762bba330bf0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:21:32.982271 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6eac68-35ea-47f0-aa54-a31ca274d007 service nova] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:21:32.982396 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6eac68-35ea-47f0-aa54-a31ca274d007 service nova] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:21:32.982677 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6eac68-35ea-47f0-aa54-a31ca274d007 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:21:32.984303 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-3f6eac68-35ea-47f0-aa54-a31ca274d007 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:21:33.086348 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6eac68-35ea-47f0-aa54-a31ca274d007 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:21:33.087971 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6eac68-35ea-47f0-aa54-a31ca274d007 service nova] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:21:33.107542 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 674/1366] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:21:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 15:21:33.160946 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28f07f5-0c42-45db-a4f8-6668c7728853 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:21:33.161482 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28f07f5-0c42-45db-a4f8-6668c7728853 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:21:33.161809 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28f07f5-0c42-45db-a4f8-6668c7728853 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:21:33.163689 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 693/1367] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:21:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:21:33.169235 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79867f2e-a1d1-45b8-aba1-a0af1576d25c None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:21:33.170086 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79867f2e-a1d1-45b8-aba1-a0af1576d25c None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:21:33.170624 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79867f2e-a1d1-45b8-aba1-a0af1576d25c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:21:33.206810 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:21:33.249502 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-79867f2e-a1d1-45b8-aba1-a0af1576d25c None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:21:33.250779 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-79867f2e-a1d1-45b8-aba1-a0af1576d25c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:21:33.374680 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 675/1368] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:21:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:21:33.715071 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8e11c4-51ca-4c09-9dbd-7975ecdc223f None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:21:33.715071 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8e11c4-51ca-4c09-9dbd-7975ecdc223f None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:21:33.715071 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8e11c4-51ca-4c09-9dbd-7975ecdc223f None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:21:33.715071 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 694/1369] 10.222.0.27 () {54 vars in 964 bytes} [Tue Sep 13 15:21:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:21:33.720949 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c10201-cb26-475d-9f61-48b6f03208a0 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:21:33.720949 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c10201-cb26-475d-9f61-48b6f03208a0 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:21:33.720949 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c10201-cb26-475d-9f61-48b6f03208a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:21:33.800108 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-c6c10201-cb26-475d-9f61-48b6f03208a0 None None] MFA Rules not processed for user `97acd23097d54bf7805c3cef60626ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:21:33.801338 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-c6c10201-cb26-475d-9f61-48b6f03208a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:21:33.850638 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:21:33.884362 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 676/1370] 10.222.0.27 () {58 vars in 1061 bytes} [Tue Sep 13 15:21:33 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:21:33.892563 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8e11c4-51ca-4c09-9dbd-7975ecdc223f None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:21:33.894333 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-6c8e11c4-51ca-4c09-9dbd-7975ecdc223f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:21:33.947808 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:21:34.007432 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8e11c4-51ca-4c09-9dbd-7975ecdc223f None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:21:34.092068 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af28e939-129d-4f79-9be0-63d2e102817c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97acd23097d54bf7805c3cef60626ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:21:34.092800 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af28e939-129d-4f79-9be0-63d2e102817c service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:21:34.093083 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af28e939-129d-4f79-9be0-63d2e102817c service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:21:34.093361 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af28e939-129d-4f79-9be0-63d2e102817c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:21:34.095032 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-af28e939-129d-4f79-9be0-63d2e102817c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:21:34.212718 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:21:34.229921 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af28e939-129d-4f79-9be0-63d2e102817c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:21:34.231360 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af28e939-129d-4f79-9be0-63d2e102817c service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:21:34.252619 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 695/1371] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:21:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:21:35.409251 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb84d43-8df6-46a9-9349-e67f6bae97e4 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:21:35.409840 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb84d43-8df6-46a9-9349-e67f6bae97e4 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:21:35.410030 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb84d43-8df6-46a9-9349-e67f6bae97e4 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:21:35.412351 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 677/1372] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:21:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:21:35.417975 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19745424-d31f-4092-833e-ebd7ddda60b7 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:21:35.418431 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19745424-d31f-4092-833e-ebd7ddda60b7 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:21:35.418542 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19745424-d31f-4092-833e-ebd7ddda60b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:21:35.490406 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-19745424-d31f-4092-833e-ebd7ddda60b7 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:21:35.491868 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-19745424-d31f-4092-833e-ebd7ddda60b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:21:35.589653 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 696/1373] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:21:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:21:35.883564 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb84d43-8df6-46a9-9349-e67f6bae97e4 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:21:35.885104 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-0fb84d43-8df6-46a9-9349-e67f6bae97e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:21:36.039550 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb84d43-8df6-46a9-9349-e67f6bae97e4 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:21:36.099037 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:21:36.171405 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08559002-dfc1-45ac-b506-f23ccad2d173 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62aad71c6c1a4469805762bba330bf0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:21:36.172098 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08559002-dfc1-45ac-b506-f23ccad2d173 service nova] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:21:36.172454 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08559002-dfc1-45ac-b506-f23ccad2d173 service nova] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:21:36.172823 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08559002-dfc1-45ac-b506-f23ccad2d173 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:21:36.174608 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-08559002-dfc1-45ac-b506-f23ccad2d173 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:21:36.274434 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08559002-dfc1-45ac-b506-f23ccad2d173 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:21:36.276048 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08559002-dfc1-45ac-b506-f23ccad2d173 service nova] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:21:36.302924 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 678/1374] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:21:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:21:38.597047 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0320e0-3f6f-4bb3-8d04-871d47cdd49f None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:21:38.597611 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0320e0-3f6f-4bb3-8d04-871d47cdd49f None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:21:38.597611 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0320e0-3f6f-4bb3-8d04-871d47cdd49f None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:21:38.599180 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 697/1375] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:21:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:21:38.604840 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01964dd-0d24-454c-8cf2-be38f669bb57 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:21:38.605336 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01964dd-0d24-454c-8cf2-be38f669bb57 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:21:38.605427 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01964dd-0d24-454c-8cf2-be38f669bb57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:21:38.677107 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-d01964dd-0d24-454c-8cf2-be38f669bb57 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:21:38.678474 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-d01964dd-0d24-454c-8cf2-be38f669bb57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:21:38.686834 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:21:38.791349 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 679/1376] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:21:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:21:39.090059 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0320e0-3f6f-4bb3-8d04-871d47cdd49f None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:21:39.092924 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-7b0320e0-3f6f-4bb3-8d04-871d47cdd49f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:21:39.156350 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:21:39.246245 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0320e0-3f6f-4bb3-8d04-871d47cdd49f None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:21:39.367262 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b810155b-2860-443c-9ee6-c084c4577011 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62aad71c6c1a4469805762bba330bf0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:21:39.367791 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b810155b-2860-443c-9ee6-c084c4577011 service nova] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:21:39.368070 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b810155b-2860-443c-9ee6-c084c4577011 service nova] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:21:39.368342 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b810155b-2860-443c-9ee6-c084c4577011 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:21:39.370084 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-b810155b-2860-443c-9ee6-c084c4577011 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:21:39.390717 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:21:39.473877 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b810155b-2860-443c-9ee6-c084c4577011 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:21:39.475622 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b810155b-2860-443c-9ee6-c084c4577011 service nova] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:21:39.495032 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 698/1377] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:21:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:21:41.720513 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a5c788-61dd-4169-9155-5a7dc8317189 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:21:41.720948 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a5c788-61dd-4169-9155-5a7dc8317189 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:21:41.720948 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a5c788-61dd-4169-9155-5a7dc8317189 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:21:41.722574 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 680/1378] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:21:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:21:41.733022 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad75fda4-9d64-4b80-89b1-10f1b2eaad0d None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:21:41.733022 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad75fda4-9d64-4b80-89b1-10f1b2eaad0d None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:21:41.733022 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad75fda4-9d64-4b80-89b1-10f1b2eaad0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:21:41.862001 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-ad75fda4-9d64-4b80-89b1-10f1b2eaad0d None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:21:41.863301 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-ad75fda4-9d64-4b80-89b1-10f1b2eaad0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:21:41.958494 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:21:41.964971 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 699/1379] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:21:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:21:42.256905 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a5c788-61dd-4169-9155-5a7dc8317189 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:21:42.258463 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-a9a5c788-61dd-4169-9155-5a7dc8317189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:21:42.399871 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:21:42.413235 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a5c788-61dd-4169-9155-5a7dc8317189 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:21:42.549501 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8ac4e9-1530-419a-ac53-93c7a8c6a1fa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62aad71c6c1a4469805762bba330bf0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:21:42.550068 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8ac4e9-1530-419a-ac53-93c7a8c6a1fa service nova] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:21:42.550349 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8ac4e9-1530-419a-ac53-93c7a8c6a1fa service nova] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:21:42.550626 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8ac4e9-1530-419a-ac53-93c7a8c6a1fa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:21:42.552269 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-5e8ac4e9-1530-419a-ac53-93c7a8c6a1fa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:21:42.647446 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8ac4e9-1530-419a-ac53-93c7a8c6a1fa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:21:42.649076 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8ac4e9-1530-419a-ac53-93c7a8c6a1fa service nova] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:21:42.659571 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:21:42.668330 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 681/1380] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:21:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:21:44.906868 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f8d854-c3ef-42bf-90f0-99334b0343bf None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:21:44.907412 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f8d854-c3ef-42bf-90f0-99334b0343bf None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:21:44.907412 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f8d854-c3ef-42bf-90f0-99334b0343bf None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:21:44.908778 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 700/1381] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:21:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:21:44.914398 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a4fc44-4c3e-4b84-acca-00cd538331d3 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:21:44.914852 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a4fc44-4c3e-4b84-acca-00cd538331d3 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:21:44.914982 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a4fc44-4c3e-4b84-acca-00cd538331d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:21:45.038139 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-f8a4fc44-4c3e-4b84-acca-00cd538331d3 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:21:45.040432 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-f8a4fc44-4c3e-4b84-acca-00cd538331d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:21:45.161862 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 682/1382] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:21:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:21:45.454517 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f8d854-c3ef-42bf-90f0-99334b0343bf None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:21:45.457073 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-35f8d854-c3ef-42bf-90f0-99334b0343bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:21:45.627025 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f8d854-c3ef-42bf-90f0-99334b0343bf None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:21:45.719733 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:21:45.787592 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66e3967-a891-4a0b-ac62-25b2695f761b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62aad71c6c1a4469805762bba330bf0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:21:45.788163 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66e3967-a891-4a0b-ac62-25b2695f761b service nova] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:21:45.788450 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66e3967-a891-4a0b-ac62-25b2695f761b service nova] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:21:45.788723 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66e3967-a891-4a0b-ac62-25b2695f761b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:21:45.790373 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-a66e3967-a891-4a0b-ac62-25b2695f761b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:21:45.917942 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66e3967-a891-4a0b-ac62-25b2695f761b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:21:45.920235 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66e3967-a891-4a0b-ac62-25b2695f761b service nova] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:21:45.940719 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 701/1383] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:21:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 486 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:21:48.152517 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9773f8be-b587-4216-9b1d-db9d47b639cb None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:21:48.153202 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9773f8be-b587-4216-9b1d-db9d47b639cb None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:21:48.153202 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9773f8be-b587-4216-9b1d-db9d47b639cb None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:21:48.154601 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 683/1384] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:21:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:21:48.160484 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d362fb41-9f2d-46e8-b2b3-ea72ab6ce66c None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:21:48.160484 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d362fb41-9f2d-46e8-b2b3-ea72ab6ce66c None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:21:48.161033 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d362fb41-9f2d-46e8-b2b3-ea72ab6ce66c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:21:48.232367 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-d362fb41-9f2d-46e8-b2b3-ea72ab6ce66c None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:21:48.233750 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-d362fb41-9f2d-46e8-b2b3-ea72ab6ce66c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:21:48.269784 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:21:48.337844 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 702/1385] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:21:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:21:48.627533 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9773f8be-b587-4216-9b1d-db9d47b639cb None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:21:48.629098 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-9773f8be-b587-4216-9b1d-db9d47b639cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:21:48.705872 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:21:48.778600 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9773f8be-b587-4216-9b1d-db9d47b639cb None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:21:48.893591 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67da5ef7-abfc-411c-8e3c-0917025af118 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62aad71c6c1a4469805762bba330bf0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:21:48.894239 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67da5ef7-abfc-411c-8e3c-0917025af118 service nova] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:21:48.894521 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67da5ef7-abfc-411c-8e3c-0917025af118 service nova] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:21:48.894796 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67da5ef7-abfc-411c-8e3c-0917025af118 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:21:48.896388 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-67da5ef7-abfc-411c-8e3c-0917025af118 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:21:48.935597 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:21:48.987928 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67da5ef7-abfc-411c-8e3c-0917025af118 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:21:48.989523 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67da5ef7-abfc-411c-8e3c-0917025af118 service nova] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:21:49.007952 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 684/1386] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:21:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:21:49.743183 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a2dd08-c23c-4f75-8ac0-2483b1dff4ea None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:21:49.743705 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a2dd08-c23c-4f75-8ac0-2483b1dff4ea None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:21:49.743802 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a2dd08-c23c-4f75-8ac0-2483b1dff4ea None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:21:49.745084 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 703/1387] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:21:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:21:49.751170 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ee032a-9f32-4e8c-8526-fe4539887a55 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:21:49.751613 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ee032a-9f32-4e8c-8526-fe4539887a55 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:21:49.751730 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ee032a-9f32-4e8c-8526-fe4539887a55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:21:49.820393 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-c2ee032a-9f32-4e8c-8526-fe4539887a55 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:21:49.821595 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-c2ee032a-9f32-4e8c-8526-fe4539887a55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:21:49.922243 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 685/1388] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:21:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:21:50.227048 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b9ebb0-5b5a-4ad3-80db-3943a4544e25 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:21:50.227343 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b9ebb0-5b5a-4ad3-80db-3943a4544e25 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:21:50.227625 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b9ebb0-5b5a-4ad3-80db-3943a4544e25 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:21:50.229029 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 704/1389] 10.222.0.27 () {54 vars in 966 bytes} [Tue Sep 13 15:21:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:21:50.235041 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0efb75-be03-4dbe-93f5-a02c343b11af None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:21:50.235329 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0efb75-be03-4dbe-93f5-a02c343b11af None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:21:50.235601 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0efb75-be03-4dbe-93f5-a02c343b11af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:21:50.251856 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:21:50.313970 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-1e0efb75-be03-4dbe-93f5-a02c343b11af None None] MFA Rules not processed for user `8ef26a5203094c83b52f10b930dfc453`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:21:50.315197 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-1e0efb75-be03-4dbe-93f5-a02c343b11af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:21:50.391291 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 686/1390] 10.222.0.27 () {58 vars in 1063 bytes} [Tue Sep 13 15:21:50 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:21:50.398875 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b9ebb0-5b5a-4ad3-80db-3943a4544e25 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:21:50.400416 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-b5b9ebb0-5b5a-4ad3-80db-3943a4544e25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:21:50.505481 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b9ebb0-5b5a-4ad3-80db-3943a4544e25 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:21:50.564481 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:21:50.580614 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3773c553-c6ea-404d-aa4c-7adae44d5281 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef26a5203094c83b52f10b930dfc453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:21:50.581223 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3773c553-c6ea-404d-aa4c-7adae44d5281 service glance] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:21:50.581503 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3773c553-c6ea-404d-aa4c-7adae44d5281 service glance] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:21:50.581803 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3773c553-c6ea-404d-aa4c-7adae44d5281 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:21:50.583397 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-3773c553-c6ea-404d-aa4c-7adae44d5281 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:21:50.694877 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3773c553-c6ea-404d-aa4c-7adae44d5281 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:21:50.696329 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3773c553-c6ea-404d-aa4c-7adae44d5281 service glance] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:21:50.715627 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 705/1391] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:21:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:21:51.204228 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc0da65-5f24-44c5-a2a6-e6e306e5e101 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:21:51.204763 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc0da65-5f24-44c5-a2a6-e6e306e5e101 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:21:51.204894 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc0da65-5f24-44c5-a2a6-e6e306e5e101 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:21:51.206327 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 687/1392] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:21:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:21:51.212129 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df6ccb0-9ed0-4631-aec9-99651f5c5a0b None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:21:51.212129 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df6ccb0-9ed0-4631-aec9-99651f5c5a0b None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:21:51.212605 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df6ccb0-9ed0-4631-aec9-99651f5c5a0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:21:51.280600 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-2df6ccb0-9ed0-4631-aec9-99651f5c5a0b None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:21:51.281931 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-2df6ccb0-9ed0-4631-aec9-99651f5c5a0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:21:51.331429 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:21:51.393258 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 706/1393] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:21:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:21:51.467405 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c450c27f-388c-41e1-82d9-3012a5c9aaba None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:21:51.467769 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c450c27f-388c-41e1-82d9-3012a5c9aaba None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:21:51.468116 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c450c27f-388c-41e1-82d9-3012a5c9aaba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:21:51.540763 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-c450c27f-388c-41e1-82d9-3012a5c9aaba None None] MFA Rules not processed for user `e97bcdb20f1e416ea41b99c226617faf`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:21:51.542009 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-c450c27f-388c-41e1-82d9-3012a5c9aaba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:21:51.598123 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:21:51.631789 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 688/1394] 10.222.0.27 () {58 vars in 1009 bytes} [Tue Sep 13 15:21:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 15:21:51.674712 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830b762a-730c-4d1c-ae8b-1b1946fc5667 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:21:51.674712 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830b762a-730c-4d1c-ae8b-1b1946fc5667 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:21:51.674910 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830b762a-730c-4d1c-ae8b-1b1946fc5667 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:21:51.676125 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 707/1395] 10.222.0.27 () {54 vars in 943 bytes} [Tue Sep 13 15:21:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:21:51.682898 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945825bd-a4e6-4b0b-80e0-ef0969946315 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:21:51.683190 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945825bd-a4e6-4b0b-80e0-ef0969946315 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:21:51.683462 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945825bd-a4e6-4b0b-80e0-ef0969946315 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:21:51.688581 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830b762a-730c-4d1c-ae8b-1b1946fc5667 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:21:51.690118 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-830b762a-730c-4d1c-ae8b-1b1946fc5667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:21:51.767016 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-945825bd-a4e6-4b0b-80e0-ef0969946315 None None] MFA Rules not processed for user `dc735644be394e0abe73e709373e2003`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:21:51.768525 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-945825bd-a4e6-4b0b-80e0-ef0969946315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:21:51.845833 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830b762a-730c-4d1c-ae8b-1b1946fc5667 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:21:51.873320 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:21:51.881828 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 689/1396] 10.222.0.27 () {58 vars in 1040 bytes} [Tue Sep 13 15:21:51 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:21:51.891549 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945825bd-a4e6-4b0b-80e0-ef0969946315 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:21:51.901333 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945825bd-a4e6-4b0b-80e0-ef0969946315 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:21:51.928094 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:21:51.963229 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f775ff-bb5a-409d-9f1a-fcd23a31291e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62aad71c6c1a4469805762bba330bf0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:21:51.963833 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f775ff-bb5a-409d-9f1a-fcd23a31291e service nova] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:21:51.964116 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f775ff-bb5a-409d-9f1a-fcd23a31291e service nova] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:21:51.964384 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f775ff-bb5a-409d-9f1a-fcd23a31291e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:21:51.966732 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-21f775ff-bb5a-409d-9f1a-fcd23a31291e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:21:52.010221 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445be755-dbe3-41f4-9afd-7da7180e01ab service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc735644be394e0abe73e709373e2003', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:21:52.010835 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445be755-dbe3-41f4-9afd-7da7180e01ab service swift] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:21:52.011118 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445be755-dbe3-41f4-9afd-7da7180e01ab service swift] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:21:52.011388 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445be755-dbe3-41f4-9afd-7da7180e01ab service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:21:52.013896 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-445be755-dbe3-41f4-9afd-7da7180e01ab service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:21:52.057545 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f775ff-bb5a-409d-9f1a-fcd23a31291e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:21:52.059237 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f775ff-bb5a-409d-9f1a-fcd23a31291e service nova] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:21:52.077495 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 708/1397] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:21:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 15:21:52.100698 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445be755-dbe3-41f4-9afd-7da7180e01ab service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:21:52.102307 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445be755-dbe3-41f4-9afd-7da7180e01ab service swift] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:21:52.110888 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 690/1398] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Sep 13 15:21:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 13 15:21:54.313192 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7356d06a-0b3e-4a76-a189-5d0b8d2d0a1a None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:21:54.313792 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7356d06a-0b3e-4a76-a189-5d0b8d2d0a1a None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:21:54.313792 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7356d06a-0b3e-4a76-a189-5d0b8d2d0a1a None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:21:54.315268 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 709/1399] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:21:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:21:54.322158 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f112334-540f-4cc4-8f74-74a9ac8f143a None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:21:54.323011 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f112334-540f-4cc4-8f74-74a9ac8f143a None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:21:54.323513 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f112334-540f-4cc4-8f74-74a9ac8f143a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:21:54.404877 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-2f112334-540f-4cc4-8f74-74a9ac8f143a None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:21:54.406131 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-2f112334-540f-4cc4-8f74-74a9ac8f143a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:21:54.413850 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:21:54.545294 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 691/1400] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:21:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:21:54.853437 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7356d06a-0b3e-4a76-a189-5d0b8d2d0a1a None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:21:54.855037 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-7356d06a-0b3e-4a76-a189-5d0b8d2d0a1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:21:54.891560 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:21:55.022647 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7356d06a-0b3e-4a76-a189-5d0b8d2d0a1a None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:21:55.145022 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:21:55.156288 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37e5891-5d36-413c-91a1-d35860ce1723 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62aad71c6c1a4469805762bba330bf0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:21:55.156911 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37e5891-5d36-413c-91a1-d35860ce1723 service nova] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:21:55.157195 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37e5891-5d36-413c-91a1-d35860ce1723 service nova] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:21:55.157473 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37e5891-5d36-413c-91a1-d35860ce1723 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:21:55.159308 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-b37e5891-5d36-413c-91a1-d35860ce1723 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:21:55.274931 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37e5891-5d36-413c-91a1-d35860ce1723 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:21:55.276596 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37e5891-5d36-413c-91a1-d35860ce1723 service nova] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:21:55.297465 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 710/1401] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:21:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:21:57.588231 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5798de7-fb7c-464d-a602-946f84d03f0d None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:21:57.588838 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5798de7-fb7c-464d-a602-946f84d03f0d None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:21:57.588838 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5798de7-fb7c-464d-a602-946f84d03f0d None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:21:57.590305 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 692/1402] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:21:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:21:57.595552 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96bde8f-ff8b-4e20-9012-4678b8d0126d None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:21:57.596023 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96bde8f-ff8b-4e20-9012-4678b8d0126d None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:21:57.596114 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96bde8f-ff8b-4e20-9012-4678b8d0126d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:21:57.669262 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-b96bde8f-ff8b-4e20-9012-4678b8d0126d None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:21:57.670523 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-b96bde8f-ff8b-4e20-9012-4678b8d0126d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:21:57.743058 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:21:57.783520 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 711/1403] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:21:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:21:58.081846 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5798de7-fb7c-464d-a602-946f84d03f0d None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:21:58.083459 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-e5798de7-fb7c-464d-a602-946f84d03f0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:21:58.255976 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:21:58.267928 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5798de7-fb7c-464d-a602-946f84d03f0d None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:21:58.400675 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c30368d-23b4-4bef-9efc-395d420d76d6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62aad71c6c1a4469805762bba330bf0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:21:58.400675 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c30368d-23b4-4bef-9efc-395d420d76d6 service nova] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:21:58.400675 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c30368d-23b4-4bef-9efc-395d420d76d6 service nova] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:21:58.400675 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c30368d-23b4-4bef-9efc-395d420d76d6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:21:58.404392 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-3c30368d-23b4-4bef-9efc-395d420d76d6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:21:58.513032 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c30368d-23b4-4bef-9efc-395d420d76d6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:21:58.514809 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c30368d-23b4-4bef-9efc-395d420d76d6 service nova] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:21:58.525658 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:21:58.535538 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 693/1404] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:21:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:22:00.792827 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a02965-d153-43f0-a40a-066502a25a47 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:22:00.793348 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a02965-d153-43f0-a40a-066502a25a47 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:22:00.793460 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a02965-d153-43f0-a40a-066502a25a47 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:22:00.797732 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 712/1405] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:22:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:22:00.800365 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9441d89-bfd1-4a1c-a98b-37759298a9f1 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:22:00.800787 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9441d89-bfd1-4a1c-a98b-37759298a9f1 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:22:00.800955 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9441d89-bfd1-4a1c-a98b-37759298a9f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:22:00.881252 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-a9441d89-bfd1-4a1c-a98b-37759298a9f1 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:22:00.882500 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-a9441d89-bfd1-4a1c-a98b-37759298a9f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:22:01.009827 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 694/1406] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:22:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:22:01.302817 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a02965-d153-43f0-a40a-066502a25a47 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:22:01.304330 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-99a02965-d153-43f0-a40a-066502a25a47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:22:01.471354 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a02965-d153-43f0-a40a-066502a25a47 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:22:01.530807 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:22:01.605945 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472cdb79-6126-4ea1-9fcd-8be6a61f85bb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62aad71c6c1a4469805762bba330bf0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:22:01.607523 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472cdb79-6126-4ea1-9fcd-8be6a61f85bb service nova] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:22:01.608100 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472cdb79-6126-4ea1-9fcd-8be6a61f85bb service nova] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:22:01.608560 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472cdb79-6126-4ea1-9fcd-8be6a61f85bb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:22:01.610250 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-472cdb79-6126-4ea1-9fcd-8be6a61f85bb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:22:01.764655 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472cdb79-6126-4ea1-9fcd-8be6a61f85bb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:22:01.766516 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472cdb79-6126-4ea1-9fcd-8be6a61f85bb service nova] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:22:01.790448 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 713/1407] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:22:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 488 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:22:10.996686 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=67 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:22:11.787953 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=76 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:22:14.872062 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e546f82-dd61-4019-952a-be8cb1ea7862 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:22:14.872625 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e546f82-dd61-4019-952a-be8cb1ea7862 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:22:14.872625 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e546f82-dd61-4019-952a-be8cb1ea7862 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:22:14.874780 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 695/1408] 10.222.0.27 () {54 vars in 918 bytes} [Tue Sep 13 15:22:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:22:14.879772 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9b20b5-9e6f-48c5-b503-b8074be3a16e None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:22:14.880239 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9b20b5-9e6f-48c5-b503-b8074be3a16e None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:22:14.880345 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9b20b5-9e6f-48c5-b503-b8074be3a16e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:22:14.956678 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-ab9b20b5-9e6f-48c5-b503-b8074be3a16e None None] MFA Rules not processed for user `5b56f96cb3184a3ba82c8a0c3427e268`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:22:14.957922 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-ab9b20b5-9e6f-48c5-b503-b8074be3a16e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:22:15.070351 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 714/1409] 10.222.0.27 () {58 vars in 1015 bytes} [Tue Sep 13 15:22:14 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:22:15.085321 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb293d89-b284-4b10-8ece-0855fcc3013b None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:22:15.085604 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb293d89-b284-4b10-8ece-0855fcc3013b None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:22:15.085910 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb293d89-b284-4b10-8ece-0855fcc3013b None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:22:15.087244 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 696/1410] 10.222.0.27 () {54 vars in 918 bytes} [Tue Sep 13 15:22:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:22:15.092044 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c4b1d6-92b9-490c-95de-18166958add9 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:22:15.092518 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c4b1d6-92b9-490c-95de-18166958add9 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:22:15.092981 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c4b1d6-92b9-490c-95de-18166958add9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:22:15.175054 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:22:15.179177 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-f9c4b1d6-92b9-490c-95de-18166958add9 None None] MFA Rules not processed for user `62aad71c6c1a4469805762bba330bf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:22:15.181320 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-f9c4b1d6-92b9-490c-95de-18166958add9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:22:15.296819 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 715/1411] 10.222.0.27 () {58 vars in 1015 bytes} [Tue Sep 13 15:22:15 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:22:17.884824 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c33be55-6f55-42bd-8309-afbbf00a275c None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:22:17.885377 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c33be55-6f55-42bd-8309-afbbf00a275c None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:22:17.885377 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c33be55-6f55-42bd-8309-afbbf00a275c None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:22:17.886736 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 697/1412] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 15:22:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:22:17.892123 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f4a404-5b63-4822-9514-da3ea7be0d3e None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:22:17.892570 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f4a404-5b63-4822-9514-da3ea7be0d3e None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:22:17.892678 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f4a404-5b63-4822-9514-da3ea7be0d3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:22:17.958639 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-f0f4a404-5b63-4822-9514-da3ea7be0d3e None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:22:17.959838 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-f0f4a404-5b63-4822-9514-da3ea7be0d3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:22:18.013555 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:22:18.055595 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 716/1413] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 15:22:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:22:18.352751 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c33be55-6f55-42bd-8309-afbbf00a275c None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:22:18.354474 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-4c33be55-6f55-42bd-8309-afbbf00a275c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:22:18.501712 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c33be55-6f55-42bd-8309-afbbf00a275c None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:22:18.574399 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:22:18.614460 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4748f4-c6c7-48a8-9ee0-0885bdc78c88 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62aad71c6c1a4469805762bba330bf0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:22:18.614996 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4748f4-c6c7-48a8-9ee0-0885bdc78c88 service nova] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:22:18.615272 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4748f4-c6c7-48a8-9ee0-0885bdc78c88 service nova] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:22:18.615542 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4748f4-c6c7-48a8-9ee0-0885bdc78c88 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:22:18.617117 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-ea4748f4-c6c7-48a8-9ee0-0885bdc78c88 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:22:18.706012 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4748f4-c6c7-48a8-9ee0-0885bdc78c88 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:22:18.707623 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4748f4-c6c7-48a8-9ee0-0885bdc78c88 service nova] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:22:18.726326 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 698/1414] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:22:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:22:19.860189 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19c3c5d-5562-4c1e-a87c-13fb81c8d7a4 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:22:19.860678 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19c3c5d-5562-4c1e-a87c-13fb81c8d7a4 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:22:19.860776 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19c3c5d-5562-4c1e-a87c-13fb81c8d7a4 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:22:19.862168 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 717/1415] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 13 15:22:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:22:19.868607 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b0a034-fbe7-4e88-adaa-f7c10f5e0b62 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:22:19.869002 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b0a034-fbe7-4e88-adaa-f7c10f5e0b62 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:22:19.869164 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b0a034-fbe7-4e88-adaa-f7c10f5e0b62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:22:19.945021 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-58b0a034-fbe7-4e88-adaa-f7c10f5e0b62 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:22:19.946257 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-58b0a034-fbe7-4e88-adaa-f7c10f5e0b62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:22:19.973464 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:22:20.042952 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 699/1416] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 13 15:22:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:22:20.192820 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19c3c5d-5562-4c1e-a87c-13fb81c8d7a4 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:22:20.194358 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-e19c3c5d-5562-4c1e-a87c-13fb81c8d7a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:22:20.338110 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19c3c5d-5562-4c1e-a87c-13fb81c8d7a4 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:22:20.377862 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:22:20.450752 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a2ad8c-2b12-4d9b-9a60-ec0ae0e437ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62aad71c6c1a4469805762bba330bf0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:22:20.451366 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a2ad8c-2b12-4d9b-9a60-ec0ae0e437ea service nova] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:22:20.451818 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a2ad8c-2b12-4d9b-9a60-ec0ae0e437ea service nova] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:22:20.452099 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a2ad8c-2b12-4d9b-9a60-ec0ae0e437ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:22:20.453782 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-15a2ad8c-2b12-4d9b-9a60-ec0ae0e437ea service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:22:20.541262 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a2ad8c-2b12-4d9b-9a60-ec0ae0e437ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:22:20.542909 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a2ad8c-2b12-4d9b-9a60-ec0ae0e437ea service nova] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:22:20.562098 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 718/1417] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:22:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:22:21.697857 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892ca9c9-913e-4c6d-a8d5-3f6dfa76e27f None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:22:21.698418 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892ca9c9-913e-4c6d-a8d5-3f6dfa76e27f None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:22:21.698418 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892ca9c9-913e-4c6d-a8d5-3f6dfa76e27f None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:22:21.699767 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 700/1418] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 13 15:22:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:22:21.706502 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8943f15b-7c36-48e4-bebd-8c221b0c1def None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:22:21.706958 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8943f15b-7c36-48e4-bebd-8c221b0c1def None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:22:21.707054 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8943f15b-7c36-48e4-bebd-8c221b0c1def None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:22:21.761431 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:22:21.783732 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-8943f15b-7c36-48e4-bebd-8c221b0c1def None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:22:21.785021 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-8943f15b-7c36-48e4-bebd-8c221b0c1def None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:22:21.882206 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 719/1419] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 13 15:22:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:22:22.031977 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892ca9c9-913e-4c6d-a8d5-3f6dfa76e27f None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:22:22.033501 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-892ca9c9-913e-4c6d-a8d5-3f6dfa76e27f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:22:22.177615 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892ca9c9-913e-4c6d-a8d5-3f6dfa76e27f None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:22:22.190442 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:22:22.292562 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6fb357-c1e4-4a7a-ac18-2099d65f643f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62aad71c6c1a4469805762bba330bf0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:22:22.293172 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6fb357-c1e4-4a7a-ac18-2099d65f643f service nova] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:22:22.293457 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6fb357-c1e4-4a7a-ac18-2099d65f643f service nova] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:22:22.293762 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6fb357-c1e4-4a7a-ac18-2099d65f643f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:22:22.295971 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-2e6fb357-c1e4-4a7a-ac18-2099d65f643f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:22:22.385464 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6fb357-c1e4-4a7a-ac18-2099d65f643f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:22:22.387093 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6fb357-c1e4-4a7a-ac18-2099d65f643f service nova] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:22:22.405669 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 701/1420] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:22:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:22:23.528080 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5698d5a6-5746-4a7d-9e42-200c1b0ca7f8 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:22:23.528651 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5698d5a6-5746-4a7d-9e42-200c1b0ca7f8 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:22:23.528651 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5698d5a6-5746-4a7d-9e42-200c1b0ca7f8 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:22:23.530171 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 720/1421] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 13 15:22:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:22:23.536610 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4846f5-2762-4bd8-b086-9ca2617fb80b None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:22:23.537119 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4846f5-2762-4bd8-b086-9ca2617fb80b None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:22:23.537219 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4846f5-2762-4bd8-b086-9ca2617fb80b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:22:23.557447 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:22:23.615020 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-cd4846f5-2762-4bd8-b086-9ca2617fb80b None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:22:23.616222 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-cd4846f5-2762-4bd8-b086-9ca2617fb80b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:22:23.712957 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 702/1422] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 13 15:22:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:22:23.864677 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5698d5a6-5746-4a7d-9e42-200c1b0ca7f8 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:22:23.866234 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-5698d5a6-5746-4a7d-9e42-200c1b0ca7f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:22:23.975119 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:22:24.011072 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5698d5a6-5746-4a7d-9e42-200c1b0ca7f8 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:22:24.126339 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492d9f91-4d41-44ce-bb4e-d5d3b7aba51e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62aad71c6c1a4469805762bba330bf0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:22:24.126866 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492d9f91-4d41-44ce-bb4e-d5d3b7aba51e service nova] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:22:24.127148 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492d9f91-4d41-44ce-bb4e-d5d3b7aba51e service nova] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:22:24.127421 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492d9f91-4d41-44ce-bb4e-d5d3b7aba51e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:22:24.129057 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-492d9f91-4d41-44ce-bb4e-d5d3b7aba51e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:22:24.206529 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:22:24.220906 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492d9f91-4d41-44ce-bb4e-d5d3b7aba51e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:22:24.222584 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492d9f91-4d41-44ce-bb4e-d5d3b7aba51e service nova] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:22:24.240246 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 721/1423] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:22:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:22:25.353936 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363b82b9-2227-43e7-a3c0-3635a19b56c6 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:22:25.354503 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363b82b9-2227-43e7-a3c0-3635a19b56c6 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:22:25.354503 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363b82b9-2227-43e7-a3c0-3635a19b56c6 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:22:25.355920 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 703/1424] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 13 15:22:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:22:25.362669 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0851d944-2e75-47ec-a14e-c703a2399861 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:22:25.363115 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0851d944-2e75-47ec-a14e-c703a2399861 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:22:25.363248 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0851d944-2e75-47ec-a14e-c703a2399861 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:22:25.439531 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-0851d944-2e75-47ec-a14e-c703a2399861 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:22:25.440745 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-0851d944-2e75-47ec-a14e-c703a2399861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:22:25.538459 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 722/1425] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 13 15:22:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:22:25.687991 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363b82b9-2227-43e7-a3c0-3635a19b56c6 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:22:25.689617 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-363b82b9-2227-43e7-a3c0-3635a19b56c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:22:25.774539 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:22:25.836964 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363b82b9-2227-43e7-a3c0-3635a19b56c6 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:22:25.951066 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8408d369-2fc2-4915-9bc2-5855a7721242 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62aad71c6c1a4469805762bba330bf0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:22:25.951599 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8408d369-2fc2-4915-9bc2-5855a7721242 service nova] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:22:25.951956 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8408d369-2fc2-4915-9bc2-5855a7721242 service nova] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:22:25.952742 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8408d369-2fc2-4915-9bc2-5855a7721242 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:22:25.954581 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-8408d369-2fc2-4915-9bc2-5855a7721242 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:22:26.003084 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:22:26.044726 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8408d369-2fc2-4915-9bc2-5855a7721242 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:22:26.047104 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8408d369-2fc2-4915-9bc2-5855a7721242 service nova] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:22:26.064997 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 704/1426] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:22:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:22:27.147697 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c884a33-95f9-47cf-a1e9-4571102b33c2 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:22:27.148254 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c884a33-95f9-47cf-a1e9-4571102b33c2 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:22:27.148363 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c884a33-95f9-47cf-a1e9-4571102b33c2 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:22:27.149679 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 723/1427] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 13 15:22:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:22:27.156216 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdca04f7-8584-417c-a43c-41b35370a320 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:22:27.156690 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdca04f7-8584-417c-a43c-41b35370a320 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:22:27.156820 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdca04f7-8584-417c-a43c-41b35370a320 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:22:27.234813 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-cdca04f7-8584-417c-a43c-41b35370a320 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:22:27.236036 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-cdca04f7-8584-417c-a43c-41b35370a320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:22:27.332539 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 705/1428] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 13 15:22:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:22:27.483627 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c884a33-95f9-47cf-a1e9-4571102b33c2 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:22:27.485066 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-7c884a33-95f9-47cf-a1e9-4571102b33c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:22:27.536032 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:22:27.631884 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c884a33-95f9-47cf-a1e9-4571102b33c2 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:22:27.745107 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20990b3c-527a-4f3b-ab6d-76b5f8e5a78a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62aad71c6c1a4469805762bba330bf0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:22:27.745653 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20990b3c-527a-4f3b-ab6d-76b5f8e5a78a service nova] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:22:27.745964 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20990b3c-527a-4f3b-ab6d-76b5f8e5a78a service nova] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:22:27.746240 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20990b3c-527a-4f3b-ab6d-76b5f8e5a78a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:22:27.747882 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-20990b3c-527a-4f3b-ab6d-76b5f8e5a78a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:22:27.755382 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:22:27.839782 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20990b3c-527a-4f3b-ab6d-76b5f8e5a78a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:22:27.841516 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20990b3c-527a-4f3b-ab6d-76b5f8e5a78a service nova] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:22:27.860531 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 724/1429] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:22:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:22:28.958842 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c523548-79d3-42b8-a7e1-c63e7dc27630 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:22:28.959396 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c523548-79d3-42b8-a7e1-c63e7dc27630 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:22:28.959396 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c523548-79d3-42b8-a7e1-c63e7dc27630 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:22:28.960662 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 706/1430] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 13 15:22:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:22:28.966745 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bcb506-b992-4fa2-bf27-a93068bb020a None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:22:28.967200 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bcb506-b992-4fa2-bf27-a93068bb020a None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:22:28.967303 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bcb506-b992-4fa2-bf27-a93068bb020a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:22:29.044044 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-85bcb506-b992-4fa2-bf27-a93068bb020a None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:22:29.045260 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-85bcb506-b992-4fa2-bf27-a93068bb020a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:22:29.112805 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:22:29.141061 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 725/1431] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 13 15:22:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:22:29.305734 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c523548-79d3-42b8-a7e1-c63e7dc27630 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:22:29.307178 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-5c523548-79d3-42b8-a7e1-c63e7dc27630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:22:29.325588 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:22:29.454983 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c523548-79d3-42b8-a7e1-c63e7dc27630 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:22:29.540981 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:22:29.567701 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5de876-da7d-4c39-92a9-45727fe98503 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62aad71c6c1a4469805762bba330bf0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:22:29.568241 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5de876-da7d-4c39-92a9-45727fe98503 service nova] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:22:29.568523 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5de876-da7d-4c39-92a9-45727fe98503 service nova] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:22:29.568797 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5de876-da7d-4c39-92a9-45727fe98503 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:22:29.570411 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-dd5de876-da7d-4c39-92a9-45727fe98503 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:22:29.658921 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5de876-da7d-4c39-92a9-45727fe98503 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:22:29.660508 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5de876-da7d-4c39-92a9-45727fe98503 service nova] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:22:29.680245 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 707/1432] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:22:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:22:30.744672 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fc8f8c-90b7-47f1-90a2-387eeabee5f4 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:22:30.745182 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fc8f8c-90b7-47f1-90a2-387eeabee5f4 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:22:30.745288 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fc8f8c-90b7-47f1-90a2-387eeabee5f4 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:22:30.746638 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 726/1433] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 13 15:22:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:22:30.752925 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ca3acf-af6a-4a23-97ae-50c65b15db77 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:22:30.753354 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ca3acf-af6a-4a23-97ae-50c65b15db77 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:22:30.753459 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ca3acf-af6a-4a23-97ae-50c65b15db77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:22:30.829799 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-67ca3acf-af6a-4a23-97ae-50c65b15db77 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:22:30.831003 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-67ca3acf-af6a-4a23-97ae-50c65b15db77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:22:30.874791 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:22:30.930735 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 708/1434] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 13 15:22:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:22:31.082074 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fc8f8c-90b7-47f1-90a2-387eeabee5f4 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:22:31.083532 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-92fc8f8c-90b7-47f1-90a2-387eeabee5f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:22:31.227902 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fc8f8c-90b7-47f1-90a2-387eeabee5f4 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:22:31.281148 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:22:31.339449 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa476050-0ae4-4ada-8f1c-b7b6c6afb937 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62aad71c6c1a4469805762bba330bf0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:22:31.339981 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa476050-0ae4-4ada-8f1c-b7b6c6afb937 service nova] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:22:31.340262 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa476050-0ae4-4ada-8f1c-b7b6c6afb937 service nova] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:22:31.340537 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa476050-0ae4-4ada-8f1c-b7b6c6afb937 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:22:31.342163 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-fa476050-0ae4-4ada-8f1c-b7b6c6afb937 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:22:31.430491 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa476050-0ae4-4ada-8f1c-b7b6c6afb937 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:22:31.432118 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa476050-0ae4-4ada-8f1c-b7b6c6afb937 service nova] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:22:31.450886 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 727/1435] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:22:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:22:32.507481 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179c4194-ee49-4d7c-81f7-f608f45b21bb None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:22:32.508058 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179c4194-ee49-4d7c-81f7-f608f45b21bb None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:22:32.508058 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179c4194-ee49-4d7c-81f7-f608f45b21bb None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:22:32.509476 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 709/1436] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 13 15:22:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:22:32.516550 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e9539b-10c1-46de-98db-ddbe2b3053ac None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:22:32.516974 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e9539b-10c1-46de-98db-ddbe2b3053ac None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:22:32.517118 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e9539b-10c1-46de-98db-ddbe2b3053ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:22:32.592646 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-48e9539b-10c1-46de-98db-ddbe2b3053ac None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:22:32.594475 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-48e9539b-10c1-46de-98db-ddbe2b3053ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:22:32.596470 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:22:32.691708 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 728/1437] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 13 15:22:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:22:32.841935 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179c4194-ee49-4d7c-81f7-f608f45b21bb None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:22:32.844219 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-179c4194-ee49-4d7c-81f7-f608f45b21bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:22:32.989520 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179c4194-ee49-4d7c-81f7-f608f45b21bb None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:22:33.016196 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:22:33.103190 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3baf69-946b-4829-b17e-c0b8154c2373 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62aad71c6c1a4469805762bba330bf0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:22:33.103717 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3baf69-946b-4829-b17e-c0b8154c2373 service nova] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:22:33.103997 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3baf69-946b-4829-b17e-c0b8154c2373 service nova] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:22:33.104270 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3baf69-946b-4829-b17e-c0b8154c2373 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:22:33.105894 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-7f3baf69-946b-4829-b17e-c0b8154c2373 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:22:33.195647 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3baf69-946b-4829-b17e-c0b8154c2373 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:22:33.197238 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3baf69-946b-4829-b17e-c0b8154c2373 service nova] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:22:33.215712 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 710/1438] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:22:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:22:35.293394 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2679d8-d17d-4785-93b9-ca196e913d1a None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:22:35.293991 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2679d8-d17d-4785-93b9-ca196e913d1a None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:22:35.293991 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2679d8-d17d-4785-93b9-ca196e913d1a None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:22:35.295311 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 729/1439] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 15:22:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:22:35.301452 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0d5bac-ec76-4b18-ad51-36cf9378a7ab None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:22:35.301909 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0d5bac-ec76-4b18-ad51-36cf9378a7ab None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:22:35.302048 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0d5bac-ec76-4b18-ad51-36cf9378a7ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:22:35.460286 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:22:35.486166 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-aa0d5bac-ec76-4b18-ad51-36cf9378a7ab None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:22:35.487361 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-aa0d5bac-ec76-4b18-ad51-36cf9378a7ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:22:35.582440 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 711/1440] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 15:22:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 15:22:35.892604 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc1e037-082e-4bc7-b19f-b445f2f6725b None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:22:35.892923 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc1e037-082e-4bc7-b19f-b445f2f6725b None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:22:35.893180 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc1e037-082e-4bc7-b19f-b445f2f6725b None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:22:35.894625 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 730/1441] 10.222.0.27 () {54 vars in 965 bytes} [Tue Sep 13 15:22:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 15:22:35.900817 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66653c12-27c3-4f78-9b56-b225555b63e6 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:22:35.901106 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66653c12-27c3-4f78-9b56-b225555b63e6 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:22:35.901386 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66653c12-27c3-4f78-9b56-b225555b63e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:22:35.978421 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-66653c12-27c3-4f78-9b56-b225555b63e6 None None] MFA Rules not processed for user `41675154bbba47388040966f75d84c3c`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:22:35.979563 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-66653c12-27c3-4f78-9b56-b225555b63e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:22:36.041541 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:22:36.073416 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 712/1442] 10.222.0.27 () {58 vars in 1062 bytes} [Tue Sep 13 15:22:35 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:22:36.084471 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc1e037-082e-4bc7-b19f-b445f2f6725b None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:22:36.086085 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-ddc1e037-082e-4bc7-b19f-b445f2f6725b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:22:36.197344 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc1e037-082e-4bc7-b19f-b445f2f6725b None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:22:36.232177 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:22:36.277940 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccc5e8a-e8ca-48c7-9490-85efe147f285 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41675154bbba47388040966f75d84c3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:22:36.278549 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccc5e8a-e8ca-48c7-9490-85efe147f285 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:22:36.278823 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccc5e8a-e8ca-48c7-9490-85efe147f285 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:22:36.279090 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccc5e8a-e8ca-48c7-9490-85efe147f285 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:22:36.280716 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-8ccc5e8a-e8ca-48c7-9490-85efe147f285 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:22:36.406177 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccc5e8a-e8ca-48c7-9490-85efe147f285 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:22:36.407612 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccc5e8a-e8ca-48c7-9490-85efe147f285 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:22:36.431574 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 731/1443] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:22:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:22:39.160740 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459130d4-9572-47cf-9e36-a49d6b744b78 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:22:39.161312 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459130d4-9572-47cf-9e36-a49d6b744b78 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:22:39.161312 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459130d4-9572-47cf-9e36-a49d6b744b78 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:22:39.162681 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 713/1444] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 15:22:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:22:39.167880 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d8c863-db46-4d99-ac85-7e4277845130 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:22:39.168308 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d8c863-db46-4d99-ac85-7e4277845130 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:22:39.168415 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d8c863-db46-4d99-ac85-7e4277845130 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:22:39.235592 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-31d8c863-db46-4d99-ac85-7e4277845130 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:22:39.236856 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-31d8c863-db46-4d99-ac85-7e4277845130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:22:39.249350 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:22:39.332490 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 732/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 15:22:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:22:39.623992 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459130d4-9572-47cf-9e36-a49d6b744b78 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:22:39.626161 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-459130d4-9572-47cf-9e36-a49d6b744b78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:22:39.735492 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459130d4-9572-47cf-9e36-a49d6b744b78 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:22:39.808007 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa1180f-7a28-4227-b7c6-6c9357014c50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41675154bbba47388040966f75d84c3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:22:39.808607 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa1180f-7a28-4227-b7c6-6c9357014c50 service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:22:39.808888 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa1180f-7a28-4227-b7c6-6c9357014c50 service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:22:39.809157 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa1180f-7a28-4227-b7c6-6c9357014c50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:22:39.810765 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-2fa1180f-7a28-4227-b7c6-6c9357014c50 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:22:39.842631 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:22:39.919427 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa1180f-7a28-4227-b7c6-6c9357014c50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:22:39.920868 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa1180f-7a28-4227-b7c6-6c9357014c50 service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:22:39.940690 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 714/1446] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:22:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:22:42.489854 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dea6b3-886f-4d3a-88fd-3cc0183c7980 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:22:42.490460 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dea6b3-886f-4d3a-88fd-3cc0183c7980 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:22:42.490460 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dea6b3-886f-4d3a-88fd-3cc0183c7980 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:22:42.491760 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 733/1447] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 15:22:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:22:42.496950 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68730c29-42af-4072-ad26-6a095a47f9a7 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:22:42.497358 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68730c29-42af-4072-ad26-6a095a47f9a7 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:22:42.497505 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68730c29-42af-4072-ad26-6a095a47f9a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:22:42.564139 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-68730c29-42af-4072-ad26-6a095a47f9a7 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:22:42.565338 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-68730c29-42af-4072-ad26-6a095a47f9a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:22:42.642164 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:22:42.661006 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 715/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 15:22:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:22:42.948310 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dea6b3-886f-4d3a-88fd-3cc0183c7980 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:22:42.949901 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-09dea6b3-886f-4d3a-88fd-3cc0183c7980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:22:43.051503 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dea6b3-886f-4d3a-88fd-3cc0183c7980 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:22:43.091084 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:22:43.123702 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf2e4a0-dbf1-426d-b85c-c0e9de4af825 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41675154bbba47388040966f75d84c3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:22:43.124303 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf2e4a0-dbf1-426d-b85c-c0e9de4af825 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:22:43.124585 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf2e4a0-dbf1-426d-b85c-c0e9de4af825 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:22:43.125412 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf2e4a0-dbf1-426d-b85c-c0e9de4af825 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:22:43.127141 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-dcf2e4a0-dbf1-426d-b85c-c0e9de4af825 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:22:43.238500 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf2e4a0-dbf1-426d-b85c-c0e9de4af825 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:22:43.239856 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf2e4a0-dbf1-426d-b85c-c0e9de4af825 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:22:43.257429 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 734/1449] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:22:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:22:45.558479 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc7d906-5cb4-4d86-af22-4d99d43480b6 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:22:45.559057 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc7d906-5cb4-4d86-af22-4d99d43480b6 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:22:45.559161 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc7d906-5cb4-4d86-af22-4d99d43480b6 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:22:45.560477 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 716/1450] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 15:22:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:22:45.566726 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803f821c-7f1c-47ac-8961-e82b4a13701d None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:22:45.567163 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803f821c-7f1c-47ac-8961-e82b4a13701d None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:22:45.567280 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803f821c-7f1c-47ac-8961-e82b4a13701d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:22:45.632844 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-803f821c-7f1c-47ac-8961-e82b4a13701d None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:22:45.634092 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-803f821c-7f1c-47ac-8961-e82b4a13701d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:22:45.654111 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:22:45.735935 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 735/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 15:22:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:22:46.027764 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc7d906-5cb4-4d86-af22-4d99d43480b6 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:22:46.029296 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-1bc7d906-5cb4-4d86-af22-4d99d43480b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:22:46.131145 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc7d906-5cb4-4d86-af22-4d99d43480b6 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:22:46.205183 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc38883-9fd9-4d33-a7cb-860920d4d9e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41675154bbba47388040966f75d84c3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:22:46.205818 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc38883-9fd9-4d33-a7cb-860920d4d9e9 service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:22:46.206101 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc38883-9fd9-4d33-a7cb-860920d4d9e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:22:46.206377 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc38883-9fd9-4d33-a7cb-860920d4d9e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:22:46.207947 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-1bc38883-9fd9-4d33-a7cb-860920d4d9e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:22:46.246646 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:22:46.316687 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc38883-9fd9-4d33-a7cb-860920d4d9e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:22:46.318160 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc38883-9fd9-4d33-a7cb-860920d4d9e9 service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:22:46.336950 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 717/1452] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:22:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:22:48.611804 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7641417f-cd71-4a0b-a362-5d0c907495a0 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:22:48.612378 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7641417f-cd71-4a0b-a362-5d0c907495a0 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:22:48.612378 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7641417f-cd71-4a0b-a362-5d0c907495a0 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:22:48.613745 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 736/1453] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 15:22:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:22:48.619094 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2663c13a-755e-4ad9-8b83-1dbfb28b2b5d None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:22:48.619514 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2663c13a-755e-4ad9-8b83-1dbfb28b2b5d None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:22:48.619639 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2663c13a-755e-4ad9-8b83-1dbfb28b2b5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:22:48.684600 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-2663c13a-755e-4ad9-8b83-1dbfb28b2b5d None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:22:48.685824 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-2663c13a-755e-4ad9-8b83-1dbfb28b2b5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:22:48.779084 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:22:48.785139 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 718/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 15:22:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:22:49.080902 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7641417f-cd71-4a0b-a362-5d0c907495a0 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:22:49.082563 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-7641417f-cd71-4a0b-a362-5d0c907495a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:22:49.185665 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7641417f-cd71-4a0b-a362-5d0c907495a0 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:22:49.235844 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:22:49.260369 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4587c17-95b9-43a7-98ba-488797449244 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41675154bbba47388040966f75d84c3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:22:49.260969 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4587c17-95b9-43a7-98ba-488797449244 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:22:49.261248 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4587c17-95b9-43a7-98ba-488797449244 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:22:49.261517 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4587c17-95b9-43a7-98ba-488797449244 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:22:49.263128 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-f4587c17-95b9-43a7-98ba-488797449244 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:22:49.371853 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4587c17-95b9-43a7-98ba-488797449244 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:22:49.373215 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4587c17-95b9-43a7-98ba-488797449244 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:22:49.391678 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 737/1455] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:22:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:22:51.608891 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45092d68-8e84-4e38-b5f9-b2f1adfe7141 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:22:51.609472 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45092d68-8e84-4e38-b5f9-b2f1adfe7141 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:22:51.609472 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45092d68-8e84-4e38-b5f9-b2f1adfe7141 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:22:51.611362 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 719/1456] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 15:22:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:22:51.616649 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6b7539-31b3-493c-9356-b71ae79f4745 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:22:51.617064 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6b7539-31b3-493c-9356-b71ae79f4745 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:22:51.617226 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6b7539-31b3-493c-9356-b71ae79f4745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:22:51.682453 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-1b6b7539-31b3-493c-9356-b71ae79f4745 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:22:51.683656 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-1b6b7539-31b3-493c-9356-b71ae79f4745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:22:51.713100 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:22:51.785334 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 738/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 15:22:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:22:52.072019 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45092d68-8e84-4e38-b5f9-b2f1adfe7141 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:22:52.073546 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-45092d68-8e84-4e38-b5f9-b2f1adfe7141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:22:52.174991 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45092d68-8e84-4e38-b5f9-b2f1adfe7141 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:22:52.247278 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c964a4-5156-4a1a-8e43-99a3e421fa2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41675154bbba47388040966f75d84c3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:22:52.247871 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c964a4-5156-4a1a-8e43-99a3e421fa2e service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:22:52.248150 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c964a4-5156-4a1a-8e43-99a3e421fa2e service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:22:52.248422 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c964a4-5156-4a1a-8e43-99a3e421fa2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:22:52.250013 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-f2c964a4-5156-4a1a-8e43-99a3e421fa2e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:22:52.299990 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:22:52.360939 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c964a4-5156-4a1a-8e43-99a3e421fa2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:22:52.362338 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c964a4-5156-4a1a-8e43-99a3e421fa2e service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:22:52.380509 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 720/1458] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:22:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:22:54.600204 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8360518a-90f9-4ef7-a0af-7cd8b8ae28b7 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:22:54.600784 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8360518a-90f9-4ef7-a0af-7cd8b8ae28b7 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:22:54.600784 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8360518a-90f9-4ef7-a0af-7cd8b8ae28b7 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:22:54.602148 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 739/1459] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 15:22:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:22:54.608059 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1bc0e9-c9b6-43e0-9e23-27bf1d6dae57 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:22:54.608530 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1bc0e9-c9b6-43e0-9e23-27bf1d6dae57 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:22:54.608739 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1bc0e9-c9b6-43e0-9e23-27bf1d6dae57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:22:54.676906 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-7f1bc0e9-c9b6-43e0-9e23-27bf1d6dae57 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:22:54.678142 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-7f1bc0e9-c9b6-43e0-9e23-27bf1d6dae57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:22:54.778708 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 721/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 15:22:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:22:55.064827 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8360518a-90f9-4ef7-a0af-7cd8b8ae28b7 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:22:55.066428 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-8360518a-90f9-4ef7-a0af-7cd8b8ae28b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:22:55.168934 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8360518a-90f9-4ef7-a0af-7cd8b8ae28b7 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:22:55.226508 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:22:55.245250 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3264fdd1-0d6e-4b5f-9060-1d524228a844 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41675154bbba47388040966f75d84c3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:22:55.245896 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3264fdd1-0d6e-4b5f-9060-1d524228a844 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:22:55.246181 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3264fdd1-0d6e-4b5f-9060-1d524228a844 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:22:55.246454 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3264fdd1-0d6e-4b5f-9060-1d524228a844 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:22:55.248056 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-3264fdd1-0d6e-4b5f-9060-1d524228a844 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:22:55.356910 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3264fdd1-0d6e-4b5f-9060-1d524228a844 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:22:55.358299 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3264fdd1-0d6e-4b5f-9060-1d524228a844 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:22:55.377324 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 740/1461] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:22:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:22:57.599281 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcecaa5-8287-4f10-956e-198a22ef8d4a None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:22:57.599867 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcecaa5-8287-4f10-956e-198a22ef8d4a None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:22:57.599867 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcecaa5-8287-4f10-956e-198a22ef8d4a None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:22:57.601159 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 722/1462] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 15:22:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:22:57.606526 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f500a5-9a6c-46b3-a74e-371ff62ce590 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:22:57.606971 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f500a5-9a6c-46b3-a74e-371ff62ce590 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:22:57.607069 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f500a5-9a6c-46b3-a74e-371ff62ce590 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:22:57.673232 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-48f500a5-9a6c-46b3-a74e-371ff62ce590 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:22:57.674492 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-48f500a5-9a6c-46b3-a74e-371ff62ce590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:22:57.713514 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:22:57.778913 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 741/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 15:22:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:22:58.064669 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcecaa5-8287-4f10-956e-198a22ef8d4a None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:22:58.066241 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-9bcecaa5-8287-4f10-956e-198a22ef8d4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:22:58.070081 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:22:58.170378 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcecaa5-8287-4f10-956e-198a22ef8d4a None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:22:58.253502 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1c1eac-134a-4e54-b6fb-c879784cd0fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41675154bbba47388040966f75d84c3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:22:58.254142 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1c1eac-134a-4e54-b6fb-c879784cd0fb service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:22:58.254423 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1c1eac-134a-4e54-b6fb-c879784cd0fb service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:22:58.254696 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1c1eac-134a-4e54-b6fb-c879784cd0fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:22:58.256298 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-7f1c1eac-134a-4e54-b6fb-c879784cd0fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:22:58.316926 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:22:58.367369 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1c1eac-134a-4e54-b6fb-c879784cd0fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:22:58.368824 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1c1eac-134a-4e54-b6fb-c879784cd0fb service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:22:58.387263 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 723/1464] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:22:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:23:00.573709 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39680747-afe2-434f-9a79-bd46f258925d None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:23:00.574292 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39680747-afe2-434f-9a79-bd46f258925d None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:23:00.574292 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39680747-afe2-434f-9a79-bd46f258925d None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:23:00.575656 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 742/1465] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 15:23:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:23:00.581924 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18614327-30c4-4d69-abb7-01cf4bc206c1 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:23:00.582354 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18614327-30c4-4d69-abb7-01cf4bc206c1 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:23:00.582502 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18614327-30c4-4d69-abb7-01cf4bc206c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:23:00.648344 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-18614327-30c4-4d69-abb7-01cf4bc206c1 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:23:00.649635 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-18614327-30c4-4d69-abb7-01cf4bc206c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:23:00.753018 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 724/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 15:23:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:23:01.039419 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39680747-afe2-434f-9a79-bd46f258925d None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:23:01.040968 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-39680747-afe2-434f-9a79-bd46f258925d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:23:01.145309 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39680747-afe2-434f-9a79-bd46f258925d None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:23:01.213240 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:23:01.220278 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa69c45-c43a-41aa-ac02-6bdcafbcdc15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41675154bbba47388040966f75d84c3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:23:01.220889 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa69c45-c43a-41aa-ac02-6bdcafbcdc15 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:23:01.221174 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa69c45-c43a-41aa-ac02-6bdcafbcdc15 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:23:01.221452 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa69c45-c43a-41aa-ac02-6bdcafbcdc15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:23:01.223081 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-4aa69c45-c43a-41aa-ac02-6bdcafbcdc15 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:23:01.330213 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa69c45-c43a-41aa-ac02-6bdcafbcdc15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:23:01.331566 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa69c45-c43a-41aa-ac02-6bdcafbcdc15 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:23:01.348962 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 743/1467] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:23:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:23:03.502367 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bd73f7-b8d9-4dae-ac3d-01e963f48795 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:23:03.502987 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bd73f7-b8d9-4dae-ac3d-01e963f48795 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:23:03.502987 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bd73f7-b8d9-4dae-ac3d-01e963f48795 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:23:03.504362 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 725/1468] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 15:23:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:23:03.509871 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cbe911-7aa5-4633-ad15-799bd16bda51 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:23:03.510260 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cbe911-7aa5-4633-ad15-799bd16bda51 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:23:03.510432 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cbe911-7aa5-4633-ad15-799bd16bda51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:23:03.576501 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-95cbe911-7aa5-4633-ad15-799bd16bda51 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:23:03.577735 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-95cbe911-7aa5-4633-ad15-799bd16bda51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:23:03.625648 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:23:03.674835 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 744/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 15:23:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:23:03.962477 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bd73f7-b8d9-4dae-ac3d-01e963f48795 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:23:03.964043 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-76bd73f7-b8d9-4dae-ac3d-01e963f48795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:23:03.978961 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:23:04.067647 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bd73f7-b8d9-4dae-ac3d-01e963f48795 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:23:04.139597 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfd4b05-e8ae-46d9-ba84-ac6d91f2ad91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41675154bbba47388040966f75d84c3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:23:04.140202 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfd4b05-e8ae-46d9-ba84-ac6d91f2ad91 service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:23:04.140481 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfd4b05-e8ae-46d9-ba84-ac6d91f2ad91 service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:23:04.140746 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfd4b05-e8ae-46d9-ba84-ac6d91f2ad91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:23:04.142794 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-5cfd4b05-e8ae-46d9-ba84-ac6d91f2ad91 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:23:04.210865 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:23:04.251992 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfd4b05-e8ae-46d9-ba84-ac6d91f2ad91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:23:04.253421 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfd4b05-e8ae-46d9-ba84-ac6d91f2ad91 service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:23:04.272132 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 726/1470] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:23:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:23:13.673410 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=22 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:23:14.269889 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=25 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:23:24.217390 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c107db-fecc-4405-96b9-880a1e7dcd60 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:23:24.217995 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c107db-fecc-4405-96b9-880a1e7dcd60 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:23:24.217995 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c107db-fecc-4405-96b9-880a1e7dcd60 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:23:24.219319 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 745/1471] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:23:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:23:24.225302 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11a1f2a-02f7-4a5d-9a88-3a80eba25e22 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:23:24.225767 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11a1f2a-02f7-4a5d-9a88-3a80eba25e22 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:23:24.225883 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11a1f2a-02f7-4a5d-9a88-3a80eba25e22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:23:24.290601 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-d11a1f2a-02f7-4a5d-9a88-3a80eba25e22 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:23:24.291814 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-d11a1f2a-02f7-4a5d-9a88-3a80eba25e22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:23:24.387327 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 727/1472] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:23:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:23:24.686686 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097b898c-c0c2-43e3-a171-bb644da58b5b None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:23:24.686977 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097b898c-c0c2-43e3-a171-bb644da58b5b None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:23:24.687280 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097b898c-c0c2-43e3-a171-bb644da58b5b None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:23:24.688631 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 746/1473] 10.222.0.27 () {54 vars in 966 bytes} [Tue Sep 13 15:23:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:23:24.694579 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e78291-9313-4ef6-8d7c-383371891ca4 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:23:24.694871 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e78291-9313-4ef6-8d7c-383371891ca4 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:23:24.695151 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e78291-9313-4ef6-8d7c-383371891ca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:23:24.771935 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-64e78291-9313-4ef6-8d7c-383371891ca4 None None] MFA Rules not processed for user `8ef26a5203094c83b52f10b930dfc453`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:23:24.773146 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-64e78291-9313-4ef6-8d7c-383371891ca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:23:24.793522 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:23:24.849566 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 728/1474] 10.222.0.27 () {58 vars in 1063 bytes} [Tue Sep 13 15:23:24 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:23:24.857406 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097b898c-c0c2-43e3-a171-bb644da58b5b None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:23:24.858953 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-097b898c-c0c2-43e3-a171-bb644da58b5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:23:24.963374 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097b898c-c0c2-43e3-a171-bb644da58b5b None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:23:25.038033 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f1c356-57d3-4c66-9f8d-d70d42f26dbc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef26a5203094c83b52f10b930dfc453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:23:25.038641 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f1c356-57d3-4c66-9f8d-d70d42f26dbc service glance] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:23:25.038926 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f1c356-57d3-4c66-9f8d-d70d42f26dbc service glance] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:23:25.039205 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f1c356-57d3-4c66-9f8d-d70d42f26dbc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:23:25.040807 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-d8f1c356-57d3-4c66-9f8d-d70d42f26dbc service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:23:25.095185 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:23:25.150444 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f1c356-57d3-4c66-9f8d-d70d42f26dbc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:23:25.151885 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f1c356-57d3-4c66-9f8d-d70d42f26dbc service glance] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:23:25.170549 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 747/1475] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:23:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:23:27.434481 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9b0f86-68af-451d-b8e1-8dfed7e1f7bb None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:23:27.435048 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9b0f86-68af-451d-b8e1-8dfed7e1f7bb None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:23:27.435048 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9b0f86-68af-451d-b8e1-8dfed7e1f7bb None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:23:27.436382 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 729/1476] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:23:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:23:27.442382 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b139654c-29af-4519-875b-5519809fa3fb None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:23:27.442810 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b139654c-29af-4519-875b-5519809fa3fb None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:23:27.442938 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b139654c-29af-4519-875b-5519809fa3fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:23:27.508333 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-b139654c-29af-4519-875b-5519809fa3fb None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:23:27.509547 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-b139654c-29af-4519-875b-5519809fa3fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:23:27.604346 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 748/1477] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:23:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:23:27.877771 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9b0f86-68af-451d-b8e1-8dfed7e1f7bb None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:23:27.879338 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-bf9b0f86-68af-451d-b8e1-8dfed7e1f7bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:23:28.010768 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9b0f86-68af-451d-b8e1-8dfed7e1f7bb None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:23:28.060328 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:23:28.105074 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ba70a2-f594-4974-819d-8457ffa9d215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:23:28.105681 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ba70a2-f594-4974-819d-8457ffa9d215 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:23:28.105991 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ba70a2-f594-4974-819d-8457ffa9d215 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:23:28.106267 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ba70a2-f594-4974-819d-8457ffa9d215 admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:23:28.106900 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ba70a2-f594-4974-819d-8457ffa9d215 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:23:28.108637 dv-cinder-857434-2-smb devstack@keystone.service[81450]: WARNING py.warnings [None req-a2ba70a2-f594-4974-819d-8457ffa9d215 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 13 15:23:28.108637 dv-cinder-857434-2-smb devstack@keystone.service[81450]: warnings.warn(msg) Sep 13 15:23:28.108637 dv-cinder-857434-2-smb devstack@keystone.service[81450]: Sep 13 15:23:28.109807 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ba70a2-f594-4974-819d-8457ffa9d215 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:23:28.129227 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 730/1478] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 13 15:23:27 2022] GET /identity/v3/projects => generated 2553 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 15:23:30.305179 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7ddd95-6098-4dc2-b3b8-9bdcac02ce07 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:23:30.305811 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7ddd95-6098-4dc2-b3b8-9bdcac02ce07 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:23:30.305811 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7ddd95-6098-4dc2-b3b8-9bdcac02ce07 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:23:30.307109 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 749/1479] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:23:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:23:30.312629 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f37d99-1c81-4eff-a8e7-7b982cf681b7 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:23:30.313061 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f37d99-1c81-4eff-a8e7-7b982cf681b7 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:23:30.313223 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f37d99-1c81-4eff-a8e7-7b982cf681b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:23:30.379126 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-86f37d99-1c81-4eff-a8e7-7b982cf681b7 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:23:30.380341 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-86f37d99-1c81-4eff-a8e7-7b982cf681b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:23:30.479655 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 731/1480] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:23:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:23:30.778513 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7ddd95-6098-4dc2-b3b8-9bdcac02ce07 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:23:30.780255 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-ef7ddd95-6098-4dc2-b3b8-9bdcac02ce07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:23:30.790699 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:23:30.929141 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7ddd95-6098-4dc2-b3b8-9bdcac02ce07 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:23:31.010559 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:23:31.043571 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50868a67-144d-4728-8dda-3833afc4720f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62aad71c6c1a4469805762bba330bf0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:23:31.044177 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50868a67-144d-4728-8dda-3833afc4720f service nova] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:23:31.044457 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50868a67-144d-4728-8dda-3833afc4720f service nova] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:23:31.044729 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50868a67-144d-4728-8dda-3833afc4720f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:23:31.046351 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-50868a67-144d-4728-8dda-3833afc4720f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:23:31.134764 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50868a67-144d-4728-8dda-3833afc4720f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:23:31.136384 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50868a67-144d-4728-8dda-3833afc4720f service nova] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:23:31.154920 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 750/1481] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:23:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:23:33.483952 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0671bd1b-243a-4c6b-9eff-7226fa9cfe26 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:23:33.484523 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0671bd1b-243a-4c6b-9eff-7226fa9cfe26 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:23:33.484523 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0671bd1b-243a-4c6b-9eff-7226fa9cfe26 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:23:33.485909 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 732/1482] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:23:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:23:33.492078 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b20dcb-c98f-45f3-808a-1e2efb678af8 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:23:33.492534 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b20dcb-c98f-45f3-808a-1e2efb678af8 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:23:33.492653 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b20dcb-c98f-45f3-808a-1e2efb678af8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:23:33.557198 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-96b20dcb-c98f-45f3-808a-1e2efb678af8 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:23:33.558420 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-96b20dcb-c98f-45f3-808a-1e2efb678af8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:23:33.604089 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:23:33.655276 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 751/1483] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:23:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:23:33.944437 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0671bd1b-243a-4c6b-9eff-7226fa9cfe26 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:23:33.945996 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-0671bd1b-243a-4c6b-9eff-7226fa9cfe26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:23:33.969437 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:23:34.049582 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0671bd1b-243a-4c6b-9eff-7226fa9cfe26 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:23:34.123059 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319c6544-3069-4add-b98c-cafc288e5cb6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41675154bbba47388040966f75d84c3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:23:34.123618 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319c6544-3069-4add-b98c-cafc288e5cb6 service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:23:34.123903 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319c6544-3069-4add-b98c-cafc288e5cb6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:23:34.124179 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319c6544-3069-4add-b98c-cafc288e5cb6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:23:34.125807 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-319c6544-3069-4add-b98c-cafc288e5cb6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:23:34.201523 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:23:34.237180 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319c6544-3069-4add-b98c-cafc288e5cb6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:23:34.238656 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319c6544-3069-4add-b98c-cafc288e5cb6 service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:23:34.257377 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 733/1484] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:23:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:23:36.466696 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c18e531-9e9d-4f7e-8a7c-cbbf88a42e6e None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:23:36.467268 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c18e531-9e9d-4f7e-8a7c-cbbf88a42e6e None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:23:36.467268 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c18e531-9e9d-4f7e-8a7c-cbbf88a42e6e None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:23:36.468611 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 752/1485] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:23:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:23:36.474474 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e608216-9224-4ebc-8aa7-6e3bddc58a6c None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:23:36.474894 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e608216-9224-4ebc-8aa7-6e3bddc58a6c None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:23:36.475040 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e608216-9224-4ebc-8aa7-6e3bddc58a6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:23:36.540635 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-0e608216-9224-4ebc-8aa7-6e3bddc58a6c None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:23:36.541897 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-0e608216-9224-4ebc-8aa7-6e3bddc58a6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:23:36.638649 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 734/1486] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:23:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:23:36.940506 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c18e531-9e9d-4f7e-8a7c-cbbf88a42e6e None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:23:36.942341 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-1c18e531-9e9d-4f7e-8a7c-cbbf88a42e6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:23:37.051296 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c18e531-9e9d-4f7e-8a7c-cbbf88a42e6e None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:23:37.262233 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:23:37.263756 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cd596b-7f8d-454f-a40a-13c47a00a6b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41675154bbba47388040966f75d84c3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:23:37.264356 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cd596b-7f8d-454f-a40a-13c47a00a6b8 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:23:37.264834 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cd596b-7f8d-454f-a40a-13c47a00a6b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:23:37.265163 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cd596b-7f8d-454f-a40a-13c47a00a6b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:23:37.268437 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-a0cd596b-7f8d-454f-a40a-13c47a00a6b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:23:37.384638 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cd596b-7f8d-454f-a40a-13c47a00a6b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:23:37.386353 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cd596b-7f8d-454f-a40a-13c47a00a6b8 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:23:37.405639 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 753/1487] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:23:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:23:39.849474 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26c0d36-d34e-4371-98c7-c5794e59764f None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:23:39.850064 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26c0d36-d34e-4371-98c7-c5794e59764f None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:23:39.850064 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26c0d36-d34e-4371-98c7-c5794e59764f None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:23:39.851494 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 735/1488] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:23:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:23:39.856665 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0e79ef-7394-484e-8fcc-cdcc7b0b6e50 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:23:39.857070 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0e79ef-7394-484e-8fcc-cdcc7b0b6e50 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:23:39.857222 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0e79ef-7394-484e-8fcc-cdcc7b0b6e50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:23:39.921688 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-3f0e79ef-7394-484e-8fcc-cdcc7b0b6e50 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:23:39.922929 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-3f0e79ef-7394-484e-8fcc-cdcc7b0b6e50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:23:39.976199 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:23:40.018917 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 754/1489] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:23:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:23:40.308489 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26c0d36-d34e-4371-98c7-c5794e59764f None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:23:40.310085 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-f26c0d36-d34e-4371-98c7-c5794e59764f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:23:40.346586 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:23:40.414790 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26c0d36-d34e-4371-98c7-c5794e59764f None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:23:40.493962 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cc7f09-a0b6-4acc-9095-616a13a32c7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41675154bbba47388040966f75d84c3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:23:40.494573 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cc7f09-a0b6-4acc-9095-616a13a32c7b service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:23:40.494854 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cc7f09-a0b6-4acc-9095-616a13a32c7b service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:23:40.495125 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cc7f09-a0b6-4acc-9095-616a13a32c7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:23:40.496727 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-00cc7f09-a0b6-4acc-9095-616a13a32c7b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:23:40.576860 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:23:40.606657 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cc7f09-a0b6-4acc-9095-616a13a32c7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:23:40.608081 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cc7f09-a0b6-4acc-9095-616a13a32c7b service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:23:40.626048 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 736/1490] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:23:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:23:42.977173 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f26442-74f7-4bf1-ac5a-2db43cdb9dd5 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:23:42.977774 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f26442-74f7-4bf1-ac5a-2db43cdb9dd5 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:23:42.977774 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f26442-74f7-4bf1-ac5a-2db43cdb9dd5 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:23:42.979184 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 755/1491] 10.222.0.27 () {54 vars in 927 bytes} [Tue Sep 13 15:23:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:23:42.984492 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae32ccb-601e-4309-a302-c8c250fd5812 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:23:42.984938 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae32ccb-601e-4309-a302-c8c250fd5812 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:23:42.985044 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae32ccb-601e-4309-a302-c8c250fd5812 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:23:43.050731 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-5ae32ccb-601e-4309-a302-c8c250fd5812 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:23:43.051956 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-5ae32ccb-601e-4309-a302-c8c250fd5812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:23:43.148249 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 737/1492] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Sep 13 15:23:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:23:43.443685 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f26442-74f7-4bf1-ac5a-2db43cdb9dd5 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:23:43.445257 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-00f26442-74f7-4bf1-ac5a-2db43cdb9dd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:23:43.547864 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f26442-74f7-4bf1-ac5a-2db43cdb9dd5 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:23:43.623528 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2877c2ba-74e5-4082-81b5-a24e51394d7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41675154bbba47388040966f75d84c3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:23:43.624128 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2877c2ba-74e5-4082-81b5-a24e51394d7b service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:23:43.624408 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2877c2ba-74e5-4082-81b5-a24e51394d7b service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:23:43.624677 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2877c2ba-74e5-4082-81b5-a24e51394d7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:23:43.626304 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-2877c2ba-74e5-4082-81b5-a24e51394d7b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:23:43.634857 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:23:43.733442 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2877c2ba-74e5-4082-81b5-a24e51394d7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:23:43.734924 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2877c2ba-74e5-4082-81b5-a24e51394d7b service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:23:43.753263 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 756/1493] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:23:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:23:53.146747 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=82 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:23:53.750971 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=50 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:25:12.901372 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1c6e07-72b7-467f-960a-7765114641b8 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:25:12.901994 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1c6e07-72b7-467f-960a-7765114641b8 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:25:12.901994 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1c6e07-72b7-467f-960a-7765114641b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:25:12.981769 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-de1c6e07-72b7-467f-960a-7765114641b8 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:25:12.982890 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-de1c6e07-72b7-467f-960a-7765114641b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:25:13.077662 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 738/1494] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:25:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:25:13.086608 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28413c0-2fb4-4159-9d39-ee913cdf8e60 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:25:13.087129 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28413c0-2fb4-4159-9d39-ee913cdf8e60 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:25:13.087236 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28413c0-2fb4-4159-9d39-ee913cdf8e60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:25:13.161449 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-e28413c0-2fb4-4159-9d39-ee913cdf8e60 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:25:13.162695 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-e28413c0-2fb4-4159-9d39-ee913cdf8e60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:25:13.259587 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 757/1495] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:25:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:25:13.264293 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1c6e07-72b7-467f-960a-7765114641b8 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:25:13.265494 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-de1c6e07-72b7-467f-960a-7765114641b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:25:13.276781 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1c6e07-72b7-467f-960a-7765114641b8 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:25:13.338641 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:25:13.373462 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255d4fca-e748-4a4f-8f44-589d5f131b1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:25:13.374097 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255d4fca-e748-4a4f-8f44-589d5f131b1b admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:25:13.374382 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255d4fca-e748-4a4f-8f44-589d5f131b1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:25:13.374657 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255d4fca-e748-4a4f-8f44-589d5f131b1b admin admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:25:13.375306 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255d4fca-e748-4a4f-8f44-589d5f131b1b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:25:13.375611 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255d4fca-e748-4a4f-8f44-589d5f131b1b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:25:13.376615 dv-cinder-857434-2-smb devstack@keystone.service[81450]: WARNING py.warnings [None req-255d4fca-e748-4a4f-8f44-589d5f131b1b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 13 15:25:13.376615 dv-cinder-857434-2-smb devstack@keystone.service[81450]: warnings.warn(msg) Sep 13 15:25:13.376615 dv-cinder-857434-2-smb devstack@keystone.service[81450]: Sep 13 15:25:13.377505 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255d4fca-e748-4a4f-8f44-589d5f131b1b admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:25:13.389227 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 739/1496] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Sep 13 15:25:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:25:13.397478 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28413c0-2fb4-4159-9d39-ee913cdf8e60 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:25:13.406499 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28413c0-2fb4-4159-9d39-ee913cdf8e60 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:25:13.467048 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:25:13.499899 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1708d0d2-2ab1-4e84-bb7b-029acfcf65af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:25:13.500499 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1708d0d2-2ab1-4e84-bb7b-029acfcf65af admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:25:13.500777 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1708d0d2-2ab1-4e84-bb7b-029acfcf65af admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:25:13.501049 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1708d0d2-2ab1-4e84-bb7b-029acfcf65af admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:25:13.501679 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1708d0d2-2ab1-4e84-bb7b-029acfcf65af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:25:13.503445 dv-cinder-857434-2-smb devstack@keystone.service[81449]: WARNING py.warnings [None req-1708d0d2-2ab1-4e84-bb7b-029acfcf65af admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 13 15:25:13.503445 dv-cinder-857434-2-smb devstack@keystone.service[81449]: warnings.warn(msg) Sep 13 15:25:13.503445 dv-cinder-857434-2-smb devstack@keystone.service[81449]: Sep 13 15:25:13.504721 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1708d0d2-2ab1-4e84-bb7b-029acfcf65af admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:25:13.560557 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 758/1497] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 13 15:25:13 2022] POST /identity/v3/projects => generated 379 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:25:13.564618 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255d4fca-e748-4a4f-8f44-589d5f131b1b admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:25:13.566170 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-255d4fca-e748-4a4f-8f44-589d5f131b1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:25:13.600924 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255d4fca-e748-4a4f-8f44-589d5f131b1b admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:25:13.694414 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61af544-372e-40f6-aa22-b2dedb119502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:25:13.695020 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61af544-372e-40f6-aa22-b2dedb119502 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:25:13.695301 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61af544-372e-40f6-aa22-b2dedb119502 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:25:13.695575 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61af544-372e-40f6-aa22-b2dedb119502 admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:25:13.696216 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61af544-372e-40f6-aa22-b2dedb119502 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:25:13.697470 dv-cinder-857434-2-smb devstack@keystone.service[81450]: WARNING py.warnings [None req-f61af544-372e-40f6-aa22-b2dedb119502 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 13 15:25:13.697470 dv-cinder-857434-2-smb devstack@keystone.service[81450]: warnings.warn(msg) Sep 13 15:25:13.697470 dv-cinder-857434-2-smb devstack@keystone.service[81450]: Sep 13 15:25:13.698718 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61af544-372e-40f6-aa22-b2dedb119502 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:25:13.744175 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 740/1498] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 13 15:25:13 2022] POST /identity/v3/users => generated 290 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:25:13.747617 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1708d0d2-2ab1-4e84-bb7b-029acfcf65af admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:25:13.749144 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-1708d0d2-2ab1-4e84-bb7b-029acfcf65af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:25:13.809926 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1708d0d2-2ab1-4e84-bb7b-029acfcf65af admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:25:13.892546 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:25:13.904779 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b810f0-261a-406e-8ea3-34c898b0b3fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:25:13.905389 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b810f0-261a-406e-8ea3-34c898b0b3fe admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:25:13.905674 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b810f0-261a-406e-8ea3-34c898b0b3fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:25:13.905983 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b810f0-261a-406e-8ea3-34c898b0b3fe admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:25:13.906625 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b810f0-261a-406e-8ea3-34c898b0b3fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:25:13.907636 dv-cinder-857434-2-smb devstack@keystone.service[81449]: WARNING py.warnings [None req-b1b810f0-261a-406e-8ea3-34c898b0b3fe admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 13 15:25:13.907636 dv-cinder-857434-2-smb devstack@keystone.service[81449]: warnings.warn(msg) Sep 13 15:25:13.907636 dv-cinder-857434-2-smb devstack@keystone.service[81449]: Sep 13 15:25:13.908541 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b810f0-261a-406e-8ea3-34c898b0b3fe admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:25:13.921037 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 759/1499] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:25:13 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 15:25:13.925051 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61af544-372e-40f6-aa22-b2dedb119502 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:25:13.926738 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-f61af544-372e-40f6-aa22-b2dedb119502 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:25:13.938161 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61af544-372e-40f6-aa22-b2dedb119502 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:25:13.964530 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:25:14.035008 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415b9009-4b13-496f-87be-37ca96c89525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:25:14.035613 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415b9009-4b13-496f-87be-37ca96c89525 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:25:14.036036 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415b9009-4b13-496f-87be-37ca96c89525 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:25:14.036399 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415b9009-4b13-496f-87be-37ca96c89525 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:25:14.037044 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415b9009-4b13-496f-87be-37ca96c89525 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:25:14.038082 dv-cinder-857434-2-smb devstack@keystone.service[81450]: WARNING py.warnings [None req-415b9009-4b13-496f-87be-37ca96c89525 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 13 15:25:14.038082 dv-cinder-857434-2-smb devstack@keystone.service[81450]: warnings.warn(msg) Sep 13 15:25:14.038082 dv-cinder-857434-2-smb devstack@keystone.service[81450]: Sep 13 15:25:14.038980 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415b9009-4b13-496f-87be-37ca96c89525 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:25:14.051031 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 741/1500] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:25:13 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 15:25:14.055815 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b810f0-261a-406e-8ea3-34c898b0b3fe admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:25:14.057337 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-b1b810f0-261a-406e-8ea3-34c898b0b3fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:25:14.091211 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b810f0-261a-406e-8ea3-34c898b0b3fe admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:25:14.182687 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2350e1c-d41e-423e-bfcf-16b8f54020b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:25:14.183277 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2350e1c-d41e-423e-bfcf-16b8f54020b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:25:14.183561 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2350e1c-d41e-423e-bfcf-16b8f54020b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:25:14.183834 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2350e1c-d41e-423e-bfcf-16b8f54020b3 admin admin] PATH_INFO: `/v3/projects/c82e9ae9baf1496294b86ccd34890948/users/a7e4caaa93f94690af7582725474fa82/roles/3fae3d3a28e147d3b2bede2378ff79ae` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:25:14.205635 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2350e1c-d41e-423e-bfcf-16b8f54020b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c82e9ae9baf1496294b86ccd34890948, user_id=a7e4caaa93f94690af7582725474fa82, role_id=3fae3d3a28e147d3b2bede2378ff79ae)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:25:14.206698 dv-cinder-857434-2-smb devstack@keystone.service[81449]: WARNING py.warnings [None req-f2350e1c-d41e-423e-bfcf-16b8f54020b3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 13 15:25:14.206698 dv-cinder-857434-2-smb devstack@keystone.service[81449]: warnings.warn(msg) Sep 13 15:25:14.206698 dv-cinder-857434-2-smb devstack@keystone.service[81449]: Sep 13 15:25:14.209296 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2350e1c-d41e-423e-bfcf-16b8f54020b3 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:25:14.235297 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 760/1501] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 13 15:25:14 2022] PUT /identity/v3/projects/c82e9ae9baf1496294b86ccd34890948/users/a7e4caaa93f94690af7582725474fa82/roles/3fae3d3a28e147d3b2bede2378ff79ae => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:25:14.247802 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f88b3a9-e8e0-4b48-b3f8-5e577d959b56 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:25:14.248104 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f88b3a9-e8e0-4b48-b3f8-5e577d959b56 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:25:14.248381 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f88b3a9-e8e0-4b48-b3f8-5e577d959b56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:25:14.306812 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-0f88b3a9-e8e0-4b48-b3f8-5e577d959b56 None None] MFA Rules not processed for user `a7e4caaa93f94690af7582725474fa82`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:25:14.308025 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-0f88b3a9-e8e0-4b48-b3f8-5e577d959b56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:25:14.390716 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 742/1502] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:25:14 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:25:14.404021 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea393bd4-e49b-49d8-a136-88d3eaee6a34 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:25:14.404314 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea393bd4-e49b-49d8-a136-88d3eaee6a34 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:25:14.404621 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea393bd4-e49b-49d8-a136-88d3eaee6a34 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:25:14.406026 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 761/1503] 10.222.0.27 () {54 vars in 964 bytes} [Tue Sep 13 15:25:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:25:14.410611 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb8b5e1-d27c-4549-9a1e-5bc6b23289eb None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:25:14.411543 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb8b5e1-d27c-4549-9a1e-5bc6b23289eb None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:25:14.411822 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb8b5e1-d27c-4549-9a1e-5bc6b23289eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:25:14.443776 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:25:14.489776 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-cfb8b5e1-d27c-4549-9a1e-5bc6b23289eb None None] MFA Rules not processed for user `97acd23097d54bf7805c3cef60626ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:25:14.491174 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-cfb8b5e1-d27c-4549-9a1e-5bc6b23289eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:25:14.565479 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 743/1504] 10.222.0.27 () {58 vars in 1061 bytes} [Tue Sep 13 15:25:14 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:25:14.574128 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea393bd4-e49b-49d8-a136-88d3eaee6a34 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:25:14.575626 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-ea393bd4-e49b-49d8-a136-88d3eaee6a34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:25:14.625171 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:25:14.681562 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea393bd4-e49b-49d8-a136-88d3eaee6a34 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:25:14.757349 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e786aac-cbf2-48c3-b13d-c96cd466f78b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97acd23097d54bf7805c3cef60626ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:25:14.757978 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e786aac-cbf2-48c3-b13d-c96cd466f78b service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:25:14.758261 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e786aac-cbf2-48c3-b13d-c96cd466f78b service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:25:14.758528 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e786aac-cbf2-48c3-b13d-c96cd466f78b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:25:14.760093 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-5e786aac-cbf2-48c3-b13d-c96cd466f78b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:25:14.856907 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e786aac-cbf2-48c3-b13d-c96cd466f78b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:25:14.858365 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e786aac-cbf2-48c3-b13d-c96cd466f78b service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:25:14.861796 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:25:14.877342 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 762/1505] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:25:14 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 15:25:14.923610 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688e82eb-0a52-453f-b455-cde14c8c1bb1 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:25:14.923903 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688e82eb-0a52-453f-b455-cde14c8c1bb1 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:25:14.924183 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688e82eb-0a52-453f-b455-cde14c8c1bb1 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:25:14.925447 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 744/1506] 10.222.0.27 () {52 vars in 830 bytes} [Tue Sep 13 15:25:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:25:14.929812 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e786aac-cbf2-48c3-b13d-c96cd466f78b service cinder] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:25:14.931033 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-5e786aac-cbf2-48c3-b13d-c96cd466f78b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:25:15.028712 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e786aac-cbf2-48c3-b13d-c96cd466f78b service cinder] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:25:15.119783 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022a6901-66ed-4452-b341-4e0ffac6f1c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:25:15.120416 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022a6901-66ed-4452-b341-4e0ffac6f1c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:25:15.120669 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022a6901-66ed-4452-b341-4e0ffac6f1c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:25:15.120939 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022a6901-66ed-4452-b341-4e0ffac6f1c9 admin admin] PATH_INFO: `/v3/users/a7e4caaa93f94690af7582725474fa82` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:25:15.134076 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022a6901-66ed-4452-b341-4e0ffac6f1c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7e4caaa93f94690af7582725474fa82)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:25:15.135100 dv-cinder-857434-2-smb devstack@keystone.service[81449]: WARNING py.warnings [None req-022a6901-66ed-4452-b341-4e0ffac6f1c9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 13 15:25:15.135100 dv-cinder-857434-2-smb devstack@keystone.service[81449]: warnings.warn(msg) Sep 13 15:25:15.135100 dv-cinder-857434-2-smb devstack@keystone.service[81449]: Sep 13 15:25:15.136305 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022a6901-66ed-4452-b341-4e0ffac6f1c9 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:25:15.146346 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:25:15.203191 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-022a6901-66ed-4452-b341-4e0ffac6f1c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7e4caaa93f94690af7582725474fa82'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:25:15.203631 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-022a6901-66ed-4452-b341-4e0ffac6f1c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7e4caaa93f94690af7582725474fa82'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:25:15.204157 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-022a6901-66ed-4452-b341-4e0ffac6f1c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7e4caaa93f94690af7582725474fa82'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:25:15.220202 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-022a6901-66ed-4452-b341-4e0ffac6f1c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7e4caaa93f94690af7582725474fa82'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:25:15.242960 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-022a6901-66ed-4452-b341-4e0ffac6f1c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7e4caaa93f94690af7582725474fa82'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:25:15.258040 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 763/1507] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 13 15:25:14 2022] DELETE /identity/v3/users/a7e4caaa93f94690af7582725474fa82 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:25:15.262421 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ff44c5-d8a7-4174-be4f-74bd5668361e None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:25:15.262728 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ff44c5-d8a7-4174-be4f-74bd5668361e None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:25:15.263004 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ff44c5-d8a7-4174-be4f-74bd5668361e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:25:15.319904 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-40ff44c5-d8a7-4174-be4f-74bd5668361e None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:25:15.321067 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-40ff44c5-d8a7-4174-be4f-74bd5668361e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:25:15.396209 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:25:15.408683 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 745/1508] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:25:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 15:25:15.419087 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022a6901-66ed-4452-b341-4e0ffac6f1c9 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:25:15.420350 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-022a6901-66ed-4452-b341-4e0ffac6f1c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:25:15.519905 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022a6901-66ed-4452-b341-4e0ffac6f1c9 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:25:15.574522 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:25:15.595013 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db26ae34-6646-4f78-a294-64f33056df32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41675154bbba47388040966f75d84c3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:25:15.595631 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db26ae34-6646-4f78-a294-64f33056df32 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:25:15.595912 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db26ae34-6646-4f78-a294-64f33056df32 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:25:15.596183 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db26ae34-6646-4f78-a294-64f33056df32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:25:15.597812 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-db26ae34-6646-4f78-a294-64f33056df32 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:25:15.705801 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db26ae34-6646-4f78-a294-64f33056df32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:25:15.707251 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db26ae34-6646-4f78-a294-64f33056df32 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:25:15.726453 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 764/1509] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:25:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:25:16.071353 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ff44c5-d8a7-4174-be4f-74bd5668361e None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:25:16.072968 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-40ff44c5-d8a7-4174-be4f-74bd5668361e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:25:16.085457 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ff44c5-d8a7-4174-be4f-74bd5668361e None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:25:16.183595 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6481d60-8149-48f1-9db1-033d97d0d6b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:25:16.184223 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6481d60-8149-48f1-9db1-033d97d0d6b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:25:16.184500 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6481d60-8149-48f1-9db1-033d97d0d6b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:25:16.184768 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6481d60-8149-48f1-9db1-033d97d0d6b2 admin admin] PATH_INFO: `/v3/projects/c82e9ae9baf1496294b86ccd34890948` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:25:16.194765 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6481d60-8149-48f1-9db1-033d97d0d6b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c82e9ae9baf1496294b86ccd34890948)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:25:16.195778 dv-cinder-857434-2-smb devstack@keystone.service[81450]: WARNING py.warnings [None req-d6481d60-8149-48f1-9db1-033d97d0d6b2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 13 15:25:16.195778 dv-cinder-857434-2-smb devstack@keystone.service[81450]: warnings.warn(msg) Sep 13 15:25:16.195778 dv-cinder-857434-2-smb devstack@keystone.service[81450]: Sep 13 15:25:16.197232 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6481d60-8149-48f1-9db1-033d97d0d6b2 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:25:16.256070 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-d6481d60-8149-48f1-9db1-033d97d0d6b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c82e9ae9baf1496294b86ccd34890948', 'request_id': 'req-d6481d60-8149-48f1-9db1-033d97d0d6b2'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:25:16.271233 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-d6481d60-8149-48f1-9db1-033d97d0d6b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c82e9ae9baf1496294b86ccd34890948', 'request_id': 'req-d6481d60-8149-48f1-9db1-033d97d0d6b2'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:25:16.277211 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-d6481d60-8149-48f1-9db1-033d97d0d6b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c82e9ae9baf1496294b86ccd34890948', 'request_id': 'req-d6481d60-8149-48f1-9db1-033d97d0d6b2'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:25:16.303460 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-d6481d60-8149-48f1-9db1-033d97d0d6b2 admin admin] The token cache is being invalidate because project c82e9ae9baf1496294b86ccd34890948 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 15:25:16.303751 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-d6481d60-8149-48f1-9db1-033d97d0d6b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:25:16.304179 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-d6481d60-8149-48f1-9db1-033d97d0d6b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:25:16.305558 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 746/1510] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 13 15:25:16 2022] DELETE /identity/v3/projects/c82e9ae9baf1496294b86ccd34890948 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:25:25.724527 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=62 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:25:26.300810 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:26:50.141593 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d42acd-e1ba-4d34-ac13-9b401e35f027 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:26:50.142215 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d42acd-e1ba-4d34-ac13-9b401e35f027 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:26:50.142215 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d42acd-e1ba-4d34-ac13-9b401e35f027 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:26:50.143525 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 765/1511] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 13 15:26:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:26:50.148815 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37bbad2-5c9f-450b-9550-988a455592fe None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:26:50.149239 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37bbad2-5c9f-450b-9550-988a455592fe None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:26:50.149438 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37bbad2-5c9f-450b-9550-988a455592fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:26:50.230147 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-f37bbad2-5c9f-450b-9550-988a455592fe None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:26:50.231358 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-f37bbad2-5c9f-450b-9550-988a455592fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:26:50.334149 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 747/1512] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 13 15:26:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:26:50.492439 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d42acd-e1ba-4d34-ac13-9b401e35f027 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:26:50.494616 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-98d42acd-e1ba-4d34-ac13-9b401e35f027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:26:50.614014 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d42acd-e1ba-4d34-ac13-9b401e35f027 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:26:50.619657 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2ef0ea-3cb9-49a0-baf8-77ad285af6b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62aad71c6c1a4469805762bba330bf0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:26:50.620246 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2ef0ea-3cb9-49a0-baf8-77ad285af6b1 service nova] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:26:50.620524 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2ef0ea-3cb9-49a0-baf8-77ad285af6b1 service nova] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:26:50.620796 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2ef0ea-3cb9-49a0-baf8-77ad285af6b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:26:50.628609 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2ef0ea-3cb9-49a0-baf8-77ad285af6b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:26:50.630232 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2ef0ea-3cb9-49a0-baf8-77ad285af6b1 service nova] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:26:50.640434 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 766/1513] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:26:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 15:26:51.741059 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c306fdb-7f20-47c9-bd84-de54403a5575 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:26:51.741585 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c306fdb-7f20-47c9-bd84-de54403a5575 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:26:51.741880 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c306fdb-7f20-47c9-bd84-de54403a5575 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:26:51.743267 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 748/1514] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 13 15:26:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:26:51.749799 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdd163d-3993-46a0-8189-1aa15dcd3563 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:26:51.750274 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdd163d-3993-46a0-8189-1aa15dcd3563 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:26:51.750393 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdd163d-3993-46a0-8189-1aa15dcd3563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:26:51.770363 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-cbdd163d-3993-46a0-8189-1aa15dcd3563 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:26:51.771577 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-cbdd163d-3993-46a0-8189-1aa15dcd3563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:26:51.779451 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 767/1515] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 13 15:26:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:26:51.932145 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c306fdb-7f20-47c9-bd84-de54403a5575 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:26:51.946964 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c306fdb-7f20-47c9-bd84-de54403a5575 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:26:51.953420 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0816f830-d08a-48c4-9522-72cd1d44f25b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62aad71c6c1a4469805762bba330bf0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:26:51.954052 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0816f830-d08a-48c4-9522-72cd1d44f25b service nova] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:26:51.954337 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0816f830-d08a-48c4-9522-72cd1d44f25b service nova] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:26:51.954619 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0816f830-d08a-48c4-9522-72cd1d44f25b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:26:51.962987 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0816f830-d08a-48c4-9522-72cd1d44f25b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:26:51.964566 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0816f830-d08a-48c4-9522-72cd1d44f25b service nova] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:26:51.973972 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 749/1516] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:26:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:26:52.070699 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b9eea7-e987-4926-ba81-c15781fb50d9 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:26:52.070993 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b9eea7-e987-4926-ba81-c15781fb50d9 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:26:52.071278 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b9eea7-e987-4926-ba81-c15781fb50d9 None None] PATH_INFO: `/v3` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:26:52.072622 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 768/1517] 10.222.0.15 () {54 vars in 925 bytes} [Tue Sep 13 15:26:52 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 15:26:52.079435 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b174c79b-2af3-4bf6-af62-6e01f246a5f9 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:26:52.079828 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b174c79b-2af3-4bf6-af62-6e01f246a5f9 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:26:52.080176 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b174c79b-2af3-4bf6-af62-6e01f246a5f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:26:52.146260 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-b174c79b-2af3-4bf6-af62-6e01f246a5f9 None None] MFA Rules not processed for user `5b56f96cb3184a3ba82c8a0c3427e268`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:26:52.147993 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-b174c79b-2af3-4bf6-af62-6e01f246a5f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:26:52.165014 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:26:52.219916 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 750/1518] 10.222.0.15 () {58 vars in 1015 bytes} [Tue Sep 13 15:26:52 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 15:26:55.777841 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c754ecde-f656-4bdf-a048-1ac012cf27a3 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:26:55.778325 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c754ecde-f656-4bdf-a048-1ac012cf27a3 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:26:55.778546 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c754ecde-f656-4bdf-a048-1ac012cf27a3 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:26:55.779979 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 769/1519] 10.222.0.27 () {54 vars in 961 bytes} [Tue Sep 13 15:26:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:26:55.785031 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5b1281-efda-4f0c-96a2-a54fa23ec38d None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:26:55.785608 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5b1281-efda-4f0c-96a2-a54fa23ec38d None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:26:55.785608 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5b1281-efda-4f0c-96a2-a54fa23ec38d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:26:55.805405 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-fb5b1281-efda-4f0c-96a2-a54fa23ec38d None None] MFA Rules not processed for user `5b56f96cb3184a3ba82c8a0c3427e268`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:26:55.806651 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-fb5b1281-efda-4f0c-96a2-a54fa23ec38d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:26:55.815541 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 751/1520] 10.222.0.27 () {58 vars in 1058 bytes} [Tue Sep 13 15:26:55 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:26:55.824030 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c754ecde-f656-4bdf-a048-1ac012cf27a3 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:26:55.839802 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c754ecde-f656-4bdf-a048-1ac012cf27a3 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:26:55.844934 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f0fe52-9eee-4452-81a4-24d1804040af service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b56f96cb3184a3ba82c8a0c3427e268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:26:55.845547 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f0fe52-9eee-4452-81a4-24d1804040af service placement] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:26:55.845951 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f0fe52-9eee-4452-81a4-24d1804040af service placement] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:26:55.846227 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f0fe52-9eee-4452-81a4-24d1804040af service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:26:55.855447 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f0fe52-9eee-4452-81a4-24d1804040af service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:26:55.857044 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f0fe52-9eee-4452-81a4-24d1804040af service placement] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:26:55.867190 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 770/1521] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:26:55 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:27:03.447187 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f4b28a-763f-4744-af35-041efbe403c4 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:27:03.447796 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f4b28a-763f-4744-af35-041efbe403c4 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:27:03.447796 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f4b28a-763f-4744-af35-041efbe403c4 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:27:03.449084 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 752/1522] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 13 15:27:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:27:03.455608 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101da56c-ed77-460a-9e92-fa3c85697b2e None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:27:03.456060 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101da56c-ed77-460a-9e92-fa3c85697b2e None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:27:03.456161 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101da56c-ed77-460a-9e92-fa3c85697b2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:27:03.477125 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-101da56c-ed77-460a-9e92-fa3c85697b2e None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:27:03.478344 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-101da56c-ed77-460a-9e92-fa3c85697b2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:27:03.486102 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 771/1523] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 13 15:27:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:27:03.643144 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f4b28a-763f-4744-af35-041efbe403c4 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:27:03.658997 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f4b28a-763f-4744-af35-041efbe403c4 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:27:03.665223 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b14b49a-552d-495e-8e06-0f2bd8d60543 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62aad71c6c1a4469805762bba330bf0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:27:03.665856 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b14b49a-552d-495e-8e06-0f2bd8d60543 service nova] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:27:03.666139 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b14b49a-552d-495e-8e06-0f2bd8d60543 service nova] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:27:03.666411 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b14b49a-552d-495e-8e06-0f2bd8d60543 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:27:03.674363 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b14b49a-552d-495e-8e06-0f2bd8d60543 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:27:03.675937 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b14b49a-552d-495e-8e06-0f2bd8d60543 service nova] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:27:03.685517 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 753/1524] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:27:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:27:04.769750 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e10d85-c694-4270-bce7-36612195688d None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:27:04.770245 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e10d85-c694-4270-bce7-36612195688d None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:27:04.770359 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e10d85-c694-4270-bce7-36612195688d None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:27:04.771704 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 772/1525] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 13 15:27:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:27:04.778170 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11c11b5-2e6a-4c4e-8893-7ef6af181927 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:27:04.778676 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11c11b5-2e6a-4c4e-8893-7ef6af181927 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:27:04.778786 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11c11b5-2e6a-4c4e-8893-7ef6af181927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:27:04.798701 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-d11c11b5-2e6a-4c4e-8893-7ef6af181927 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:27:04.799891 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-d11c11b5-2e6a-4c4e-8893-7ef6af181927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:27:04.808865 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 754/1526] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 13 15:27:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:27:04.964055 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e10d85-c694-4270-bce7-36612195688d None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:27:04.978966 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e10d85-c694-4270-bce7-36612195688d None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:27:04.984341 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b920a87-53dd-4eb8-bd3d-e17f3521e494 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62aad71c6c1a4469805762bba330bf0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:27:04.984933 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b920a87-53dd-4eb8-bd3d-e17f3521e494 service nova] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:27:04.985214 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b920a87-53dd-4eb8-bd3d-e17f3521e494 service nova] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:27:04.985486 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b920a87-53dd-4eb8-bd3d-e17f3521e494 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:27:04.993645 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b920a87-53dd-4eb8-bd3d-e17f3521e494 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:27:04.995265 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b920a87-53dd-4eb8-bd3d-e17f3521e494 service nova] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:27:05.004534 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 773/1527] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:27:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:27:09.071610 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14754a1-a4f8-4c0a-9d06-d56df33c712d None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:27:09.072177 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14754a1-a4f8-4c0a-9d06-d56df33c712d None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:27:09.072177 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14754a1-a4f8-4c0a-9d06-d56df33c712d None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:27:09.073412 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 755/1528] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 15:27:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:27:09.078961 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2520f8-0c71-4cad-8cdf-c6786a380f84 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:27:09.079389 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2520f8-0c71-4cad-8cdf-c6786a380f84 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:27:09.079502 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2520f8-0c71-4cad-8cdf-c6786a380f84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:27:09.099296 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-6e2520f8-0c71-4cad-8cdf-c6786a380f84 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:27:09.100540 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-6e2520f8-0c71-4cad-8cdf-c6786a380f84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:27:09.108430 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 774/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 15:27:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:27:09.395366 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14754a1-a4f8-4c0a-9d06-d56df33c712d None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:27:09.397667 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-b14754a1-a4f8-4c0a-9d06-d56df33c712d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:27:09.477369 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14754a1-a4f8-4c0a-9d06-d56df33c712d None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:27:09.480978 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dff52a-580c-48c8-912e-80e585a7f66d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41675154bbba47388040966f75d84c3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:27:09.481584 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dff52a-580c-48c8-912e-80e585a7f66d service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:27:09.481895 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dff52a-580c-48c8-912e-80e585a7f66d service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:27:09.482173 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dff52a-580c-48c8-912e-80e585a7f66d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:27:09.491103 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dff52a-580c-48c8-912e-80e585a7f66d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:27:09.492521 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dff52a-580c-48c8-912e-80e585a7f66d service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:27:09.501925 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 756/1530] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:27:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:27:11.658179 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7181384e-2d27-4489-a298-74696c8a90b8 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:27:11.658748 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7181384e-2d27-4489-a298-74696c8a90b8 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:27:11.658748 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7181384e-2d27-4489-a298-74696c8a90b8 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:27:11.660091 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 775/1531] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 15:27:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:27:11.666196 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caef576-e492-4adf-816a-90a9a883ffc3 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:27:11.666595 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caef576-e492-4adf-816a-90a9a883ffc3 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:27:11.666751 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caef576-e492-4adf-816a-90a9a883ffc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:27:11.686427 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-9caef576-e492-4adf-816a-90a9a883ffc3 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:27:11.687623 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-9caef576-e492-4adf-816a-90a9a883ffc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:27:11.695626 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 757/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 15:27:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:27:11.984224 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7181384e-2d27-4489-a298-74696c8a90b8 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:27:11.985982 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-7181384e-2d27-4489-a298-74696c8a90b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:27:11.998930 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7181384e-2d27-4489-a298-74696c8a90b8 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:27:12.002502 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dd4e68-3650-4add-ac05-e83e80b61257 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41675154bbba47388040966f75d84c3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:27:12.003100 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dd4e68-3650-4add-ac05-e83e80b61257 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:27:12.003381 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dd4e68-3650-4add-ac05-e83e80b61257 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:27:12.003654 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dd4e68-3650-4add-ac05-e83e80b61257 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:27:12.013182 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dd4e68-3650-4add-ac05-e83e80b61257 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:27:12.014650 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dd4e68-3650-4add-ac05-e83e80b61257 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:27:12.024489 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 776/1533] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:27:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:27:15.627790 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3240f9b3-7e86-45a6-a0af-9a9b75bf74bc None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:27:15.628360 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3240f9b3-7e86-45a6-a0af-9a9b75bf74bc None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:27:15.628360 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3240f9b3-7e86-45a6-a0af-9a9b75bf74bc None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:27:15.629583 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 758/1534] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 15:27:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:27:15.634890 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4515c618-019f-4139-94d2-6b124e0bfa84 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:27:15.635339 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4515c618-019f-4139-94d2-6b124e0bfa84 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:27:15.635450 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4515c618-019f-4139-94d2-6b124e0bfa84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:27:15.655035 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-4515c618-019f-4139-94d2-6b124e0bfa84 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:27:15.656266 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-4515c618-019f-4139-94d2-6b124e0bfa84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:27:15.664772 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 777/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 15:27:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:27:15.972578 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3240f9b3-7e86-45a6-a0af-9a9b75bf74bc None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:27:15.974295 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-3240f9b3-7e86-45a6-a0af-9a9b75bf74bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:27:16.038744 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:27:16.052222 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3240f9b3-7e86-45a6-a0af-9a9b75bf74bc None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:27:16.055916 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3951c525-61fd-4096-8d8b-ce4f2af900dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97acd23097d54bf7805c3cef60626ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:27:16.056522 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3951c525-61fd-4096-8d8b-ce4f2af900dc service cinder] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:27:16.056803 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3951c525-61fd-4096-8d8b-ce4f2af900dc service cinder] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:27:16.057079 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3951c525-61fd-4096-8d8b-ce4f2af900dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:27:16.065944 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3951c525-61fd-4096-8d8b-ce4f2af900dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:27:16.067360 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3951c525-61fd-4096-8d8b-ce4f2af900dc service cinder] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:27:16.077479 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 759/1536] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:27:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:27:18.254849 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ae91e7-ee98-458a-8cf6-451a231ea20c None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:27:18.255418 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ae91e7-ee98-458a-8cf6-451a231ea20c None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:27:18.255418 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ae91e7-ee98-458a-8cf6-451a231ea20c None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:27:18.257366 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 778/1537] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 15:27:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:27:18.262797 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c29e31-fba2-47c3-bc1f-d4536e7028f8 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:27:18.263228 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c29e31-fba2-47c3-bc1f-d4536e7028f8 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:27:18.263382 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c29e31-fba2-47c3-bc1f-d4536e7028f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:27:18.283553 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-e9c29e31-fba2-47c3-bc1f-d4536e7028f8 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:27:18.284750 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-e9c29e31-fba2-47c3-bc1f-d4536e7028f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:27:18.292635 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 760/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 15:27:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:27:18.596636 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ae91e7-ee98-458a-8cf6-451a231ea20c None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:27:18.598393 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-01ae91e7-ee98-458a-8cf6-451a231ea20c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:27:18.606073 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=84 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:27:18.612437 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ae91e7-ee98-458a-8cf6-451a231ea20c None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:27:18.616517 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984c9191-26f2-4dc0-9a69-7960f6ccc42f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97acd23097d54bf7805c3cef60626ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:27:18.617114 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984c9191-26f2-4dc0-9a69-7960f6ccc42f service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:27:18.617397 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984c9191-26f2-4dc0-9a69-7960f6ccc42f service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:27:18.617679 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984c9191-26f2-4dc0-9a69-7960f6ccc42f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:27:18.626508 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984c9191-26f2-4dc0-9a69-7960f6ccc42f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:27:18.627939 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984c9191-26f2-4dc0-9a69-7960f6ccc42f service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:27:18.638002 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 779/1539] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:27:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:27:28.278548 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=11 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:27:28.633912 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=5 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:28:46.180593 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1849807-d91e-49a0-970b-32e030d25dff None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:28:46.181719 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1849807-d91e-49a0-970b-32e030d25dff None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:28:46.182229 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1849807-d91e-49a0-970b-32e030d25dff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:28:46.206255 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-a1849807-d91e-49a0-970b-32e030d25dff None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:28:46.207480 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-a1849807-d91e-49a0-970b-32e030d25dff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:28:46.220536 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 761/1540] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:28:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:28:46.229932 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3903047e-2491-4239-8295-f541a2652c6c None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:28:46.230522 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3903047e-2491-4239-8295-f541a2652c6c None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:28:46.230522 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3903047e-2491-4239-8295-f541a2652c6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:28:46.263740 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-3903047e-2491-4239-8295-f541a2652c6c None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:28:46.264894 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-3903047e-2491-4239-8295-f541a2652c6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:28:46.277150 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 780/1541] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:28:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:28:46.281793 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1849807-d91e-49a0-970b-32e030d25dff None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:28:46.299210 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1849807-d91e-49a0-970b-32e030d25dff None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:28:46.308201 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ec3420-1423-4b6e-b660-4c7fc6aa53f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:28:46.308825 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ec3420-1423-4b6e-b660-4c7fc6aa53f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:28:46.309104 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ec3420-1423-4b6e-b660-4c7fc6aa53f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:28:46.309377 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ec3420-1423-4b6e-b660-4c7fc6aa53f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:28:46.310067 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ec3420-1423-4b6e-b660-4c7fc6aa53f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:28:46.310371 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ec3420-1423-4b6e-b660-4c7fc6aa53f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:28:46.312041 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ec3420-1423-4b6e-b660-4c7fc6aa53f9 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:28:46.323307 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5603cdc3-85e9-42d3-92b9-b995091e2d41 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:28:46.323667 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5603cdc3-85e9-42d3-92b9-b995091e2d41 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:28:46.323870 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5603cdc3-85e9-42d3-92b9-b995091e2d41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:28:46.334862 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 762/1542] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Sep 13 15:28:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:28:46.344696 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ec3420-1423-4b6e-b660-4c7fc6aa53f9 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:28:46.353089 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-5603cdc3-85e9-42d3-92b9-b995091e2d41 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:28:46.354392 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-5603cdc3-85e9-42d3-92b9-b995091e2d41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:28:46.356426 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ec3420-1423-4b6e-b660-4c7fc6aa53f9 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:28:46.369449 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 781/1543] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:28:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 15:28:46.375869 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f499d4f-7156-4e7e-aa59-49800f963fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:28:46.376513 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f499d4f-7156-4e7e-aa59-49800f963fac admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:28:46.376795 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f499d4f-7156-4e7e-aa59-49800f963fac admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:28:46.377067 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f499d4f-7156-4e7e-aa59-49800f963fac admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:28:46.377746 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f499d4f-7156-4e7e-aa59-49800f963fac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:28:46.378794 dv-cinder-857434-2-smb devstack@keystone.service[81450]: WARNING py.warnings [None req-8f499d4f-7156-4e7e-aa59-49800f963fac admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 13 15:28:46.378794 dv-cinder-857434-2-smb devstack@keystone.service[81450]: warnings.warn(msg) Sep 13 15:28:46.378794 dv-cinder-857434-2-smb devstack@keystone.service[81450]: Sep 13 15:28:46.380729 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f499d4f-7156-4e7e-aa59-49800f963fac admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:28:46.382151 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de441a9-b6f0-4042-8be3-aaaf4281af7b None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:28:46.382448 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de441a9-b6f0-4042-8be3-aaaf4281af7b None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:28:46.382737 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de441a9-b6f0-4042-8be3-aaaf4281af7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:28:46.414401 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-7de441a9-b6f0-4042-8be3-aaaf4281af7b None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:28:46.415720 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-7de441a9-b6f0-4042-8be3-aaaf4281af7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:28:46.428658 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 782/1544] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:28:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 15:28:46.433504 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de441a9-b6f0-4042-8be3-aaaf4281af7b None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:28:46.448909 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de441a9-b6f0-4042-8be3-aaaf4281af7b None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:28:46.457902 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925994de-83e0-40cc-8bc8-33f36c50bc83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:28:46.459499 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925994de-83e0-40cc-8bc8-33f36c50bc83 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:28:46.459974 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925994de-83e0-40cc-8bc8-33f36c50bc83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:28:46.460441 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925994de-83e0-40cc-8bc8-33f36c50bc83 admin admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:28:46.461261 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925994de-83e0-40cc-8bc8-33f36c50bc83 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:28:46.461761 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925994de-83e0-40cc-8bc8-33f36c50bc83 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:28:46.462995 dv-cinder-857434-2-smb devstack@keystone.service[81449]: WARNING py.warnings [None req-925994de-83e0-40cc-8bc8-33f36c50bc83 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 13 15:28:46.462995 dv-cinder-857434-2-smb devstack@keystone.service[81449]: warnings.warn(msg) Sep 13 15:28:46.462995 dv-cinder-857434-2-smb devstack@keystone.service[81449]: Sep 13 15:28:46.464273 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925994de-83e0-40cc-8bc8-33f36c50bc83 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:28:46.474205 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 763/1545] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 13 15:28:46 2022] POST /identity/v3/projects => generated 373 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 15:28:46.478173 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f499d4f-7156-4e7e-aa59-49800f963fac admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:28:46.482361 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 783/1546] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Sep 13 15:28:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 15:28:46.491082 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925994de-83e0-40cc-8bc8-33f36c50bc83 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:28:46.508334 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925994de-83e0-40cc-8bc8-33f36c50bc83 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:28:46.586870 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f499d4f-7156-4e7e-aa59-49800f963fac admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:28:46.595368 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3eda5bf-f024-4eea-a4ea-a8540bda4389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:28:46.596324 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eda5bf-f024-4eea-a4ea-a8540bda4389 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:28:46.596832 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eda5bf-f024-4eea-a4ea-a8540bda4389 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:28:46.597334 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eda5bf-f024-4eea-a4ea-a8540bda4389 admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:28:46.598535 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3eda5bf-f024-4eea-a4ea-a8540bda4389 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:28:46.601925 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3eda5bf-f024-4eea-a4ea-a8540bda4389 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:28:46.615463 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e2831d-2e4c-48f4-9426-27dbdafeff9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:28:46.616106 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e2831d-2e4c-48f4-9426-27dbdafeff9e admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:28:46.616393 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e2831d-2e4c-48f4-9426-27dbdafeff9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:28:46.616672 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e2831d-2e4c-48f4-9426-27dbdafeff9e admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:28:46.617434 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e2831d-2e4c-48f4-9426-27dbdafeff9e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:28:46.619335 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e2831d-2e4c-48f4-9426-27dbdafeff9e admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:28:46.649714 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 764/1547] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 13 15:28:46 2022] POST /identity/v3/users => generated 287 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 15:28:46.658090 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3eda5bf-f024-4eea-a4ea-a8540bda4389 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:28:46.667517 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 784/1548] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 13 15:28:46 2022] POST /identity/v3/projects => generated 375 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 15:28:46.668825 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2430c0-e4c9-4d9d-9a20-ce0788dd9724 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:28:46.669109 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2430c0-e4c9-4d9d-9a20-ce0788dd9724 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:28:46.669390 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2430c0-e4c9-4d9d-9a20-ce0788dd9724 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:28:46.676181 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3eda5bf-f024-4eea-a4ea-a8540bda4389 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:28:46.725779 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-7e2430c0-e4c9-4d9d-9a20-ce0788dd9724 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:28:46.725779 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-7e2430c0-e4c9-4d9d-9a20-ce0788dd9724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:28:46.796951 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2839bb8a-21d1-47db-ad1c-7bf292dfa8ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:28:46.797595 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2839bb8a-21d1-47db-ad1c-7bf292dfa8ee admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:28:46.797916 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2839bb8a-21d1-47db-ad1c-7bf292dfa8ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:28:46.798196 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2839bb8a-21d1-47db-ad1c-7bf292dfa8ee admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:28:46.798854 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2839bb8a-21d1-47db-ad1c-7bf292dfa8ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:28:46.800661 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2839bb8a-21d1-47db-ad1c-7bf292dfa8ee admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:28:46.822757 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 765/1549] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:28:46 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 15:28:46.823725 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2839bb8a-21d1-47db-ad1c-7bf292dfa8ee admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:28:46.832517 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 785/1550] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:28:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:28:46.833736 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc376aa-8d52-47de-89ba-77e969eee6de None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:28:46.834643 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc376aa-8d52-47de-89ba-77e969eee6de None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:28:46.834643 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc376aa-8d52-47de-89ba-77e969eee6de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:28:46.839628 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2839bb8a-21d1-47db-ad1c-7bf292dfa8ee admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:28:46.844337 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3799befc-2981-40f1-9605-3a8c88d054c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:28:46.844949 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3799befc-2981-40f1-9605-3a8c88d054c5 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:28:46.845231 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3799befc-2981-40f1-9605-3a8c88d054c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:28:46.845506 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3799befc-2981-40f1-9605-3a8c88d054c5 admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:28:46.846163 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3799befc-2981-40f1-9605-3a8c88d054c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:28:46.848069 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3799befc-2981-40f1-9605-3a8c88d054c5 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:28:46.857747 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-9cc376aa-8d52-47de-89ba-77e969eee6de None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:28:46.859051 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-9cc376aa-8d52-47de-89ba-77e969eee6de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:28:46.869426 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 786/1551] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:28:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:28:46.870684 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0591ba89-67a7-477d-ad16-eecc6b0f3b9d None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:28:46.870973 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0591ba89-67a7-477d-ad16-eecc6b0f3b9d None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:28:46.871250 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0591ba89-67a7-477d-ad16-eecc6b0f3b9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:28:46.878120 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 766/1552] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 13 15:28:46 2022] POST /identity/v3/users => generated 288 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:28:46.878120 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245a735c-c25c-499d-8a49-56ca903c5d88 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:28:46.878120 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245a735c-c25c-499d-8a49-56ca903c5d88 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:28:46.878120 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245a735c-c25c-499d-8a49-56ca903c5d88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:28:46.894097 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-0591ba89-67a7-477d-ad16-eecc6b0f3b9d None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:28:46.895302 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-0591ba89-67a7-477d-ad16-eecc6b0f3b9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:28:46.897763 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-245a735c-c25c-499d-8a49-56ca903c5d88 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:28:46.898914 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-245a735c-c25c-499d-8a49-56ca903c5d88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:28:46.904317 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 787/1553] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:28:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:28:46.905013 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0591ba89-67a7-477d-ad16-eecc6b0f3b9d None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:28:46.914373 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 767/1554] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:28:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:28:46.914577 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0591ba89-67a7-477d-ad16-eecc6b0f3b9d None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:28:46.915590 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fa27d7-4d6f-4a4c-987f-6fc476042873 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:28:46.915875 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fa27d7-4d6f-4a4c-987f-6fc476042873 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:28:46.916148 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fa27d7-4d6f-4a4c-987f-6fc476042873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:28:46.919353 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a17341-6129-4717-8b44-b8803919d8d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:28:46.919961 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a17341-6129-4717-8b44-b8803919d8d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:28:46.920243 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a17341-6129-4717-8b44-b8803919d8d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:28:46.920518 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a17341-6129-4717-8b44-b8803919d8d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:28:46.921156 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a17341-6129-4717-8b44-b8803919d8d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:28:46.923007 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a17341-6129-4717-8b44-b8803919d8d5 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:28:46.934100 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 788/1555] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:28:46 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 15:28:46.935398 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7098d8c5-4d94-470a-b891-3fd619239ef0 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:28:46.935683 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7098d8c5-4d94-470a-b891-3fd619239ef0 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:28:46.936007 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7098d8c5-4d94-470a-b891-3fd619239ef0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:28:46.940532 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-12fa27d7-4d6f-4a4c-987f-6fc476042873 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:28:46.941790 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-12fa27d7-4d6f-4a4c-987f-6fc476042873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:28:46.950314 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 768/1556] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:28:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:28:46.951522 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d116a366-8354-4dfc-abde-7ee84344d7a5 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:28:46.952130 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d116a366-8354-4dfc-abde-7ee84344d7a5 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:28:46.952414 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d116a366-8354-4dfc-abde-7ee84344d7a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:28:46.956527 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-7098d8c5-4d94-470a-b891-3fd619239ef0 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:28:46.957926 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-7098d8c5-4d94-470a-b891-3fd619239ef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:28:46.962700 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:28:46.973560 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 789/1557] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:28:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:28:46.973560 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c031a94-94fb-47ab-a19e-f53cd72dfd0a None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:28:46.973560 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c031a94-94fb-47ab-a19e-f53cd72dfd0a None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:28:46.973560 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c031a94-94fb-47ab-a19e-f53cd72dfd0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:28:46.976035 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-d116a366-8354-4dfc-abde-7ee84344d7a5 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:28:46.977256 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-d116a366-8354-4dfc-abde-7ee84344d7a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:28:46.985456 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 769/1558] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:28:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:28:46.986279 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d116a366-8354-4dfc-abde-7ee84344d7a5 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:28:46.991214 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-6c031a94-94fb-47ab-a19e-f53cd72dfd0a None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:28:46.992398 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-6c031a94-94fb-47ab-a19e-f53cd72dfd0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:28:46.998365 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d116a366-8354-4dfc-abde-7ee84344d7a5 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:28:47.000287 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 790/1559] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:28:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:28:47.001522 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32962a1f-486a-4ada-9f9d-03485b767e58 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:28:47.001853 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32962a1f-486a-4ada-9f9d-03485b767e58 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:28:47.002162 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32962a1f-486a-4ada-9f9d-03485b767e58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:28:47.003407 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19d9e70-83f5-46b4-9f7e-7b7216e15a57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:28:47.004081 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19d9e70-83f5-46b4-9f7e-7b7216e15a57 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:28:47.004373 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19d9e70-83f5-46b4-9f7e-7b7216e15a57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:28:47.004653 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19d9e70-83f5-46b4-9f7e-7b7216e15a57 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:28:47.005387 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19d9e70-83f5-46b4-9f7e-7b7216e15a57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:28:47.007091 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19d9e70-83f5-46b4-9f7e-7b7216e15a57 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:28:47.020507 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 770/1560] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:28:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 15:28:47.020507 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ddb924-42d8-4dbb-89e3-b99d57685eb4 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:28:47.020507 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ddb924-42d8-4dbb-89e3-b99d57685eb4 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:28:47.020507 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ddb924-42d8-4dbb-89e3-b99d57685eb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:28:47.022708 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-32962a1f-486a-4ada-9f9d-03485b767e58 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:28:47.023919 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-32962a1f-486a-4ada-9f9d-03485b767e58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:28:47.031971 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 791/1561] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:28:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:28:47.032572 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32962a1f-486a-4ada-9f9d-03485b767e58 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:28:47.039457 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-77ddb924-42d8-4dbb-89e3-b99d57685eb4 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:28:47.040658 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-77ddb924-42d8-4dbb-89e3-b99d57685eb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:28:47.042337 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32962a1f-486a-4ada-9f9d-03485b767e58 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:28:47.046920 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e7a153-aad0-48bb-9929-945cc96c3f55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:28:47.047564 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e7a153-aad0-48bb-9929-945cc96c3f55 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:28:47.047849 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e7a153-aad0-48bb-9929-945cc96c3f55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:28:47.048125 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e7a153-aad0-48bb-9929-945cc96c3f55 admin admin] PATH_INFO: `/v3/projects/7893015d35fb45cebba6e5e74d29b406/users/cbc5387f448d417c859ca72a6150d745/roles/3fae3d3a28e147d3b2bede2378ff79ae` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:28:47.052357 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 771/1562] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:28:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:28:47.052357 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29017ad5-9b31-4115-9e81-b8fda324e2b5 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:28:47.052357 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29017ad5-9b31-4115-9e81-b8fda324e2b5 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:28:47.052357 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29017ad5-9b31-4115-9e81-b8fda324e2b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:28:47.056205 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:28:47.068106 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e7a153-aad0-48bb-9929-945cc96c3f55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7893015d35fb45cebba6e5e74d29b406, user_id=cbc5387f448d417c859ca72a6150d745, role_id=3fae3d3a28e147d3b2bede2378ff79ae)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:28:47.070931 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e7a153-aad0-48bb-9929-945cc96c3f55 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:28:47.072603 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-29017ad5-9b31-4115-9e81-b8fda324e2b5 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:28:47.073847 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-29017ad5-9b31-4115-9e81-b8fda324e2b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:28:47.082949 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 772/1563] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:28:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:28:47.084676 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7f00c8-3e67-4f30-91fa-429048c3acaf None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:28:47.084966 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7f00c8-3e67-4f30-91fa-429048c3acaf None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:28:47.085245 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7f00c8-3e67-4f30-91fa-429048c3acaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:28:47.096893 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 792/1564] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 13 15:28:47 2022] PUT /identity/v3/projects/7893015d35fb45cebba6e5e74d29b406/users/cbc5387f448d417c859ca72a6150d745/roles/3fae3d3a28e147d3b2bede2378ff79ae => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:28:47.096893 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e7a153-aad0-48bb-9929-945cc96c3f55 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:28:47.105145 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-ca7f00c8-3e67-4f30-91fa-429048c3acaf None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:28:47.106482 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-ca7f00c8-3e67-4f30-91fa-429048c3acaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:28:47.151582 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e7a153-aad0-48bb-9929-945cc96c3f55 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:28:47.156253 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc7a249-074c-4453-84c0-d2e0a94e6aa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:28:47.156867 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc7a249-074c-4453-84c0-d2e0a94e6aa5 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:28:47.157156 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc7a249-074c-4453-84c0-d2e0a94e6aa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:28:47.157434 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc7a249-074c-4453-84c0-d2e0a94e6aa5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:28:47.158113 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc7a249-074c-4453-84c0-d2e0a94e6aa5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:28:47.158421 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc7a249-074c-4453-84c0-d2e0a94e6aa5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:28:47.160037 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc7a249-074c-4453-84c0-d2e0a94e6aa5 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:28:47.166777 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 773/1565] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:28:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:28:47.167874 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7f00c8-3e67-4f30-91fa-429048c3acaf None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:28:47.174834 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 793/1566] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Sep 13 15:28:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:28:47.175675 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc7a249-074c-4453-84c0-d2e0a94e6aa5 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:28:47.183786 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7f00c8-3e67-4f30-91fa-429048c3acaf None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:28:47.186471 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc7a249-074c-4453-84c0-d2e0a94e6aa5 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:28:47.188621 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35db68f0-8820-4a37-9987-90d6eab6df2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:28:47.189239 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35db68f0-8820-4a37-9987-90d6eab6df2f admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:28:47.189524 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35db68f0-8820-4a37-9987-90d6eab6df2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:28:47.189858 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35db68f0-8820-4a37-9987-90d6eab6df2f admin admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:28:47.190511 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35db68f0-8820-4a37-9987-90d6eab6df2f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:28:47.190819 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35db68f0-8820-4a37-9987-90d6eab6df2f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:28:47.191172 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834c3445-68fa-4c38-9688-cf71f504fb0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:28:47.191772 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834c3445-68fa-4c38-9688-cf71f504fb0e admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:28:47.192057 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834c3445-68fa-4c38-9688-cf71f504fb0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:28:47.192332 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834c3445-68fa-4c38-9688-cf71f504fb0e admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:28:47.192499 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35db68f0-8820-4a37-9987-90d6eab6df2f admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:28:47.193571 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834c3445-68fa-4c38-9688-cf71f504fb0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:28:47.195193 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834c3445-68fa-4c38-9688-cf71f504fb0e admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:28:47.205215 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 774/1567] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Sep 13 15:28:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:28:47.205916 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 794/1568] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:28:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 15:28:47.206605 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834c3445-68fa-4c38-9688-cf71f504fb0e admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:28:47.208977 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35db68f0-8820-4a37-9987-90d6eab6df2f admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:28:47.216671 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834c3445-68fa-4c38-9688-cf71f504fb0e admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:28:47.218699 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35db68f0-8820-4a37-9987-90d6eab6df2f admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:28:47.221372 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7c73d8-d9ce-4583-9e40-b6864137566e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:28:47.222004 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7c73d8-d9ce-4583-9e40-b6864137566e admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:28:47.222291 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7c73d8-d9ce-4583-9e40-b6864137566e admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:28:47.222569 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7c73d8-d9ce-4583-9e40-b6864137566e admin admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:28:47.223268 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e539fa-7f86-4d3a-9ba9-edb976cf3dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:28:47.223412 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7c73d8-d9ce-4583-9e40-b6864137566e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:28:47.223620 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7c73d8-d9ce-4583-9e40-b6864137566e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:28:47.224377 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e539fa-7f86-4d3a-9ba9-edb976cf3dce admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:28:47.224663 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e539fa-7f86-4d3a-9ba9-edb976cf3dce admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:28:47.224940 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e539fa-7f86-4d3a-9ba9-edb976cf3dce admin admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:28:47.225579 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e539fa-7f86-4d3a-9ba9-edb976cf3dce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:28:47.225919 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e539fa-7f86-4d3a-9ba9-edb976cf3dce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:28:47.226038 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7c73d8-d9ce-4583-9e40-b6864137566e admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:28:47.227490 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e539fa-7f86-4d3a-9ba9-edb976cf3dce admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:28:47.238124 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 795/1569] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Sep 13 15:28:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:28:47.238954 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7c73d8-d9ce-4583-9e40-b6864137566e admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:28:47.243242 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 775/1570] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Sep 13 15:28:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:28:47.244469 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c637539c-5b77-4248-a5b3-623bf4ea96c2 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:28:47.244904 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c637539c-5b77-4248-a5b3-623bf4ea96c2 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:28:47.245184 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c637539c-5b77-4248-a5b3-623bf4ea96c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:28:47.257832 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7c73d8-d9ce-4583-9e40-b6864137566e admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:28:47.262916 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d52194-5eda-41a6-97fb-4659a7af61a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:28:47.263524 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d52194-5eda-41a6-97fb-4659a7af61a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:28:47.263809 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d52194-5eda-41a6-97fb-4659a7af61a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:28:47.264088 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d52194-5eda-41a6-97fb-4659a7af61a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:28:47.264731 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d52194-5eda-41a6-97fb-4659a7af61a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:28:47.265038 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d52194-5eda-41a6-97fb-4659a7af61a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:28:47.266705 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d52194-5eda-41a6-97fb-4659a7af61a9 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:28:47.274264 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-c637539c-5b77-4248-a5b3-623bf4ea96c2 None None] MFA Rules not processed for user `cbc5387f448d417c859ca72a6150d745`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:28:47.275480 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-c637539c-5b77-4248-a5b3-623bf4ea96c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:28:47.278825 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 796/1571] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Sep 13 15:28:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:28:47.279636 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d52194-5eda-41a6-97fb-4659a7af61a9 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:28:47.289984 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d52194-5eda-41a6-97fb-4659a7af61a9 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:28:47.294644 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b10176-6d36-4a11-bfd7-5e3be05048d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:28:47.295241 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b10176-6d36-4a11-bfd7-5e3be05048d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:28:47.295528 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b10176-6d36-4a11-bfd7-5e3be05048d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:28:47.295807 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b10176-6d36-4a11-bfd7-5e3be05048d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:28:47.296447 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b10176-6d36-4a11-bfd7-5e3be05048d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:28:47.296757 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b10176-6d36-4a11-bfd7-5e3be05048d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:28:47.298383 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b10176-6d36-4a11-bfd7-5e3be05048d7 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:28:47.310225 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 797/1572] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Sep 13 15:28:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:28:47.311000 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b10176-6d36-4a11-bfd7-5e3be05048d7 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:28:47.321260 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b10176-6d36-4a11-bfd7-5e3be05048d7 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:28:47.326145 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482ebd3b-11f3-4f0f-a4d0-8b558102b315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:28:47.326996 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482ebd3b-11f3-4f0f-a4d0-8b558102b315 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:28:47.327281 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482ebd3b-11f3-4f0f-a4d0-8b558102b315 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:28:47.327557 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482ebd3b-11f3-4f0f-a4d0-8b558102b315 admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:28:47.328184 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482ebd3b-11f3-4f0f-a4d0-8b558102b315 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:28:47.330124 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482ebd3b-11f3-4f0f-a4d0-8b558102b315 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:28:47.348481 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 776/1573] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:28:47 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:28:47.349992 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c637539c-5b77-4248-a5b3-623bf4ea96c2 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:28:47.361352 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 798/1574] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 13 15:28:47 2022] POST /identity/v3/projects => generated 379 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:28:47.361352 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482ebd3b-11f3-4f0f-a4d0-8b558102b315 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:28:47.361641 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c637539c-5b77-4248-a5b3-623bf4ea96c2 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:28:47.394353 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:28:47.419655 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe86c49-39ee-444e-8f9c-67dec18f1b37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:28:47.420320 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe86c49-39ee-444e-8f9c-67dec18f1b37 admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:28:47.420601 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe86c49-39ee-444e-8f9c-67dec18f1b37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:28:47.420886 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe86c49-39ee-444e-8f9c-67dec18f1b37 admin admin] PATH_INFO: `/v3/projects/ff7c18fa3fc74931908e5736f7e4e0aa/users/7d103d2fe211474ab70df0aac0632c30/roles/3fae3d3a28e147d3b2bede2378ff79ae` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:28:47.423054 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482ebd3b-11f3-4f0f-a4d0-8b558102b315 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:28:47.428836 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7978148b-52f6-4a1d-b6d3-a25784090c95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:28:47.429445 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7978148b-52f6-4a1d-b6d3-a25784090c95 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:28:47.429836 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7978148b-52f6-4a1d-b6d3-a25784090c95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:28:47.430029 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7978148b-52f6-4a1d-b6d3-a25784090c95 admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:28:47.430661 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7978148b-52f6-4a1d-b6d3-a25784090c95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:28:47.432588 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7978148b-52f6-4a1d-b6d3-a25784090c95 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:28:47.435710 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe86c49-39ee-444e-8f9c-67dec18f1b37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff7c18fa3fc74931908e5736f7e4e0aa, user_id=7d103d2fe211474ab70df0aac0632c30, role_id=3fae3d3a28e147d3b2bede2378ff79ae)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:28:47.436747 dv-cinder-857434-2-smb devstack@keystone.service[81450]: WARNING py.warnings [None req-ebe86c49-39ee-444e-8f9c-67dec18f1b37 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 13 15:28:47.436747 dv-cinder-857434-2-smb devstack@keystone.service[81450]: warnings.warn(msg) Sep 13 15:28:47.436747 dv-cinder-857434-2-smb devstack@keystone.service[81450]: Sep 13 15:28:47.438857 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe86c49-39ee-444e-8f9c-67dec18f1b37 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:28:47.444607 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:28:47.454406 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 777/1575] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 13 15:28:47 2022] PUT /identity/v3/projects/ff7c18fa3fc74931908e5736f7e4e0aa/users/7d103d2fe211474ab70df0aac0632c30/roles/3fae3d3a28e147d3b2bede2378ff79ae => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:28:47.455229 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe86c49-39ee-444e-8f9c-67dec18f1b37 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:28:47.463688 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 799/1576] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 13 15:28:47 2022] POST /identity/v3/projects => generated 383 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:28:47.465098 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7978148b-52f6-4a1d-b6d3-a25784090c95 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:28:47.522833 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe86c49-39ee-444e-8f9c-67dec18f1b37 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:28:47.527691 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f091ec76-6c15-42c2-a5e9-6325842aafb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:28:47.528034 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7978148b-52f6-4a1d-b6d3-a25784090c95 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:28:47.528310 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f091ec76-6c15-42c2-a5e9-6325842aafb6 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:28:47.528658 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f091ec76-6c15-42c2-a5e9-6325842aafb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:28:47.528938 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f091ec76-6c15-42c2-a5e9-6325842aafb6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:28:47.529580 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f091ec76-6c15-42c2-a5e9-6325842aafb6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:28:47.531524 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f091ec76-6c15-42c2-a5e9-6325842aafb6 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:28:47.532862 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bd2e43-0325-48f1-83e4-ae2ee9ca1b40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:28:47.533469 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bd2e43-0325-48f1-83e4-ae2ee9ca1b40 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:28:47.533787 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bd2e43-0325-48f1-83e4-ae2ee9ca1b40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:28:47.534069 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bd2e43-0325-48f1-83e4-ae2ee9ca1b40 admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:28:47.534804 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bd2e43-0325-48f1-83e4-ae2ee9ca1b40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:28:47.537556 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bd2e43-0325-48f1-83e4-ae2ee9ca1b40 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:28:47.563501 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 778/1577] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 13 15:28:47 2022] POST /identity/v3/projects => generated 391 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:28:47.563501 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f091ec76-6c15-42c2-a5e9-6325842aafb6 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:28:47.570677 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 800/1578] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 13 15:28:47 2022] POST /identity/v3/projects => generated 373 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:28:47.570677 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bd2e43-0325-48f1-83e4-ae2ee9ca1b40 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:28:47.629009 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f091ec76-6c15-42c2-a5e9-6325842aafb6 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:28:47.629588 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bd2e43-0325-48f1-83e4-ae2ee9ca1b40 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:28:47.634168 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21600b76-1f2c-44c5-a499-453f91ff9e88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:28:47.634409 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98be824-f4bb-4ca2-8437-da1b4a721dc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:28:47.634788 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21600b76-1f2c-44c5-a499-453f91ff9e88 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:28:47.634950 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98be824-f4bb-4ca2-8437-da1b4a721dc2 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:28:47.635094 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21600b76-1f2c-44c5-a499-453f91ff9e88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:28:47.635259 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98be824-f4bb-4ca2-8437-da1b4a721dc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:28:47.635416 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21600b76-1f2c-44c5-a499-453f91ff9e88 admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:28:47.635577 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98be824-f4bb-4ca2-8437-da1b4a721dc2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:28:47.636032 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98be824-f4bb-4ca2-8437-da1b4a721dc2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:28:47.636181 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21600b76-1f2c-44c5-a499-453f91ff9e88 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:28:47.638120 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98be824-f4bb-4ca2-8437-da1b4a721dc2 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:28:47.638303 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21600b76-1f2c-44c5-a499-453f91ff9e88 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:28:47.666780 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 801/1579] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 13 15:28:47 2022] POST /identity/v3/projects => generated 383 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:28:47.667777 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 779/1580] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 13 15:28:47 2022] POST /identity/v3/projects => generated 365 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:28:47.668506 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21600b76-1f2c-44c5-a499-453f91ff9e88 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:28:47.670987 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98be824-f4bb-4ca2-8437-da1b4a721dc2 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:28:47.703527 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:28:47.736150 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98be824-f4bb-4ca2-8437-da1b4a721dc2 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:28:47.736334 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21600b76-1f2c-44c5-a499-453f91ff9e88 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:28:47.741157 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91df0d1-bed7-4dd1-a1b6-949d485b14fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:28:47.741314 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf063850-ec8f-4010-8d97-c920f8250c72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:28:47.741793 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91df0d1-bed7-4dd1-a1b6-949d485b14fe admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:28:47.741907 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf063850-ec8f-4010-8d97-c920f8250c72 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:28:47.742073 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91df0d1-bed7-4dd1-a1b6-949d485b14fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:28:47.742169 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf063850-ec8f-4010-8d97-c920f8250c72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:28:47.742344 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91df0d1-bed7-4dd1-a1b6-949d485b14fe admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:28:47.742469 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf063850-ec8f-4010-8d97-c920f8250c72 admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:28:47.742979 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91df0d1-bed7-4dd1-a1b6-949d485b14fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:28:47.743156 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf063850-ec8f-4010-8d97-c920f8250c72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:28:47.744894 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91df0d1-bed7-4dd1-a1b6-949d485b14fe admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:28:47.745037 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf063850-ec8f-4010-8d97-c920f8250c72 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:28:47.750277 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:28:47.771088 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 780/1581] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 13 15:28:47 2022] POST /identity/v3/users => generated 290 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:28:47.771088 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27b3abe-3941-410a-b22c-ef8d4a1f90ce None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:28:47.771088 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27b3abe-3941-410a-b22c-ef8d4a1f90ce None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:28:47.771088 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27b3abe-3941-410a-b22c-ef8d4a1f90ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:28:47.777613 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 802/1582] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 13 15:28:47 2022] POST /identity/v3/projects => generated 371 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:28:47.777613 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf063850-ec8f-4010-8d97-c920f8250c72 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:28:47.791194 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-d27b3abe-3941-410a-b22c-ef8d4a1f90ce None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:28:47.792421 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-d27b3abe-3941-410a-b22c-ef8d4a1f90ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:28:47.838755 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf063850-ec8f-4010-8d97-c920f8250c72 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:28:47.843401 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907416ef-85e1-47b9-907d-cda487041555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:28:47.844010 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907416ef-85e1-47b9-907d-cda487041555 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:28:47.844322 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907416ef-85e1-47b9-907d-cda487041555 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:28:47.844599 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907416ef-85e1-47b9-907d-cda487041555 admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:28:47.845226 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907416ef-85e1-47b9-907d-cda487041555 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:28:47.846306 dv-cinder-857434-2-smb devstack@keystone.service[81449]: WARNING py.warnings [None req-907416ef-85e1-47b9-907d-cda487041555 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 13 15:28:47.846306 dv-cinder-857434-2-smb devstack@keystone.service[81449]: warnings.warn(msg) Sep 13 15:28:47.846306 dv-cinder-857434-2-smb devstack@keystone.service[81449]: Sep 13 15:28:47.847528 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907416ef-85e1-47b9-907d-cda487041555 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:28:47.851458 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 781/1583] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:28:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:28:47.852053 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27b3abe-3941-410a-b22c-ef8d4a1f90ce None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:28:47.863554 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27b3abe-3941-410a-b22c-ef8d4a1f90ce None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:28:47.872198 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 803/1584] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 13 15:28:47 2022] POST /identity/v3/users => generated 292 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:28:47.872361 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e69a416-4bab-4859-89d2-4ae56161a670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:28:47.872361 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e69a416-4bab-4859-89d2-4ae56161a670 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:28:47.872581 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907416ef-85e1-47b9-907d-cda487041555 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:28:47.872680 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e69a416-4bab-4859-89d2-4ae56161a670 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:28:47.872680 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e69a416-4bab-4859-89d2-4ae56161a670 admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:28:47.872680 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e69a416-4bab-4859-89d2-4ae56161a670 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:28:47.873059 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e69a416-4bab-4859-89d2-4ae56161a670 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:28:47.882695 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907416ef-85e1-47b9-907d-cda487041555 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:28:47.887646 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7c6e66-d267-4a78-83a6-103b5b560308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:28:47.888248 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7c6e66-d267-4a78-83a6-103b5b560308 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:28:47.888533 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7c6e66-d267-4a78-83a6-103b5b560308 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:28:47.888810 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7c6e66-d267-4a78-83a6-103b5b560308 admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:28:47.889609 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7c6e66-d267-4a78-83a6-103b5b560308 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:28:47.891589 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7c6e66-d267-4a78-83a6-103b5b560308 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:28:47.898099 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 782/1585] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 13 15:28:47 2022] POST /identity/v3/users => generated 296 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:28:47.898099 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e69a416-4bab-4859-89d2-4ae56161a670 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:28:47.905663 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e69a416-4bab-4859-89d2-4ae56161a670 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:28:47.911070 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57083ad0-868f-4561-8fdf-fcdcfd26f016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:28:47.911888 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57083ad0-868f-4561-8fdf-fcdcfd26f016 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:28:47.912301 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57083ad0-868f-4561-8fdf-fcdcfd26f016 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:28:47.912605 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57083ad0-868f-4561-8fdf-fcdcfd26f016 admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:28:47.913240 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57083ad0-868f-4561-8fdf-fcdcfd26f016 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:28:47.915255 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57083ad0-868f-4561-8fdf-fcdcfd26f016 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:28:47.915717 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 804/1586] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 13 15:28:47 2022] POST /identity/v3/users => generated 287 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:28:47.916524 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7c6e66-d267-4a78-83a6-103b5b560308 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:28:47.928045 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7c6e66-d267-4a78-83a6-103b5b560308 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:28:47.933335 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41394967-9ff2-4e0e-bd02-341fa91c2441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:28:47.933971 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41394967-9ff2-4e0e-bd02-341fa91c2441 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:28:47.934253 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41394967-9ff2-4e0e-bd02-341fa91c2441 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:28:47.934531 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41394967-9ff2-4e0e-bd02-341fa91c2441 admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:28:47.935157 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41394967-9ff2-4e0e-bd02-341fa91c2441 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:28:47.937075 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41394967-9ff2-4e0e-bd02-341fa91c2441 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:28:47.937302 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 783/1587] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 13 15:28:47 2022] POST /identity/v3/users => generated 292 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:28:47.938293 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57083ad0-868f-4561-8fdf-fcdcfd26f016 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:28:47.948129 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57083ad0-868f-4561-8fdf-fcdcfd26f016 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:28:47.954395 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3402c996-fa64-4ee7-b3be-cf879bcb835d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:28:47.955022 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3402c996-fa64-4ee7-b3be-cf879bcb835d admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:28:47.955317 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3402c996-fa64-4ee7-b3be-cf879bcb835d admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:28:47.955568 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3402c996-fa64-4ee7-b3be-cf879bcb835d admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:28:47.956253 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3402c996-fa64-4ee7-b3be-cf879bcb835d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:28:47.957860 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3402c996-fa64-4ee7-b3be-cf879bcb835d admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:28:47.963008 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 805/1588] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 13 15:28:47 2022] POST /identity/v3/users => generated 283 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:28:47.966754 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41394967-9ff2-4e0e-bd02-341fa91c2441 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:28:47.970946 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 784/1589] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:28:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 15:28:47.971775 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3402c996-fa64-4ee7-b3be-cf879bcb835d admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:28:47.976550 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41394967-9ff2-4e0e-bd02-341fa91c2441 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:28:47.981130 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8904d79-573a-4ddf-9966-14817549bff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:28:47.981761 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8904d79-573a-4ddf-9966-14817549bff6 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:28:47.982049 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8904d79-573a-4ddf-9966-14817549bff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:28:47.982326 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8904d79-573a-4ddf-9966-14817549bff6 admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:28:47.982979 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8904d79-573a-4ddf-9966-14817549bff6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:28:47.984890 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8904d79-573a-4ddf-9966-14817549bff6 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:28:48.008377 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 806/1590] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 13 15:28:47 2022] POST /identity/v3/users => generated 292 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:28:48.016515 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8904d79-573a-4ddf-9966-14817549bff6 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:28:48.021678 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8904d79-573a-4ddf-9966-14817549bff6 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:28:48.026752 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae390cae-6dae-454d-8af8-adfe758c9323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:28:48.027471 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae390cae-6dae-454d-8af8-adfe758c9323 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:28:48.027752 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae390cae-6dae-454d-8af8-adfe758c9323 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:28:48.028022 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae390cae-6dae-454d-8af8-adfe758c9323 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:28:48.028662 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae390cae-6dae-454d-8af8-adfe758c9323 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:28:48.030321 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae390cae-6dae-454d-8af8-adfe758c9323 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:28:48.034843 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3402c996-fa64-4ee7-b3be-cf879bcb835d admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:28:48.039921 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459e5a14-85b1-4f21-8071-6006319aa588 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41675154bbba47388040966f75d84c3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:28:48.040519 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459e5a14-85b1-4f21-8071-6006319aa588 service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:28:48.040797 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459e5a14-85b1-4f21-8071-6006319aa588 service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:28:48.041064 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459e5a14-85b1-4f21-8071-6006319aa588 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:28:48.041493 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 807/1591] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:28:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 15:28:48.042294 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae390cae-6dae-454d-8af8-adfe758c9323 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:28:48.053069 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459e5a14-85b1-4f21-8071-6006319aa588 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:28:48.053582 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae390cae-6dae-454d-8af8-adfe758c9323 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:28:48.054951 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459e5a14-85b1-4f21-8071-6006319aa588 service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:28:48.058255 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40f6de2-7c12-46e1-b2e9-7b0c39e9c65d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:28:48.058867 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40f6de2-7c12-46e1-b2e9-7b0c39e9c65d admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:28:48.059152 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40f6de2-7c12-46e1-b2e9-7b0c39e9c65d admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:28:48.059430 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40f6de2-7c12-46e1-b2e9-7b0c39e9c65d admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:28:48.060207 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40f6de2-7c12-46e1-b2e9-7b0c39e9c65d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:28:48.061848 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40f6de2-7c12-46e1-b2e9-7b0c39e9c65d admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:28:48.065298 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 785/1592] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:28:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:28:48.066155 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459e5a14-85b1-4f21-8071-6006319aa588 service neutron] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:28:48.073662 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 808/1593] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:28:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 15:28:48.074404 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40f6de2-7c12-46e1-b2e9-7b0c39e9c65d admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:28:48.080205 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459e5a14-85b1-4f21-8071-6006319aa588 service neutron] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:28:48.086586 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40f6de2-7c12-46e1-b2e9-7b0c39e9c65d admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:28:48.086972 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be83a17b-196f-4377-a60c-09180e80400b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:28:48.087578 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be83a17b-196f-4377-a60c-09180e80400b admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:28:48.087859 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be83a17b-196f-4377-a60c-09180e80400b admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:28:48.088140 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be83a17b-196f-4377-a60c-09180e80400b admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:28:48.088777 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be83a17b-196f-4377-a60c-09180e80400b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:28:48.090405 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be83a17b-196f-4377-a60c-09180e80400b admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:28:48.092364 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef551e3-bb2b-48c5-a410-2a12b526dfa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:28:48.093081 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef551e3-bb2b-48c5-a410-2a12b526dfa8 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:28:48.093402 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef551e3-bb2b-48c5-a410-2a12b526dfa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:28:48.093796 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef551e3-bb2b-48c5-a410-2a12b526dfa8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:28:48.094555 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef551e3-bb2b-48c5-a410-2a12b526dfa8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:28:48.096624 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef551e3-bb2b-48c5-a410-2a12b526dfa8 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:28:48.105074 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 786/1594] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:28:48 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 15:28:48.105074 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be83a17b-196f-4377-a60c-09180e80400b admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:28:48.110739 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 809/1595] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:28:48 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 15:28:48.110739 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef551e3-bb2b-48c5-a410-2a12b526dfa8 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:28:48.115978 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be83a17b-196f-4377-a60c-09180e80400b admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:28:48.120850 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e955eec2-2cd0-4498-b9aa-3ecca2127908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:28:48.121529 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e955eec2-2cd0-4498-b9aa-3ecca2127908 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:28:48.121911 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e955eec2-2cd0-4498-b9aa-3ecca2127908 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:28:48.122185 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef551e3-bb2b-48c5-a410-2a12b526dfa8 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:28:48.122308 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e955eec2-2cd0-4498-b9aa-3ecca2127908 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:28:48.123016 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e955eec2-2cd0-4498-b9aa-3ecca2127908 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:28:48.124673 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e955eec2-2cd0-4498-b9aa-3ecca2127908 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:28:48.126249 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:28:48.127240 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99931f3a-4079-41eb-a36b-f5dc0af547e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:28:48.127977 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99931f3a-4079-41eb-a36b-f5dc0af547e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:28:48.128344 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99931f3a-4079-41eb-a36b-f5dc0af547e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:28:48.128754 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99931f3a-4079-41eb-a36b-f5dc0af547e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:28:48.129415 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99931f3a-4079-41eb-a36b-f5dc0af547e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:28:48.131863 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99931f3a-4079-41eb-a36b-f5dc0af547e0 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:28:48.138486 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 787/1596] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:28:48 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 15:28:48.139434 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e955eec2-2cd0-4498-b9aa-3ecca2127908 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:28:48.149311 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 810/1597] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:28:48 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 15:28:48.149311 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99931f3a-4079-41eb-a36b-f5dc0af547e0 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:28:48.155338 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e955eec2-2cd0-4498-b9aa-3ecca2127908 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:28:48.159736 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99931f3a-4079-41eb-a36b-f5dc0af547e0 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:28:48.162243 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90440cc-907d-4260-b082-d3bf9eaa7b88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:28:48.162993 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90440cc-907d-4260-b082-d3bf9eaa7b88 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:28:48.163346 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90440cc-907d-4260-b082-d3bf9eaa7b88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:28:48.163689 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90440cc-907d-4260-b082-d3bf9eaa7b88 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:28:48.164439 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90440cc-907d-4260-b082-d3bf9eaa7b88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:28:48.165413 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be1e384-1363-4ef8-b2a9-98b277fbfa73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:28:48.165916 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be1e384-1363-4ef8-b2a9-98b277fbfa73 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:28:48.166286 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90440cc-907d-4260-b082-d3bf9eaa7b88 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:28:48.166415 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be1e384-1363-4ef8-b2a9-98b277fbfa73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:28:48.166768 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be1e384-1363-4ef8-b2a9-98b277fbfa73 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:28:48.167559 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be1e384-1363-4ef8-b2a9-98b277fbfa73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:28:48.169533 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be1e384-1363-4ef8-b2a9-98b277fbfa73 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:28:48.181779 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 788/1598] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:28:48 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 15:28:48.181779 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90440cc-907d-4260-b082-d3bf9eaa7b88 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:28:48.182074 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 811/1599] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:28:48 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 15:28:48.182465 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be1e384-1363-4ef8-b2a9-98b277fbfa73 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:28:48.193328 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90440cc-907d-4260-b082-d3bf9eaa7b88 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:28:48.193926 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be1e384-1363-4ef8-b2a9-98b277fbfa73 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:28:48.198175 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d18d5a-88f7-4340-9017-d4bf34e3aabf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:28:48.198951 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d18d5a-88f7-4340-9017-d4bf34e3aabf admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:28:48.199250 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d18d5a-88f7-4340-9017-d4bf34e3aabf admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:28:48.199379 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50e3e67-6930-4ce3-bdf8-328df7b50733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:28:48.199477 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d18d5a-88f7-4340-9017-d4bf34e3aabf admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:28:48.199854 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50e3e67-6930-4ce3-bdf8-328df7b50733 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:28:48.200175 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d18d5a-88f7-4340-9017-d4bf34e3aabf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:28:48.200416 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50e3e67-6930-4ce3-bdf8-328df7b50733 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:28:48.200516 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50e3e67-6930-4ce3-bdf8-328df7b50733 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:28:48.201159 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50e3e67-6930-4ce3-bdf8-328df7b50733 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:28:48.201956 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d18d5a-88f7-4340-9017-d4bf34e3aabf admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:28:48.203222 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50e3e67-6930-4ce3-bdf8-328df7b50733 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:28:48.212539 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 789/1600] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:28:48 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 15:28:48.213388 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d18d5a-88f7-4340-9017-d4bf34e3aabf admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:28:48.218607 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 812/1601] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:28:48 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 15:28:48.218607 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50e3e67-6930-4ce3-bdf8-328df7b50733 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:28:48.227806 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50e3e67-6930-4ce3-bdf8-328df7b50733 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:28:48.228004 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d18d5a-88f7-4340-9017-d4bf34e3aabf admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:28:48.232853 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0450907f-b6b2-48ab-bcad-cee9d4b04d72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:28:48.233028 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e886c072-d628-4da7-a2af-627ff05ae014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:28:48.233468 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0450907f-b6b2-48ab-bcad-cee9d4b04d72 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:28:48.233600 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e886c072-d628-4da7-a2af-627ff05ae014 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:28:48.233801 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0450907f-b6b2-48ab-bcad-cee9d4b04d72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:28:48.233919 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e886c072-d628-4da7-a2af-627ff05ae014 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:28:48.234082 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0450907f-b6b2-48ab-bcad-cee9d4b04d72 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:28:48.234188 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e886c072-d628-4da7-a2af-627ff05ae014 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:28:48.234795 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e886c072-d628-4da7-a2af-627ff05ae014 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:28:48.234929 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0450907f-b6b2-48ab-bcad-cee9d4b04d72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:28:48.236447 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e886c072-d628-4da7-a2af-627ff05ae014 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:28:48.236561 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0450907f-b6b2-48ab-bcad-cee9d4b04d72 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:28:48.248563 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 790/1602] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:28:48 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 15:28:48.249379 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0450907f-b6b2-48ab-bcad-cee9d4b04d72 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:28:48.251822 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 813/1603] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:28:48 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 15:28:48.252732 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e886c072-d628-4da7-a2af-627ff05ae014 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:28:48.262830 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0450907f-b6b2-48ab-bcad-cee9d4b04d72 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:28:48.266716 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e886c072-d628-4da7-a2af-627ff05ae014 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:28:48.273021 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463b021b-6eb7-4980-bc23-e7eed2a30e6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:28:48.273786 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f06cb04-1919-4f96-8479-9a7633f9534e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:28:48.273943 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463b021b-6eb7-4980-bc23-e7eed2a30e6b admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:28:48.274253 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463b021b-6eb7-4980-bc23-e7eed2a30e6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:28:48.274610 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463b021b-6eb7-4980-bc23-e7eed2a30e6b admin admin] PATH_INFO: `/v3/projects/3e21c867c8d74ef4990605705dc8db82/users/4c9cc065561e4c03a609e15594ca5cf6/roles/f34412ad29f1478cba775b033129f71f` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:28:48.274750 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f06cb04-1919-4f96-8479-9a7633f9534e admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:28:48.275105 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f06cb04-1919-4f96-8479-9a7633f9534e admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:28:48.275513 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f06cb04-1919-4f96-8479-9a7633f9534e admin admin] PATH_INFO: `/v3/projects/c9ca543ab03a415c994cebe4735b663d/users/4b3c5e5fb1d74c58b897b6b420685264/roles/3fae3d3a28e147d3b2bede2378ff79ae` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:28:48.279530 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=87,keystone:INSERT=13 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:28:48.296194 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463b021b-6eb7-4980-bc23-e7eed2a30e6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e21c867c8d74ef4990605705dc8db82, user_id=4c9cc065561e4c03a609e15594ca5cf6, role_id=f34412ad29f1478cba775b033129f71f)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:28:48.297190 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f06cb04-1919-4f96-8479-9a7633f9534e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9ca543ab03a415c994cebe4735b663d, user_id=4b3c5e5fb1d74c58b897b6b420685264, role_id=3fae3d3a28e147d3b2bede2378ff79ae)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:28:48.299575 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463b021b-6eb7-4980-bc23-e7eed2a30e6b admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:28:48.300386 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f06cb04-1919-4f96-8479-9a7633f9534e admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:28:48.314920 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 814/1604] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 13 15:28:48 2022] PUT /identity/v3/projects/3e21c867c8d74ef4990605705dc8db82/users/4c9cc065561e4c03a609e15594ca5cf6/roles/f34412ad29f1478cba775b033129f71f => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:28:48.315693 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463b021b-6eb7-4980-bc23-e7eed2a30e6b admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:28:48.316956 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 791/1605] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 13 15:28:48 2022] PUT /identity/v3/projects/c9ca543ab03a415c994cebe4735b663d/users/4b3c5e5fb1d74c58b897b6b420685264/roles/3fae3d3a28e147d3b2bede2378ff79ae => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:28:48.318785 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f06cb04-1919-4f96-8479-9a7633f9534e admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:28:48.386717 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463b021b-6eb7-4980-bc23-e7eed2a30e6b admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:28:48.392451 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bacad9a-f387-4d00-9beb-e911b0e5786f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:28:48.393259 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bacad9a-f387-4d00-9beb-e911b0e5786f admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:28:48.393548 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bacad9a-f387-4d00-9beb-e911b0e5786f admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:28:48.393866 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bacad9a-f387-4d00-9beb-e911b0e5786f admin admin] PATH_INFO: `/v3/projects/586040c6a539435eb5a3c601601f1fba/users/3380dfec771d40f1828a463aa355b293/roles/3fae3d3a28e147d3b2bede2378ff79ae` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:28:48.398808 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f06cb04-1919-4f96-8479-9a7633f9534e admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:28:48.405095 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0edfc3-d68b-4a0e-a458-14678bead8ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:28:48.406224 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0edfc3-d68b-4a0e-a458-14678bead8ab admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:28:48.406613 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0edfc3-d68b-4a0e-a458-14678bead8ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:28:48.407423 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0edfc3-d68b-4a0e-a458-14678bead8ab admin admin] PATH_INFO: `/v3/projects/8b972a050e4c40f6bf091a10e9933a8d/users/0f2d373741034946bb989002d4b895ca/roles/3fae3d3a28e147d3b2bede2378ff79ae` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:28:48.409896 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bacad9a-f387-4d00-9beb-e911b0e5786f admin admin] RBAC: Authorizing `identity:create_grant(project_id=586040c6a539435eb5a3c601601f1fba, user_id=3380dfec771d40f1828a463aa355b293, role_id=3fae3d3a28e147d3b2bede2378ff79ae)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:28:48.412829 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bacad9a-f387-4d00-9beb-e911b0e5786f admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:28:48.428546 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 815/1606] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 13 15:28:48 2022] PUT /identity/v3/projects/586040c6a539435eb5a3c601601f1fba/users/3380dfec771d40f1828a463aa355b293/roles/3fae3d3a28e147d3b2bede2378ff79ae => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:28:48.429307 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bacad9a-f387-4d00-9beb-e911b0e5786f admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:28:48.445417 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0edfc3-d68b-4a0e-a458-14678bead8ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b972a050e4c40f6bf091a10e9933a8d, user_id=0f2d373741034946bb989002d4b895ca, role_id=3fae3d3a28e147d3b2bede2378ff79ae)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:28:48.449326 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0edfc3-d68b-4a0e-a458-14678bead8ab admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:28:48.482834 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 792/1607] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 13 15:28:48 2022] PUT /identity/v3/projects/8b972a050e4c40f6bf091a10e9933a8d/users/0f2d373741034946bb989002d4b895ca/roles/3fae3d3a28e147d3b2bede2378ff79ae => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:28:48.482834 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0edfc3-d68b-4a0e-a458-14678bead8ab admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:28:48.528959 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bacad9a-f387-4d00-9beb-e911b0e5786f admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:28:48.557946 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0edfc3-d68b-4a0e-a458-14678bead8ab admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:28:48.564665 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d9a7b8-098a-463b-ab64-9f18fe9b6032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:28:48.565679 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d9a7b8-098a-463b-ab64-9f18fe9b6032 admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:28:48.565995 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d9a7b8-098a-463b-ab64-9f18fe9b6032 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:28:48.566273 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d9a7b8-098a-463b-ab64-9f18fe9b6032 admin admin] PATH_INFO: `/v3/projects/5ee1ae8ffa4146e6a6a1b48ccd92af3d/users/0f80c49b77d1446d9ff42c5c4ddc82a8/roles/3fae3d3a28e147d3b2bede2378ff79ae` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:28:48.585255 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d9a7b8-098a-463b-ab64-9f18fe9b6032 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ee1ae8ffa4146e6a6a1b48ccd92af3d, user_id=0f80c49b77d1446d9ff42c5c4ddc82a8, role_id=3fae3d3a28e147d3b2bede2378ff79ae)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:28:48.588167 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d9a7b8-098a-463b-ab64-9f18fe9b6032 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:28:48.602029 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5245ae7-46b3-43dc-9fd9-c4c8f0f2c24a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:28:48.602989 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5245ae7-46b3-43dc-9fd9-c4c8f0f2c24a admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:28:48.603383 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5245ae7-46b3-43dc-9fd9-c4c8f0f2c24a admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:28:48.603670 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5245ae7-46b3-43dc-9fd9-c4c8f0f2c24a admin admin] PATH_INFO: `/v3/projects/5fa62ee10eff48dcabd21f47ae5acbe0/users/10122e2264cf418a9eb65ccf40249814/roles/3fae3d3a28e147d3b2bede2378ff79ae` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:28:48.606300 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 793/1608] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 13 15:28:48 2022] PUT /identity/v3/projects/5ee1ae8ffa4146e6a6a1b48ccd92af3d/users/0f80c49b77d1446d9ff42c5c4ddc82a8/roles/3fae3d3a28e147d3b2bede2378ff79ae => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:28:48.607091 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d9a7b8-098a-463b-ab64-9f18fe9b6032 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:28:48.613533 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:28:48.630467 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5245ae7-46b3-43dc-9fd9-c4c8f0f2c24a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fa62ee10eff48dcabd21f47ae5acbe0, user_id=10122e2264cf418a9eb65ccf40249814, role_id=3fae3d3a28e147d3b2bede2378ff79ae)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:28:48.633693 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5245ae7-46b3-43dc-9fd9-c4c8f0f2c24a admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:28:48.637538 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:28:48.653896 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 816/1609] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 13 15:28:48 2022] PUT /identity/v3/projects/5fa62ee10eff48dcabd21f47ae5acbe0/users/10122e2264cf418a9eb65ccf40249814/roles/3fae3d3a28e147d3b2bede2378ff79ae => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:28:48.653896 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5245ae7-46b3-43dc-9fd9-c4c8f0f2c24a admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:28:48.695819 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d9a7b8-098a-463b-ab64-9f18fe9b6032 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:28:48.736038 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5245ae7-46b3-43dc-9fd9-c4c8f0f2c24a admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:28:48.745414 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e04c68c-6e80-4b82-961a-a3fec15f351f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:28:48.747316 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e04c68c-6e80-4b82-961a-a3fec15f351f admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:28:48.747716 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e04c68c-6e80-4b82-961a-a3fec15f351f admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:28:48.748102 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e04c68c-6e80-4b82-961a-a3fec15f351f admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:28:48.749141 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e04c68c-6e80-4b82-961a-a3fec15f351f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:28:48.750826 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e04c68c-6e80-4b82-961a-a3fec15f351f admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:28:48.764920 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 817/1610] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:28:48 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 15:28:48.766420 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01e99fb-30de-4d05-8292-b58fa3a335aa None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:28:48.766885 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01e99fb-30de-4d05-8292-b58fa3a335aa None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:28:48.767170 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01e99fb-30de-4d05-8292-b58fa3a335aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:28:48.775067 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73acf305-bf85-4eee-9d8e-8dd0018f7fee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:28:48.775984 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73acf305-bf85-4eee-9d8e-8dd0018f7fee admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:28:48.776393 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73acf305-bf85-4eee-9d8e-8dd0018f7fee admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:28:48.776806 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73acf305-bf85-4eee-9d8e-8dd0018f7fee admin admin] PATH_INFO: `/v3/projects/ea3cda7ada374a97826b076da1592cab/users/7fe1e310cd5b4506bc6e10a2f5742cbb/roles/3fae3d3a28e147d3b2bede2378ff79ae` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:28:48.797984 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73acf305-bf85-4eee-9d8e-8dd0018f7fee admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea3cda7ada374a97826b076da1592cab, user_id=7fe1e310cd5b4506bc6e10a2f5742cbb, role_id=3fae3d3a28e147d3b2bede2378ff79ae)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:28:48.800146 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-b01e99fb-30de-4d05-8292-b58fa3a335aa None None] MFA Rules not processed for user `4b3c5e5fb1d74c58b897b6b420685264`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:28:48.801466 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-b01e99fb-30de-4d05-8292-b58fa3a335aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:28:48.802943 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73acf305-bf85-4eee-9d8e-8dd0018f7fee admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:28:48.829399 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 794/1611] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 13 15:28:48 2022] PUT /identity/v3/projects/ea3cda7ada374a97826b076da1592cab/users/7fe1e310cd5b4506bc6e10a2f5742cbb/roles/3fae3d3a28e147d3b2bede2378ff79ae => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:28:48.830744 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1abe2fa-8744-4c13-a18e-fb14ef670e0f None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:28:48.831030 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1abe2fa-8744-4c13-a18e-fb14ef670e0f None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:28:48.831299 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1abe2fa-8744-4c13-a18e-fb14ef670e0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:28:48.875308 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-d1abe2fa-8744-4c13-a18e-fb14ef670e0f None None] MFA Rules not processed for user `3380dfec771d40f1828a463aa355b293`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:28:48.877506 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-d1abe2fa-8744-4c13-a18e-fb14ef670e0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:28:48.889769 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 818/1612] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:28:48 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:28:48.891158 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a6fe3d-23ef-4728-8a3c-69bb2ba905d5 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:28:48.891501 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a6fe3d-23ef-4728-8a3c-69bb2ba905d5 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:28:48.891721 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a6fe3d-23ef-4728-8a3c-69bb2ba905d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:28:48.912491 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-b4a6fe3d-23ef-4728-8a3c-69bb2ba905d5 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:28:48.913630 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-b4a6fe3d-23ef-4728-8a3c-69bb2ba905d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:28:48.972389 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 795/1613] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:28:48 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:28:48.982308 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20fbfca-0d02-41bd-9d9c-3b677df369e4 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:28:48.982925 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20fbfca-0d02-41bd-9d9c-3b677df369e4 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:28:48.983477 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20fbfca-0d02-41bd-9d9c-3b677df369e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:28:49.016838 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 819/1614] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:28:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:28:49.018556 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1f70bc-e1f5-41cd-9c67-66b017ffe03f None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:28:49.019029 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1f70bc-e1f5-41cd-9c67-66b017ffe03f None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:28:49.019472 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1f70bc-e1f5-41cd-9c67-66b017ffe03f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:28:49.031935 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-a20fbfca-0d02-41bd-9d9c-3b677df369e4 None None] MFA Rules not processed for user `0f80c49b77d1446d9ff42c5c4ddc82a8`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:28:49.033372 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-a20fbfca-0d02-41bd-9d9c-3b677df369e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:28:49.055083 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-0d1f70bc-e1f5-41cd-9c67-66b017ffe03f None None] MFA Rules not processed for user `10122e2264cf418a9eb65ccf40249814`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:28:49.055932 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:28:49.056795 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-0d1f70bc-e1f5-41cd-9c67-66b017ffe03f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:28:49.068312 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:28:49.132806 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 796/1615] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:28:48 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:28:49.134417 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20fbfca-0d02-41bd-9d9c-3b677df369e4 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:28:49.135791 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 820/1616] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:28:49 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:28:49.137505 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89831f3f-37bb-4a11-906b-a03f1133d25a None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:28:49.137863 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89831f3f-37bb-4a11-906b-a03f1133d25a None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:28:49.138150 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89831f3f-37bb-4a11-906b-a03f1133d25a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:28:49.162751 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-89831f3f-37bb-4a11-906b-a03f1133d25a None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:28:49.164009 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-89831f3f-37bb-4a11-906b-a03f1133d25a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:28:49.173582 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 821/1617] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:28:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:28:49.174180 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89831f3f-37bb-4a11-906b-a03f1133d25a None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:28:49.188231 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20fbfca-0d02-41bd-9d9c-3b677df369e4 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:28:49.193920 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89831f3f-37bb-4a11-906b-a03f1133d25a None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:28:49.195040 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de969fd9-b382-4096-96e3-8e39428c19e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:28:49.195886 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de969fd9-b382-4096-96e3-8e39428c19e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:28:49.196233 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de969fd9-b382-4096-96e3-8e39428c19e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:28:49.197187 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de969fd9-b382-4096-96e3-8e39428c19e3 admin admin] PATH_INFO: `/v3/projects/3e21c867c8d74ef4990605705dc8db82/users/4c9cc065561e4c03a609e15594ca5cf6/roles/f34412ad29f1478cba775b033129f71f` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:28:49.198691 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de969fd9-b382-4096-96e3-8e39428c19e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e21c867c8d74ef4990605705dc8db82, user_id=4c9cc065561e4c03a609e15594ca5cf6, role_id=f34412ad29f1478cba775b033129f71f)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:28:49.201529 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de969fd9-b382-4096-96e3-8e39428c19e3 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:28:49.206010 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de294f4-386d-48c4-b22b-f6e069df8fa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:28:49.206771 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de294f4-386d-48c4-b22b-f6e069df8fa0 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:28:49.207059 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de294f4-386d-48c4-b22b-f6e069df8fa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:28:49.207335 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de294f4-386d-48c4-b22b-f6e069df8fa0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:28:49.208281 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de294f4-386d-48c4-b22b-f6e069df8fa0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:28:49.211454 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de294f4-386d-48c4-b22b-f6e069df8fa0 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:28:49.222016 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 797/1618] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 13 15:28:49 2022] PUT /identity/v3/projects/3e21c867c8d74ef4990605705dc8db82/users/4c9cc065561e4c03a609e15594ca5cf6/roles/f34412ad29f1478cba775b033129f71f => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:28:49.223651 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de969fd9-b382-4096-96e3-8e39428c19e3 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:28:49.258978 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 822/1619] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 13 15:28:49 2022] POST /identity/v3/projects => generated 379 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:28:49.261159 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a40300-756e-4a08-b077-f7fa15510bfa None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:28:49.261730 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a40300-756e-4a08-b077-f7fa15510bfa None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:28:49.262120 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a40300-756e-4a08-b077-f7fa15510bfa None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:28:49.263852 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 823/1620] 10.222.0.27 () {54 vars in 962 bytes} [Tue Sep 13 15:28:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:28:49.264675 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a40300-756e-4a08-b077-f7fa15510bfa None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:28:49.324654 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de969fd9-b382-4096-96e3-8e39428c19e3 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:28:49.342258 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a40300-756e-4a08-b077-f7fa15510bfa None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:28:49.346328 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93ea3e5-fa00-4be6-abf3-9a3ceec714c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97acd23097d54bf7805c3cef60626ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:28:49.346951 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93ea3e5-fa00-4be6-abf3-9a3ceec714c8 service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:28:49.347363 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93ea3e5-fa00-4be6-abf3-9a3ceec714c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:28:49.347651 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93ea3e5-fa00-4be6-abf3-9a3ceec714c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:28:49.380830 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7670315-29d5-407a-b5e7-b20f4083cd9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41675154bbba47388040966f75d84c3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:28:49.381458 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7670315-29d5-407a-b5e7-b20f4083cd9d service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:28:49.381791 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7670315-29d5-407a-b5e7-b20f4083cd9d service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:28:49.382074 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7670315-29d5-407a-b5e7-b20f4083cd9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:28:49.416651 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93ea3e5-fa00-4be6-abf3-9a3ceec714c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:28:49.418429 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93ea3e5-fa00-4be6-abf3-9a3ceec714c8 service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:28:49.430099 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 824/1621] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:28:49 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:28:49.431235 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93ea3e5-fa00-4be6-abf3-9a3ceec714c8 service cinder] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:28:49.442699 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93ea3e5-fa00-4be6-abf3-9a3ceec714c8 service cinder] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:28:49.447944 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d846c0-2ae1-4795-8d85-881176e51801 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41675154bbba47388040966f75d84c3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:28:49.448810 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d846c0-2ae1-4795-8d85-881176e51801 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:28:49.449222 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d846c0-2ae1-4795-8d85-881176e51801 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:28:49.449610 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d846c0-2ae1-4795-8d85-881176e51801 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:28:49.456145 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7670315-29d5-407a-b5e7-b20f4083cd9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:28:49.458802 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7670315-29d5-407a-b5e7-b20f4083cd9d service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:28:49.465433 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d846c0-2ae1-4795-8d85-881176e51801 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:28:49.467298 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d846c0-2ae1-4795-8d85-881176e51801 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:28:49.470238 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 798/1622] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:28:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:28:49.471846 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cd2545-655d-433f-8b43-4bd7953ee87a None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:28:49.472289 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cd2545-655d-433f-8b43-4bd7953ee87a None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:28:49.472580 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cd2545-655d-433f-8b43-4bd7953ee87a None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:28:49.474969 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 799/1623] 10.222.0.27 () {54 vars in 962 bytes} [Tue Sep 13 15:28:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:28:49.476285 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5e7c35-a8b8-4843-a111-98c64e00d238 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:28:49.476574 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5e7c35-a8b8-4843-a111-98c64e00d238 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:28:49.476857 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5e7c35-a8b8-4843-a111-98c64e00d238 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:28:49.481509 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 825/1624] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:28:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:28:49.482382 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d846c0-2ae1-4795-8d85-881176e51801 service neutron] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:28:49.491946 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:28:49.494640 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d846c0-2ae1-4795-8d85-881176e51801 service neutron] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:28:49.507902 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312b1b35-1125-4d23-83fb-b0419458e9f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:28:49.508557 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312b1b35-1125-4d23-83fb-b0419458e9f0 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:28:49.509004 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312b1b35-1125-4d23-83fb-b0419458e9f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:28:49.509955 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312b1b35-1125-4d23-83fb-b0419458e9f0 admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:28:49.511301 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312b1b35-1125-4d23-83fb-b0419458e9f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:28:49.518675 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312b1b35-1125-4d23-83fb-b0419458e9f0 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:28:49.518791 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-0f5e7c35-a8b8-4843-a111-98c64e00d238 None None] MFA Rules not processed for user `4c9cc065561e4c03a609e15594ca5cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:28:49.522413 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-0f5e7c35-a8b8-4843-a111-98c64e00d238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:28:49.573301 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 826/1625] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 13 15:28:49 2022] POST /identity/v3/users => generated 296 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:28:49.574688 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7b778f-7080-4648-8e4a-09c1e182d06b None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:28:49.575139 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7b778f-7080-4648-8e4a-09c1e182d06b None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:28:49.577209 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7b778f-7080-4648-8e4a-09c1e182d06b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:28:49.615870 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:28:49.633968 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 800/1626] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:28:49 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:28:49.636244 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1ce95b-c69a-41f4-9df5-22a1cf529686 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:28:49.636907 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1ce95b-c69a-41f4-9df5-22a1cf529686 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:28:49.636907 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1ce95b-c69a-41f4-9df5-22a1cf529686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:28:49.680488 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-5d1ce95b-c69a-41f4-9df5-22a1cf529686 None None] MFA Rules not processed for user `62aad71c6c1a4469805762bba330bf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:28:49.682621 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-5d1ce95b-c69a-41f4-9df5-22a1cf529686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:28:49.695092 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-7b7b778f-7080-4648-8e4a-09c1e182d06b None None] MFA Rules not processed for user `62aad71c6c1a4469805762bba330bf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:28:49.696332 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-7b7b778f-7080-4648-8e4a-09c1e182d06b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:28:49.786671 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 801/1627] 10.222.0.27 () {58 vars in 1059 bytes} [Tue Sep 13 15:28:49 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:28:49.788656 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1ce95b-c69a-41f4-9df5-22a1cf529686 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:28:49.804119 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1ce95b-c69a-41f4-9df5-22a1cf529686 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:28:49.818416 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089a7443-1c43-4b1b-9eda-9a53dd732495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:28:49.826291 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089a7443-1c43-4b1b-9eda-9a53dd732495 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:28:49.826291 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089a7443-1c43-4b1b-9eda-9a53dd732495 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:28:49.826291 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089a7443-1c43-4b1b-9eda-9a53dd732495 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:28:49.826291 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089a7443-1c43-4b1b-9eda-9a53dd732495 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:28:49.826291 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089a7443-1c43-4b1b-9eda-9a53dd732495 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:28:49.852619 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 802/1628] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:28:49 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 15:28:49.852619 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089a7443-1c43-4b1b-9eda-9a53dd732495 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:28:49.872054 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089a7443-1c43-4b1b-9eda-9a53dd732495 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:28:49.876479 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d201a063-43e3-4208-aa4a-711a118828e8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97acd23097d54bf7805c3cef60626ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:28:49.877159 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d201a063-43e3-4208-aa4a-711a118828e8 service cinder] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:28:49.877478 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d201a063-43e3-4208-aa4a-711a118828e8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:28:49.877921 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d201a063-43e3-4208-aa4a-711a118828e8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:28:49.890157 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 827/1629] 10.222.0.27 () {58 vars in 1059 bytes} [Tue Sep 13 15:28:49 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:28:49.891565 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7b778f-7080-4648-8e4a-09c1e182d06b None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:28:49.894655 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d201a063-43e3-4208-aa4a-711a118828e8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:28:49.896966 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d201a063-43e3-4208-aa4a-711a118828e8 service cinder] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:28:49.917261 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7b778f-7080-4648-8e4a-09c1e182d06b None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:28:49.923808 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a11fc2-6520-4c21-834e-0be6e26e6f2d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62aad71c6c1a4469805762bba330bf0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:28:49.924688 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a11fc2-6520-4c21-834e-0be6e26e6f2d service nova] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:28:49.924977 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a11fc2-6520-4c21-834e-0be6e26e6f2d service nova] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:28:49.925253 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a11fc2-6520-4c21-834e-0be6e26e6f2d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:28:49.927729 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 803/1630] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:28:49 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:28:49.929357 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d201a063-43e3-4208-aa4a-711a118828e8 service cinder] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:28:49.957291 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d201a063-43e3-4208-aa4a-711a118828e8 service cinder] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:28:49.969411 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f042dfac-1d2e-49b7-ae13-bcf8c858bb95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:28:49.971431 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f042dfac-1d2e-49b7-ae13-bcf8c858bb95 admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:28:49.971722 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f042dfac-1d2e-49b7-ae13-bcf8c858bb95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:28:49.972025 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f042dfac-1d2e-49b7-ae13-bcf8c858bb95 admin admin] PATH_INFO: `/v3/projects/4fa72cc7370e41eba2d897de6d0b48ee/users/574f50585b514fa5b358579355f6004f/roles/f34412ad29f1478cba775b033129f71f` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:28:50.013116 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f042dfac-1d2e-49b7-ae13-bcf8c858bb95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fa72cc7370e41eba2d897de6d0b48ee, user_id=574f50585b514fa5b358579355f6004f, role_id=f34412ad29f1478cba775b033129f71f)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:28:50.031272 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f042dfac-1d2e-49b7-ae13-bcf8c858bb95 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:28:50.037503 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a11fc2-6520-4c21-834e-0be6e26e6f2d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:28:50.039719 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a11fc2-6520-4c21-834e-0be6e26e6f2d service nova] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:28:50.056377 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 804/1631] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 13 15:28:49 2022] PUT /identity/v3/projects/4fa72cc7370e41eba2d897de6d0b48ee/users/574f50585b514fa5b358579355f6004f/roles/f34412ad29f1478cba775b033129f71f => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:28:50.060224 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 828/1632] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:28:49 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:28:50.061430 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f042dfac-1d2e-49b7-ae13-bcf8c858bb95 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:28:50.062558 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a11fc2-6520-4c21-834e-0be6e26e6f2d service nova] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:28:50.094581 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a11fc2-6520-4c21-834e-0be6e26e6f2d service nova] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:28:50.202986 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:28:50.290871 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f042dfac-1d2e-49b7-ae13-bcf8c858bb95 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:28:50.314065 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4139dc01-7206-4129-975a-c6f470260103 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62aad71c6c1a4469805762bba330bf0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:28:50.315038 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4139dc01-7206-4129-975a-c6f470260103 service nova] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:28:50.315250 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4139dc01-7206-4129-975a-c6f470260103 service nova] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:28:50.315675 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4139dc01-7206-4129-975a-c6f470260103 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:28:50.351518 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e4197e-c1e5-4bd0-a819-fe876a711590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:28:50.352215 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e4197e-c1e5-4bd0-a819-fe876a711590 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:28:50.352563 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e4197e-c1e5-4bd0-a819-fe876a711590 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:28:50.352870 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e4197e-c1e5-4bd0-a819-fe876a711590 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:28:50.353568 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e4197e-c1e5-4bd0-a819-fe876a711590 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:28:50.355266 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e4197e-c1e5-4bd0-a819-fe876a711590 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:28:50.385959 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 829/1633] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:28:50 2022] GET /identity/v3/roles => generated 1420 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 15:28:50.386834 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e4197e-c1e5-4bd0-a819-fe876a711590 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:28:50.439473 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4139dc01-7206-4129-975a-c6f470260103 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:28:50.441253 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4139dc01-7206-4129-975a-c6f470260103 service nova] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:28:50.452351 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:28:50.457267 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 805/1634] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:28:50 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:28:50.458659 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4139dc01-7206-4129-975a-c6f470260103 service nova] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:28:50.476091 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4139dc01-7206-4129-975a-c6f470260103 service nova] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:28:50.492184 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4957bb9-5394-4c4f-b4eb-4b64a913d41c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:28:50.493102 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4957bb9-5394-4c4f-b4eb-4b64a913d41c admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:28:50.493507 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4957bb9-5394-4c4f-b4eb-4b64a913d41c admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:28:50.494063 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4957bb9-5394-4c4f-b4eb-4b64a913d41c admin admin] PATH_INFO: `/v3/projects/4fa72cc7370e41eba2d897de6d0b48ee/users/574f50585b514fa5b358579355f6004f/roles/f34412ad29f1478cba775b033129f71f` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:28:50.496249 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4957bb9-5394-4c4f-b4eb-4b64a913d41c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fa72cc7370e41eba2d897de6d0b48ee, user_id=574f50585b514fa5b358579355f6004f, role_id=f34412ad29f1478cba775b033129f71f)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:28:50.499682 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4957bb9-5394-4c4f-b4eb-4b64a913d41c admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:28:50.529758 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 806/1635] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 13 15:28:50 2022] PUT /identity/v3/projects/4fa72cc7370e41eba2d897de6d0b48ee/users/574f50585b514fa5b358579355f6004f/roles/f34412ad29f1478cba775b033129f71f => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:28:50.533395 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73ba5a4-eee2-4ba7-a121-aa7564b1346c None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:28:50.534009 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73ba5a4-eee2-4ba7-a121-aa7564b1346c None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:28:50.534373 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73ba5a4-eee2-4ba7-a121-aa7564b1346c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:28:50.561045 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e4197e-c1e5-4bd0-a819-fe876a711590 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:28:50.626892 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-d73ba5a4-eee2-4ba7-a121-aa7564b1346c None None] MFA Rules not processed for user `574f50585b514fa5b358579355f6004f`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:28:50.628346 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-d73ba5a4-eee2-4ba7-a121-aa7564b1346c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:28:50.671143 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b8751d-aa57-4237-b174-ad7f7203257a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97acd23097d54bf7805c3cef60626ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:28:50.671774 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b8751d-aa57-4237-b174-ad7f7203257a service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:28:50.672056 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b8751d-aa57-4237-b174-ad7f7203257a service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:28:50.672550 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b8751d-aa57-4237-b174-ad7f7203257a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:28:50.774966 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b8751d-aa57-4237-b174-ad7f7203257a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:28:50.779208 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b8751d-aa57-4237-b174-ad7f7203257a service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:28:50.823128 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 830/1636] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:28:50 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:28:50.824615 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf9da52-d144-4b8b-a3b6-027aa9b9ed1c None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:28:50.825277 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf9da52-d144-4b8b-a3b6-027aa9b9ed1c None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:28:50.825882 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf9da52-d144-4b8b-a3b6-027aa9b9ed1c None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:28:50.832029 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 831/1637] 10.222.0.27 () {54 vars in 912 bytes} [Tue Sep 13 15:28:50 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:28:50.836804 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8dd0bb-0d76-430d-9828-6e1e90b53f5b None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:28:50.837272 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8dd0bb-0d76-430d-9828-6e1e90b53f5b None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:28:50.837772 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8dd0bb-0d76-430d-9828-6e1e90b53f5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:28:50.914154 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-ec8dd0bb-0d76-430d-9828-6e1e90b53f5b None None] MFA Rules not processed for user `62aad71c6c1a4469805762bba330bf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:28:50.914154 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-ec8dd0bb-0d76-430d-9828-6e1e90b53f5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:28:50.922026 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 807/1638] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:28:50 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 382 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:28:50.923077 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73ba5a4-eee2-4ba7-a121-aa7564b1346c None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:28:50.946290 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73ba5a4-eee2-4ba7-a121-aa7564b1346c None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:28:50.963132 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b8a910-b574-4c6a-8087-b9bc19998666 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97acd23097d54bf7805c3cef60626ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:28:50.963838 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b8a910-b574-4c6a-8087-b9bc19998666 service cinder] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:28:50.964124 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b8a910-b574-4c6a-8087-b9bc19998666 service cinder] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:28:50.964405 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b8a910-b574-4c6a-8087-b9bc19998666 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:28:51.049017 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:28:51.116340 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b8a910-b574-4c6a-8087-b9bc19998666 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:28:51.118154 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b8a910-b574-4c6a-8087-b9bc19998666 service cinder] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:28:51.138074 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 832/1639] 10.222.0.27 () {58 vars in 1009 bytes} [Tue Sep 13 15:28:50 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:28:51.159416 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 808/1640] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:28:50 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:28:51.234348 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32358048-7cad-4e11-ba3f-7d30c09c6a16 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:28:51.234670 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32358048-7cad-4e11-ba3f-7d30c09c6a16 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:28:51.234956 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32358048-7cad-4e11-ba3f-7d30c09c6a16 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:28:51.260334 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b8a910-b574-4c6a-8087-b9bc19998666 service cinder] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:28:51.261052 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 833/1641] 10.222.0.27 () {54 vars in 912 bytes} [Tue Sep 13 15:28:51 2022] GET /identity => generated 270 bytes in 28 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:28:51.267854 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59a959e-c2ba-455b-9b51-39a79006193d None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:28:51.268176 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59a959e-c2ba-455b-9b51-39a79006193d None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:28:51.268416 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59a959e-c2ba-455b-9b51-39a79006193d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:28:51.274926 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b8a910-b574-4c6a-8087-b9bc19998666 service cinder] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:28:51.289316 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3410d074-d03c-489f-9a53-8609cda23373 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97acd23097d54bf7805c3cef60626ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:28:51.291337 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3410d074-d03c-489f-9a53-8609cda23373 service cinder] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:28:51.295747 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3410d074-d03c-489f-9a53-8609cda23373 service cinder] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:28:51.296157 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3410d074-d03c-489f-9a53-8609cda23373 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:28:51.330851 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3410d074-d03c-489f-9a53-8609cda23373 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:28:51.332626 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3410d074-d03c-489f-9a53-8609cda23373 service cinder] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:28:51.338235 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-b59a959e-c2ba-455b-9b51-39a79006193d None None] MFA Rules not processed for user `62aad71c6c1a4469805762bba330bf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:28:51.342019 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-b59a959e-c2ba-455b-9b51-39a79006193d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:28:51.366572 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 809/1642] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:28:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:28:51.398921 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 834/1643] 10.222.0.27 () {58 vars in 1009 bytes} [Tue Sep 13 15:28:51 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:28:51.661728 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3410d074-d03c-489f-9a53-8609cda23373 service cinder] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:28:51.672818 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3410d074-d03c-489f-9a53-8609cda23373 service cinder] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:28:51.679652 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0b7b09-d6c3-4e4f-a0dd-d1501ccebd88 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97acd23097d54bf7805c3cef60626ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:28:51.680352 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0b7b09-d6c3-4e4f-a0dd-d1501ccebd88 service cinder] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:28:51.680663 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0b7b09-d6c3-4e4f-a0dd-d1501ccebd88 service cinder] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:28:51.681024 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0b7b09-d6c3-4e4f-a0dd-d1501ccebd88 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:28:51.707451 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0b7b09-d6c3-4e4f-a0dd-d1501ccebd88 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:28:51.714601 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0b7b09-d6c3-4e4f-a0dd-d1501ccebd88 service cinder] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:28:51.766569 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 810/1644] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:28:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:28:52.803344 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59a959e-c2ba-455b-9b51-39a79006193d None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:28:52.868202 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:28:53.017202 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59a959e-c2ba-455b-9b51-39a79006193d None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:28:53.034032 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0b7b09-d6c3-4e4f-a0dd-d1501ccebd88 service cinder] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:28:53.034905 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89cd16a-d1fd-48f6-8aeb-69fccecae9a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:28:53.034905 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89cd16a-d1fd-48f6-8aeb-69fccecae9a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:28:53.034905 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89cd16a-d1fd-48f6-8aeb-69fccecae9a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:28:53.034905 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89cd16a-d1fd-48f6-8aeb-69fccecae9a4 admin admin] PATH_INFO: `/v3/users/10122e2264cf418a9eb65ccf40249814` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:28:53.035213 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89cd16a-d1fd-48f6-8aeb-69fccecae9a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=10122e2264cf418a9eb65ccf40249814)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:28:53.036556 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89cd16a-d1fd-48f6-8aeb-69fccecae9a4 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:28:53.044331 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0b7b09-d6c3-4e4f-a0dd-d1501ccebd88 service cinder] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:28:53.079755 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6af331-795f-4c1f-9290-cc2e970be072 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97acd23097d54bf7805c3cef60626ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:28:53.082051 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6af331-795f-4c1f-9290-cc2e970be072 service cinder] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:28:53.084789 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6af331-795f-4c1f-9290-cc2e970be072 service cinder] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:28:53.085027 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6af331-795f-4c1f-9290-cc2e970be072 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:28:53.116223 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6af331-795f-4c1f-9290-cc2e970be072 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:28:53.121640 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6af331-795f-4c1f-9290-cc2e970be072 service cinder] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:28:53.134210 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-e89cd16a-d1fd-48f6-8aeb-69fccecae9a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10122e2264cf418a9eb65ccf40249814'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:28:53.136077 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-e89cd16a-d1fd-48f6-8aeb-69fccecae9a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10122e2264cf418a9eb65ccf40249814'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:28:53.138622 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-e89cd16a-d1fd-48f6-8aeb-69fccecae9a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10122e2264cf418a9eb65ccf40249814'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:28:53.154698 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-e89cd16a-d1fd-48f6-8aeb-69fccecae9a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10122e2264cf418a9eb65ccf40249814'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:28:53.156872 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 811/1645] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:28:53 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:28:53.190945 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-e89cd16a-d1fd-48f6-8aeb-69fccecae9a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10122e2264cf418a9eb65ccf40249814'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:28:53.235223 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 835/1646] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 13 15:28:52 2022] DELETE /identity/v3/users/10122e2264cf418a9eb65ccf40249814 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:28:53.240361 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47358193-8fda-411c-9fce-a61089bd5297 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:28:53.240657 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47358193-8fda-411c-9fce-a61089bd5297 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:28:53.240939 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47358193-8fda-411c-9fce-a61089bd5297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:28:53.284831 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-47358193-8fda-411c-9fce-a61089bd5297 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:28:53.286959 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-47358193-8fda-411c-9fce-a61089bd5297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:28:53.480802 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 812/1647] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:28:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:28:53.525680 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89cd16a-d1fd-48f6-8aeb-69fccecae9a4 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:28:53.527270 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-e89cd16a-d1fd-48f6-8aeb-69fccecae9a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:28:53.730181 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89cd16a-d1fd-48f6-8aeb-69fccecae9a4 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:28:53.752010 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6afb5d8-f48c-42af-9537-931d45c16848 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41675154bbba47388040966f75d84c3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:28:53.752770 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6afb5d8-f48c-42af-9537-931d45c16848 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:28:53.753258 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6afb5d8-f48c-42af-9537-931d45c16848 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:28:53.754316 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6afb5d8-f48c-42af-9537-931d45c16848 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:28:53.782525 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6afb5d8-f48c-42af-9537-931d45c16848 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:28:53.783954 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6afb5d8-f48c-42af-9537-931d45c16848 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:28:53.817458 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 836/1648] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:28:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:28:56.797240 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47358193-8fda-411c-9fce-a61089bd5297 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:28:56.807101 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-47358193-8fda-411c-9fce-a61089bd5297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:28:56.873518 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47358193-8fda-411c-9fce-a61089bd5297 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:28:56.884292 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf435c6a-3909-430a-a1e2-de62ba380357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:28:56.885134 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf435c6a-3909-430a-a1e2-de62ba380357 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:28:56.885585 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf435c6a-3909-430a-a1e2-de62ba380357 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:28:56.886038 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf435c6a-3909-430a-a1e2-de62ba380357 admin admin] PATH_INFO: `/v3/projects/5fa62ee10eff48dcabd21f47ae5acbe0` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:28:56.894021 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf435c6a-3909-430a-a1e2-de62ba380357 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5fa62ee10eff48dcabd21f47ae5acbe0)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:28:56.896891 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf435c6a-3909-430a-a1e2-de62ba380357 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:28:57.039234 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-cf435c6a-3909-430a-a1e2-de62ba380357 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5fa62ee10eff48dcabd21f47ae5acbe0', 'request_id': 'req-cf435c6a-3909-430a-a1e2-de62ba380357'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:28:57.062776 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-cf435c6a-3909-430a-a1e2-de62ba380357 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5fa62ee10eff48dcabd21f47ae5acbe0', 'request_id': 'req-cf435c6a-3909-430a-a1e2-de62ba380357'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:28:57.081684 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-cf435c6a-3909-430a-a1e2-de62ba380357 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5fa62ee10eff48dcabd21f47ae5acbe0', 'request_id': 'req-cf435c6a-3909-430a-a1e2-de62ba380357'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:28:57.116249 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-cf435c6a-3909-430a-a1e2-de62ba380357 admin admin] The token cache is being invalidate because project 5fa62ee10eff48dcabd21f47ae5acbe0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 15:28:57.116813 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-cf435c6a-3909-430a-a1e2-de62ba380357 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:28:57.117804 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-cf435c6a-3909-430a-a1e2-de62ba380357 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:28:57.123734 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 813/1649] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 13 15:28:56 2022] DELETE /identity/v3/projects/5fa62ee10eff48dcabd21f47ae5acbe0 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:28:57.125202 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb69f1bf-48ef-4e03-a713-e73278e64d57 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:28:57.125687 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb69f1bf-48ef-4e03-a713-e73278e64d57 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:28:57.125989 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb69f1bf-48ef-4e03-a713-e73278e64d57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:28:57.195176 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-bb69f1bf-48ef-4e03-a713-e73278e64d57 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:28:57.197202 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-bb69f1bf-48ef-4e03-a713-e73278e64d57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:28:57.367101 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:28:57.499052 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 837/1650] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:28:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:28:57.508500 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e01230b-196b-4dc7-a89a-4da5702f54da None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:28:57.509949 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e01230b-196b-4dc7-a89a-4da5702f54da None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:28:57.510274 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e01230b-196b-4dc7-a89a-4da5702f54da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:28:57.595213 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-9e01230b-196b-4dc7-a89a-4da5702f54da None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:28:57.595213 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-9e01230b-196b-4dc7-a89a-4da5702f54da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:28:57.636768 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb69f1bf-48ef-4e03-a713-e73278e64d57 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:28:57.636984 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 814/1651] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:28:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:28:57.662806 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb69f1bf-48ef-4e03-a713-e73278e64d57 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:28:57.682336 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef07809-2bee-4ad6-bc5a-789e3e995cba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:28:57.690033 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef07809-2bee-4ad6-bc5a-789e3e995cba admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:28:57.690631 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef07809-2bee-4ad6-bc5a-789e3e995cba admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:28:57.690930 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef07809-2bee-4ad6-bc5a-789e3e995cba admin admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:28:57.706053 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef07809-2bee-4ad6-bc5a-789e3e995cba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:28:57.706983 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef07809-2bee-4ad6-bc5a-789e3e995cba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:28:57.713324 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef07809-2bee-4ad6-bc5a-789e3e995cba admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:28:57.766947 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 838/1652] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Sep 13 15:28:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:28:57.771049 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e01230b-196b-4dc7-a89a-4da5702f54da None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:28:57.791826 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e01230b-196b-4dc7-a89a-4da5702f54da None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:28:57.809471 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5d6ce5-cdee-4c97-80b9-5c5e81141cb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:28:57.811488 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5d6ce5-cdee-4c97-80b9-5c5e81141cb1 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:28:57.811773 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5d6ce5-cdee-4c97-80b9-5c5e81141cb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:28:57.813532 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5d6ce5-cdee-4c97-80b9-5c5e81141cb1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:28:57.817672 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5d6ce5-cdee-4c97-80b9-5c5e81141cb1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:28:57.820186 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5d6ce5-cdee-4c97-80b9-5c5e81141cb1 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:28:57.854804 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:28:57.899910 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 815/1653] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 13 15:28:57 2022] POST /identity/v3/projects => generated 363 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:28:57.904905 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef07809-2bee-4ad6-bc5a-789e3e995cba admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:28:57.928372 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef07809-2bee-4ad6-bc5a-789e3e995cba admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:28:58.122042 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e381cd-ea80-4001-a1ba-33e3946e0204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:28:58.124175 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e381cd-ea80-4001-a1ba-33e3946e0204 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:28:58.126237 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e381cd-ea80-4001-a1ba-33e3946e0204 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:28:58.127288 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e381cd-ea80-4001-a1ba-33e3946e0204 admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:28:58.128872 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e381cd-ea80-4001-a1ba-33e3946e0204 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:28:58.138240 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e381cd-ea80-4001-a1ba-33e3946e0204 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:28:58.149492 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5d6ce5-cdee-4c97-80b9-5c5e81141cb1 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:28:58.151534 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-fd5d6ce5-cdee-4c97-80b9-5c5e81141cb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:28:58.177387 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5d6ce5-cdee-4c97-80b9-5c5e81141cb1 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:28:58.187448 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c89029-f4fd-47de-afe4-7830d4507f30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:28:58.189050 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c89029-f4fd-47de-afe4-7830d4507f30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:28:58.189574 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c89029-f4fd-47de-afe4-7830d4507f30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:28:58.190352 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c89029-f4fd-47de-afe4-7830d4507f30 admin admin] PATH_INFO: `/v3/users/4b3c5e5fb1d74c58b897b6b420685264` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:28:58.191955 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c89029-f4fd-47de-afe4-7830d4507f30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b3c5e5fb1d74c58b897b6b420685264)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:28:58.206759 dv-cinder-857434-2-smb devstack@keystone.service[81450]: WARNING py.warnings [None req-f1c89029-f4fd-47de-afe4-7830d4507f30 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 13 15:28:58.206759 dv-cinder-857434-2-smb devstack@keystone.service[81450]: warnings.warn(msg) Sep 13 15:28:58.206759 dv-cinder-857434-2-smb devstack@keystone.service[81450]: Sep 13 15:28:58.210470 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 839/1654] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 13 15:28:57 2022] POST /identity/v3/users => generated 282 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:28:58.212953 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c89029-f4fd-47de-afe4-7830d4507f30 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:28:58.225798 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e381cd-ea80-4001-a1ba-33e3946e0204 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:28:58.246903 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e381cd-ea80-4001-a1ba-33e3946e0204 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:28:58.263813 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a591e1-8b29-43ca-b05d-bcf937b8553f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:28:58.264974 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a591e1-8b29-43ca-b05d-bcf937b8553f admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:28:58.265340 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a591e1-8b29-43ca-b05d-bcf937b8553f admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:28:58.265695 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a591e1-8b29-43ca-b05d-bcf937b8553f admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:28:58.267391 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a591e1-8b29-43ca-b05d-bcf937b8553f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:28:58.272594 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a591e1-8b29-43ca-b05d-bcf937b8553f admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:28:58.315376 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 840/1655] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:28:58 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 15:28:58.319204 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a591e1-8b29-43ca-b05d-bcf937b8553f admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:28:58.344758 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a591e1-8b29-43ca-b05d-bcf937b8553f admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:28:58.374416 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cde3e3-37a7-4fb4-b01b-222a1d596881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:28:58.376166 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cde3e3-37a7-4fb4-b01b-222a1d596881 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:28:58.377222 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cde3e3-37a7-4fb4-b01b-222a1d596881 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:28:58.378789 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cde3e3-37a7-4fb4-b01b-222a1d596881 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:28:58.381595 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cde3e3-37a7-4fb4-b01b-222a1d596881 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:28:58.385211 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cde3e3-37a7-4fb4-b01b-222a1d596881 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:28:58.416770 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 841/1656] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:28:58 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 15:28:58.423245 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cde3e3-37a7-4fb4-b01b-222a1d596881 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:28:58.438604 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cde3e3-37a7-4fb4-b01b-222a1d596881 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:28:58.445441 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-f1c89029-f4fd-47de-afe4-7830d4507f30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b3c5e5fb1d74c58b897b6b420685264'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:28:58.446044 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9c8617-0164-4d87-b0d0-1b1984b0f439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:28:58.446948 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9c8617-0164-4d87-b0d0-1b1984b0f439 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:28:58.447426 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9c8617-0164-4d87-b0d0-1b1984b0f439 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:28:58.447966 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9c8617-0164-4d87-b0d0-1b1984b0f439 admin admin] PATH_INFO: `/v3/projects/0136a24dbc324417ace7dccec88f42f7/users/751c7fa792ac4769855fc2e69096e1b5/roles/3fae3d3a28e147d3b2bede2378ff79ae` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:28:58.450239 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-f1c89029-f4fd-47de-afe4-7830d4507f30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b3c5e5fb1d74c58b897b6b420685264'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:28:58.454095 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-f1c89029-f4fd-47de-afe4-7830d4507f30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b3c5e5fb1d74c58b897b6b420685264'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:28:58.474422 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9c8617-0164-4d87-b0d0-1b1984b0f439 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0136a24dbc324417ace7dccec88f42f7, user_id=751c7fa792ac4769855fc2e69096e1b5, role_id=3fae3d3a28e147d3b2bede2378ff79ae)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:28:58.480341 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9c8617-0164-4d87-b0d0-1b1984b0f439 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:28:58.507086 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-f1c89029-f4fd-47de-afe4-7830d4507f30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b3c5e5fb1d74c58b897b6b420685264'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:28:58.537466 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 842/1657] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 13 15:28:58 2022] PUT /identity/v3/projects/0136a24dbc324417ace7dccec88f42f7/users/751c7fa792ac4769855fc2e69096e1b5/roles/3fae3d3a28e147d3b2bede2378ff79ae => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:28:58.539569 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60a6c6a-3598-411b-bacf-301d8ad63403 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:28:58.540018 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60a6c6a-3598-411b-bacf-301d8ad63403 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:28:58.540429 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60a6c6a-3598-411b-bacf-301d8ad63403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:28:58.575277 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-f1c89029-f4fd-47de-afe4-7830d4507f30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b3c5e5fb1d74c58b897b6b420685264'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:28:58.615465 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 816/1658] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 13 15:28:58 2022] DELETE /identity/v3/users/4b3c5e5fb1d74c58b897b6b420685264 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 15:28:58.616661 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c89029-f4fd-47de-afe4-7830d4507f30 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:28:58.619090 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-c60a6c6a-3598-411b-bacf-301d8ad63403 None None] MFA Rules not processed for user `751c7fa792ac4769855fc2e69096e1b5`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:28:58.620949 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-f1c89029-f4fd-47de-afe4-7830d4507f30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:28:58.622621 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-c60a6c6a-3598-411b-bacf-301d8ad63403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:28:58.834717 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:28:58.850942 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 843/1659] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:28:58 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:28:58.874803 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223209ef-6c9b-4bdc-bbaa-d306869facb9 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:28:58.875232 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223209ef-6c9b-4bdc-bbaa-d306869facb9 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:28:58.875515 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223209ef-6c9b-4bdc-bbaa-d306869facb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:28:58.892433 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c89029-f4fd-47de-afe4-7830d4507f30 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:28:58.909397 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfa52a2-8dcc-4cbd-a6e6-f5ca594fa659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:28:58.910111 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfa52a2-8dcc-4cbd-a6e6-f5ca594fa659 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:28:58.910400 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfa52a2-8dcc-4cbd-a6e6-f5ca594fa659 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:28:58.910681 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfa52a2-8dcc-4cbd-a6e6-f5ca594fa659 admin admin] PATH_INFO: `/v3/users/3380dfec771d40f1828a463aa355b293` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:28:58.912755 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfa52a2-8dcc-4cbd-a6e6-f5ca594fa659 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3380dfec771d40f1828a463aa355b293)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:28:58.915044 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfa52a2-8dcc-4cbd-a6e6-f5ca594fa659 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:28:58.941213 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-223209ef-6c9b-4bdc-bbaa-d306869facb9 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:28:58.942533 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-223209ef-6c9b-4bdc-bbaa-d306869facb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:28:59.010353 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 844/1660] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:28:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:28:59.011248 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223209ef-6c9b-4bdc-bbaa-d306869facb9 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:28:59.014392 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-223209ef-6c9b-4bdc-bbaa-d306869facb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:28:59.049654 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223209ef-6c9b-4bdc-bbaa-d306869facb9 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:28:59.056038 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-5bfa52a2-8dcc-4cbd-a6e6-f5ca594fa659 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3380dfec771d40f1828a463aa355b293'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:28:59.059100 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-5bfa52a2-8dcc-4cbd-a6e6-f5ca594fa659 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3380dfec771d40f1828a463aa355b293'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:28:59.059340 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ab269f-752a-444e-bef9-ef657157a31e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:28:59.060168 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ab269f-752a-444e-bef9-ef657157a31e admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:28:59.060296 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ab269f-752a-444e-bef9-ef657157a31e admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:28:59.060503 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ab269f-752a-444e-bef9-ef657157a31e admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:28:59.061140 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ab269f-752a-444e-bef9-ef657157a31e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:28:59.063520 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ab269f-752a-444e-bef9-ef657157a31e admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:28:59.064689 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-5bfa52a2-8dcc-4cbd-a6e6-f5ca594fa659 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3380dfec771d40f1828a463aa355b293'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:28:59.097427 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-5bfa52a2-8dcc-4cbd-a6e6-f5ca594fa659 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3380dfec771d40f1828a463aa355b293'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:28:59.124648 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=80,keystone:INSERT=2,keystone:DELETE=18 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:28:59.147207 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-5bfa52a2-8dcc-4cbd-a6e6-f5ca594fa659 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3380dfec771d40f1828a463aa355b293'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:28:59.155221 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 845/1661] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 13 15:28:59 2022] POST /identity/v3/projects => generated 365 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:28:59.159536 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ab269f-752a-444e-bef9-ef657157a31e admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:28:59.169100 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-74ab269f-752a-444e-bef9-ef657157a31e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:28:59.185517 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 817/1662] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 13 15:28:58 2022] DELETE /identity/v3/users/3380dfec771d40f1828a463aa355b293 => generated 0 bytes in 569 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:28:59.188566 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfa52a2-8dcc-4cbd-a6e6-f5ca594fa659 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:28:59.198744 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-5bfa52a2-8dcc-4cbd-a6e6-f5ca594fa659 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:28:59.435824 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ab269f-752a-444e-bef9-ef657157a31e admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:28:59.456983 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfa52a2-8dcc-4cbd-a6e6-f5ca594fa659 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:28:59.478560 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36bbc54-45cd-4399-b355-4d2e1ce42344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:28:59.493131 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36bbc54-45cd-4399-b355-4d2e1ce42344 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:28:59.493131 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36bbc54-45cd-4399-b355-4d2e1ce42344 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:28:59.493131 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36bbc54-45cd-4399-b355-4d2e1ce42344 admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:28:59.493131 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36bbc54-45cd-4399-b355-4d2e1ce42344 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:28:59.493131 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36bbc54-45cd-4399-b355-4d2e1ce42344 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:28:59.549574 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 818/1663] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 13 15:28:59 2022] POST /identity/v3/users => generated 289 bytes in 361 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:28:59.553582 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8ee1c5-b5c2-4bca-be85-c14961adc624 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:28:59.554019 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8ee1c5-b5c2-4bca-be85-c14961adc624 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:28:59.554365 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8ee1c5-b5c2-4bca-be85-c14961adc624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:28:59.584862 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb8a494-8f0e-4a57-a2fd-c5c7464905bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41675154bbba47388040966f75d84c3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:28:59.586251 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb8a494-8f0e-4a57-a2fd-c5c7464905bb service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:28:59.589199 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb8a494-8f0e-4a57-a2fd-c5c7464905bb service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:28:59.589949 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb8a494-8f0e-4a57-a2fd-c5c7464905bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:28:59.597964 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-acb8a494-8f0e-4a57-a2fd-c5c7464905bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:28:59.623848 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-9f8ee1c5-b5c2-4bca-be85-c14961adc624 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:28:59.626915 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-9f8ee1c5-b5c2-4bca-be85-c14961adc624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:28:59.658176 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb8a494-8f0e-4a57-a2fd-c5c7464905bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:28:59.659274 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 819/1664] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:28:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:28:59.663676 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8ee1c5-b5c2-4bca-be85-c14961adc624 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:28:59.664117 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb8a494-8f0e-4a57-a2fd-c5c7464905bb service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:28:59.704285 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8ee1c5-b5c2-4bca-be85-c14961adc624 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:28:59.711292 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 846/1665] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:28:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 551 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:28:59.711292 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb8a494-8f0e-4a57-a2fd-c5c7464905bb service neutron] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:28:59.722165 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8270c85-dac1-4d23-b8a2-eaf7b739b9d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:28:59.722165 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8270c85-dac1-4d23-b8a2-eaf7b739b9d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:28:59.722165 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8270c85-dac1-4d23-b8a2-eaf7b739b9d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:28:59.722165 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8270c85-dac1-4d23-b8a2-eaf7b739b9d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:28:59.722581 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8270c85-dac1-4d23-b8a2-eaf7b739b9d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:28:59.726665 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8270c85-dac1-4d23-b8a2-eaf7b739b9d4 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:28:59.732927 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb8a494-8f0e-4a57-a2fd-c5c7464905bb service neutron] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:28:59.741671 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd5d357-7ed1-4d86-a460-d8b2d4274cf1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41675154bbba47388040966f75d84c3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:28:59.743970 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd5d357-7ed1-4d86-a460-d8b2d4274cf1 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:28:59.744255 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd5d357-7ed1-4d86-a460-d8b2d4274cf1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:28:59.744529 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd5d357-7ed1-4d86-a460-d8b2d4274cf1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:28:59.753440 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 820/1666] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:28:59 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 15:28:59.756775 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8270c85-dac1-4d23-b8a2-eaf7b739b9d4 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:28:59.769119 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd5d357-7ed1-4d86-a460-d8b2d4274cf1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:28:59.771581 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd5d357-7ed1-4d86-a460-d8b2d4274cf1 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:28:59.785638 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8270c85-dac1-4d23-b8a2-eaf7b739b9d4 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:28:59.785847 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 847/1667] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:28:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:28:59.794587 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840cff45-bb95-489e-b225-d4aeaade36a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:28:59.795523 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840cff45-bb95-489e-b225-d4aeaade36a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:28:59.796162 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840cff45-bb95-489e-b225-d4aeaade36a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:28:59.797432 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840cff45-bb95-489e-b225-d4aeaade36a2 admin admin] PATH_INFO: `/v3/projects/2c7ce4f5290e445eb69f378dc77b3940/users/5adb0e0b2dcb45e59a1d5ad892a5f6b4/roles/f34412ad29f1478cba775b033129f71f` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:28:59.818038 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840cff45-bb95-489e-b225-d4aeaade36a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c7ce4f5290e445eb69f378dc77b3940, user_id=5adb0e0b2dcb45e59a1d5ad892a5f6b4, role_id=f34412ad29f1478cba775b033129f71f)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:28:59.821545 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840cff45-bb95-489e-b225-d4aeaade36a2 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:28:59.854556 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 821/1668] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 13 15:28:59 2022] PUT /identity/v3/projects/2c7ce4f5290e445eb69f378dc77b3940/users/5adb0e0b2dcb45e59a1d5ad892a5f6b4/roles/f34412ad29f1478cba775b033129f71f => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:28:59.858774 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd5d357-7ed1-4d86-a460-d8b2d4274cf1 service neutron] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:28:59.874856 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd5d357-7ed1-4d86-a460-d8b2d4274cf1 service neutron] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:28:59.982182 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf5fb88-8dfc-4a40-9aac-b0b46cf4f7c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:28:59.983098 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf5fb88-8dfc-4a40-9aac-b0b46cf4f7c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:28:59.983585 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf5fb88-8dfc-4a40-9aac-b0b46cf4f7c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:28:59.984265 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf5fb88-8dfc-4a40-9aac-b0b46cf4f7c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:28:59.985080 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf5fb88-8dfc-4a40-9aac-b0b46cf4f7c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:28:59.987861 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf5fb88-8dfc-4a40-9aac-b0b46cf4f7c0 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:00.004488 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 848/1669] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:28:59 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 15:29:00.008726 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840cff45-bb95-489e-b225-d4aeaade36a2 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:00.020737 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840cff45-bb95-489e-b225-d4aeaade36a2 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:00.028105 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bd13c6-5c7d-4e3a-92bf-066caac40c3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:00.029604 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bd13c6-5c7d-4e3a-92bf-066caac40c3f admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:00.030460 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bd13c6-5c7d-4e3a-92bf-066caac40c3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:00.030979 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bd13c6-5c7d-4e3a-92bf-066caac40c3f admin admin] PATH_INFO: `/v3/projects/2c7ce4f5290e445eb69f378dc77b3940/users/5adb0e0b2dcb45e59a1d5ad892a5f6b4/roles/f34412ad29f1478cba775b033129f71f` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:00.035085 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bd13c6-5c7d-4e3a-92bf-066caac40c3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c7ce4f5290e445eb69f378dc77b3940, user_id=5adb0e0b2dcb45e59a1d5ad892a5f6b4, role_id=f34412ad29f1478cba775b033129f71f)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:00.039161 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bd13c6-5c7d-4e3a-92bf-066caac40c3f admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:00.065054 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 822/1670] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 13 15:29:00 2022] PUT /identity/v3/projects/2c7ce4f5290e445eb69f378dc77b3940/users/5adb0e0b2dcb45e59a1d5ad892a5f6b4/roles/f34412ad29f1478cba775b033129f71f => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:29:00.066405 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ef3642-d358-4ce9-adda-fa519e253375 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:00.066723 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ef3642-d358-4ce9-adda-fa519e253375 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:00.066964 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ef3642-d358-4ce9-adda-fa519e253375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:00.102791 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:29:00.114199 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-47ef3642-d358-4ce9-adda-fa519e253375 None None] MFA Rules not processed for user `5adb0e0b2dcb45e59a1d5ad892a5f6b4`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:29:00.115906 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-47ef3642-d358-4ce9-adda-fa519e253375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:00.168871 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b26ec0-fcd7-4fbb-9bc4-577e857dfb87 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:00.169247 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b26ec0-fcd7-4fbb-9bc4-577e857dfb87 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:00.169750 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b26ec0-fcd7-4fbb-9bc4-577e857dfb87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:00.222911 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 849/1671] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:29:00 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:29:00.236401 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-f0b26ec0-fcd7-4fbb-9bc4-577e857dfb87 None None] MFA Rules not processed for user `7d103d2fe211474ab70df0aac0632c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:29:00.238004 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-f0b26ec0-fcd7-4fbb-9bc4-577e857dfb87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:00.240806 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ef3642-d358-4ce9-adda-fa519e253375 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:00.244646 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-47ef3642-d358-4ce9-adda-fa519e253375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:00.375939 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ef3642-d358-4ce9-adda-fa519e253375 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:00.388928 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 823/1672] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:29:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:29:00.390894 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22551885-576d-4414-929c-bd8161160754 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:00.391188 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22551885-576d-4414-929c-bd8161160754 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:00.391470 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22551885-576d-4414-929c-bd8161160754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:00.398420 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6175b0b-1517-47d3-ba10-41447b753ce7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97acd23097d54bf7805c3cef60626ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:00.399062 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6175b0b-1517-47d3-ba10-41447b753ce7 service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:00.399348 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6175b0b-1517-47d3-ba10-41447b753ce7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:00.399627 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6175b0b-1517-47d3-ba10-41447b753ce7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:00.427033 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=92,keystone:DELETE=2,keystone:INSERT=6 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:29:00.444919 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-22551885-576d-4414-929c-bd8161160754 None None] MFA Rules not processed for user `7d103d2fe211474ab70df0aac0632c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:29:00.447211 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-22551885-576d-4414-929c-bd8161160754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:00.451299 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6175b0b-1517-47d3-ba10-41447b753ce7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:00.456290 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6175b0b-1517-47d3-ba10-41447b753ce7 service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:00.476892 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 824/1673] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:29:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:29:00.483585 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22551885-576d-4414-929c-bd8161160754 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:00.485311 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-22551885-576d-4414-929c-bd8161160754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:00.488291 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 850/1674] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:29:00 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:29:00.638176 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6175b0b-1517-47d3-ba10-41447b753ce7 service cinder] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:00.650362 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6175b0b-1517-47d3-ba10-41447b753ce7 service cinder] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:00.662081 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510957d1-6227-4aa4-b801-097625d6f2c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97acd23097d54bf7805c3cef60626ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:00.664174 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510957d1-6227-4aa4-b801-097625d6f2c8 service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:00.664557 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510957d1-6227-4aa4-b801-097625d6f2c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:00.665731 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510957d1-6227-4aa4-b801-097625d6f2c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:00.675420 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-510957d1-6227-4aa4-b801-097625d6f2c8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:00.698604 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22551885-576d-4414-929c-bd8161160754 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:00.736118 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2578ca27-c533-492c-9eba-793813ff5246 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62aad71c6c1a4469805762bba330bf0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:00.737727 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2578ca27-c533-492c-9eba-793813ff5246 service nova] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:00.742372 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2578ca27-c533-492c-9eba-793813ff5246 service nova] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:00.743083 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2578ca27-c533-492c-9eba-793813ff5246 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:00.766632 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2578ca27-c533-492c-9eba-793813ff5246 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:00.768777 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2578ca27-c533-492c-9eba-793813ff5246 service nova] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:00.811043 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 825/1675] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:29:00 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:29:00.907164 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510957d1-6227-4aa4-b801-097625d6f2c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:00.911403 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510957d1-6227-4aa4-b801-097625d6f2c8 service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:00.924295 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 851/1676] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:29:00 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:29:01.421239 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2578ca27-c533-492c-9eba-793813ff5246 service nova] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:01.433072 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-2578ca27-c533-492c-9eba-793813ff5246 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:01.565772 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2578ca27-c533-492c-9eba-793813ff5246 service nova] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:01.573416 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e628770b-dbce-49b9-8488-fbbe3283cc85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:01.574055 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e628770b-dbce-49b9-8488-fbbe3283cc85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:01.574334 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e628770b-dbce-49b9-8488-fbbe3283cc85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:01.574617 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e628770b-dbce-49b9-8488-fbbe3283cc85 admin admin] PATH_INFO: `/v3/projects/586040c6a539435eb5a3c601601f1fba` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:01.575853 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e628770b-dbce-49b9-8488-fbbe3283cc85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=586040c6a539435eb5a3c601601f1fba)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:01.579519 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e628770b-dbce-49b9-8488-fbbe3283cc85 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:01.654372 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-e628770b-dbce-49b9-8488-fbbe3283cc85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '586040c6a539435eb5a3c601601f1fba', 'request_id': 'req-e628770b-dbce-49b9-8488-fbbe3283cc85'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:01.663033 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-e628770b-dbce-49b9-8488-fbbe3283cc85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '586040c6a539435eb5a3c601601f1fba', 'request_id': 'req-e628770b-dbce-49b9-8488-fbbe3283cc85'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:01.671967 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-e628770b-dbce-49b9-8488-fbbe3283cc85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '586040c6a539435eb5a3c601601f1fba', 'request_id': 'req-e628770b-dbce-49b9-8488-fbbe3283cc85'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:01.697845 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-e628770b-dbce-49b9-8488-fbbe3283cc85 admin admin] The token cache is being invalidate because project 586040c6a539435eb5a3c601601f1fba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 15:29:01.698168 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-e628770b-dbce-49b9-8488-fbbe3283cc85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:01.699846 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-e628770b-dbce-49b9-8488-fbbe3283cc85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:01.705426 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 826/1677] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 13 15:29:01 2022] DELETE /identity/v3/projects/586040c6a539435eb5a3c601601f1fba => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:29:01.711243 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d826fb-1928-49ac-810e-b644a06f0336 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:01.712164 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d826fb-1928-49ac-810e-b644a06f0336 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:01.713279 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d826fb-1928-49ac-810e-b644a06f0336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:01.745838 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-97d826fb-1928-49ac-810e-b644a06f0336 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:29:01.747482 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-97d826fb-1928-49ac-810e-b644a06f0336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:01.786644 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e628770b-dbce-49b9-8488-fbbe3283cc85 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:01.789512 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-e628770b-dbce-49b9-8488-fbbe3283cc85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:01.850996 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:29:01.876768 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:29:01.921510 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 852/1678] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:29:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:29:01.923266 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaee7eb-1de0-46fc-b10b-9d5689383821 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:01.924654 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaee7eb-1de0-46fc-b10b-9d5689383821 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:01.924654 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaee7eb-1de0-46fc-b10b-9d5689383821 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:01.968913 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-beaee7eb-1de0-46fc-b10b-9d5689383821 None None] MFA Rules not processed for user `7fe1e310cd5b4506bc6e10a2f5742cbb`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:29:01.972106 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-beaee7eb-1de0-46fc-b10b-9d5689383821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:02.018921 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e628770b-dbce-49b9-8488-fbbe3283cc85 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:02.033853 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9280d5d-1dd8-40da-80c2-5eadfe61ac8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:02.035127 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9280d5d-1dd8-40da-80c2-5eadfe61ac8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:02.038026 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9280d5d-1dd8-40da-80c2-5eadfe61ac8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:02.038883 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9280d5d-1dd8-40da-80c2-5eadfe61ac8d admin admin] PATH_INFO: `/v3/projects/c9ca543ab03a415c994cebe4735b663d` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:02.043682 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9280d5d-1dd8-40da-80c2-5eadfe61ac8d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9ca543ab03a415c994cebe4735b663d)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:02.050270 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9280d5d-1dd8-40da-80c2-5eadfe61ac8d admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:02.163975 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 853/1679] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:29:01 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:29:02.167535 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f88be41-cd6a-4201-9cab-05c916feba85 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:02.168616 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f88be41-cd6a-4201-9cab-05c916feba85 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:02.169604 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f88be41-cd6a-4201-9cab-05c916feba85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:02.175384 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-b9280d5d-1dd8-40da-80c2-5eadfe61ac8d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9ca543ab03a415c994cebe4735b663d', 'request_id': 'req-b9280d5d-1dd8-40da-80c2-5eadfe61ac8d'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:02.190882 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-b9280d5d-1dd8-40da-80c2-5eadfe61ac8d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9ca543ab03a415c994cebe4735b663d', 'request_id': 'req-b9280d5d-1dd8-40da-80c2-5eadfe61ac8d'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:02.196742 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-b9280d5d-1dd8-40da-80c2-5eadfe61ac8d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9ca543ab03a415c994cebe4735b663d', 'request_id': 'req-b9280d5d-1dd8-40da-80c2-5eadfe61ac8d'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:02.214497 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-5f88be41-cd6a-4201-9cab-05c916feba85 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:29:02.215860 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-5f88be41-cd6a-4201-9cab-05c916feba85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:02.224936 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-b9280d5d-1dd8-40da-80c2-5eadfe61ac8d admin admin] The token cache is being invalidate because project c9ca543ab03a415c994cebe4735b663d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 15:29:02.226146 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-b9280d5d-1dd8-40da-80c2-5eadfe61ac8d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:02.227823 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-b9280d5d-1dd8-40da-80c2-5eadfe61ac8d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:02.231272 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 827/1680] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 13 15:29:01 2022] DELETE /identity/v3/projects/c9ca543ab03a415c994cebe4735b663d => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 15:29:02.234983 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485b075b-f70c-4432-9f01-9fa32c3a02ac None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:02.235367 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485b075b-f70c-4432-9f01-9fa32c3a02ac None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:02.236313 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485b075b-f70c-4432-9f01-9fa32c3a02ac None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:02.246535 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 828/1681] 10.222.0.27 () {54 vars in 912 bytes} [Tue Sep 13 15:29:02 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:29:02.248652 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485b075b-f70c-4432-9f01-9fa32c3a02ac None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:02.253847 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-485b075b-f70c-4432-9f01-9fa32c3a02ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:02.316120 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 854/1682] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:29:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:29:02.318311 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f88be41-cd6a-4201-9cab-05c916feba85 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:02.320642 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-5f88be41-cd6a-4201-9cab-05c916feba85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:02.336744 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f88be41-cd6a-4201-9cab-05c916feba85 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:02.342637 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89faa66-aff9-4aee-8c0c-04254eca3ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:02.343461 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89faa66-aff9-4aee-8c0c-04254eca3ab6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:02.343892 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89faa66-aff9-4aee-8c0c-04254eca3ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:02.344316 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89faa66-aff9-4aee-8c0c-04254eca3ab6 admin admin] PATH_INFO: `/v3/users/574f50585b514fa5b358579355f6004f` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:02.346974 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89faa66-aff9-4aee-8c0c-04254eca3ab6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=574f50585b514fa5b358579355f6004f)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:02.350970 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89faa66-aff9-4aee-8c0c-04254eca3ab6 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:02.457234 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-d89faa66-aff9-4aee-8c0c-04254eca3ab6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '574f50585b514fa5b358579355f6004f'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:02.458729 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-d89faa66-aff9-4aee-8c0c-04254eca3ab6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '574f50585b514fa5b358579355f6004f'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:02.461941 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-d89faa66-aff9-4aee-8c0c-04254eca3ab6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '574f50585b514fa5b358579355f6004f'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:02.472514 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485b075b-f70c-4432-9f01-9fa32c3a02ac None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:02.486654 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-d89faa66-aff9-4aee-8c0c-04254eca3ab6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '574f50585b514fa5b358579355f6004f'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:02.500739 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dd9154-deff-45a4-8293-51bbd8f06c44 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62aad71c6c1a4469805762bba330bf0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:02.501819 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dd9154-deff-45a4-8293-51bbd8f06c44 service nova] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:02.502117 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dd9154-deff-45a4-8293-51bbd8f06c44 service nova] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:02.502398 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dd9154-deff-45a4-8293-51bbd8f06c44 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:02.503014 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:29:02.512188 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-57dd9154-deff-45a4-8293-51bbd8f06c44 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:02.525662 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-d89faa66-aff9-4aee-8c0c-04254eca3ab6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '574f50585b514fa5b358579355f6004f'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:02.566463 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 855/1683] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 13 15:29:02 2022] DELETE /identity/v3/users/574f50585b514fa5b358579355f6004f => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:29:02.575153 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c87d03d-ba82-4215-bb19-a00b1fad2eab None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:02.575459 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c87d03d-ba82-4215-bb19-a00b1fad2eab None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:02.575742 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c87d03d-ba82-4215-bb19-a00b1fad2eab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:02.689996 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:29:02.711359 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-3c87d03d-ba82-4215-bb19-a00b1fad2eab None None] MFA Rules not processed for user `41675154bbba47388040966f75d84c3c`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:29:02.712679 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-3c87d03d-ba82-4215-bb19-a00b1fad2eab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:02.739808 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dd9154-deff-45a4-8293-51bbd8f06c44 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:02.744309 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dd9154-deff-45a4-8293-51bbd8f06c44 service nova] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:02.789056 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 829/1684] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:29:02 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 542 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:29:02.792602 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dd9154-deff-45a4-8293-51bbd8f06c44 service nova] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:02.798306 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-57dd9154-deff-45a4-8293-51bbd8f06c44 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:02.863374 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dd9154-deff-45a4-8293-51bbd8f06c44 service nova] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:02.954666 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 856/1685] 10.222.0.27 () {58 vars in 1009 bytes} [Tue Sep 13 15:29:02 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 387 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:29:03.007655 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c87d03d-ba82-4215-bb19-a00b1fad2eab None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:03.012297 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-3c87d03d-ba82-4215-bb19-a00b1fad2eab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:03.048253 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5851738-dd8a-40ca-9e9a-6ae14b6a4656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:03.049590 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c87d03d-ba82-4215-bb19-a00b1fad2eab None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:03.050896 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5851738-dd8a-40ca-9e9a-6ae14b6a4656 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:03.051496 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5851738-dd8a-40ca-9e9a-6ae14b6a4656 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:03.053732 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5851738-dd8a-40ca-9e9a-6ae14b6a4656 admin admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:03.055433 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5851738-dd8a-40ca-9e9a-6ae14b6a4656 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:29:03.056587 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5851738-dd8a-40ca-9e9a-6ae14b6a4656 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:03.057141 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55056490-2d83-4b2b-a734-57fc61306bb7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41675154bbba47388040966f75d84c3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:03.058023 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55056490-2d83-4b2b-a734-57fc61306bb7 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:03.058246 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55056490-2d83-4b2b-a734-57fc61306bb7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:03.058517 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55056490-2d83-4b2b-a734-57fc61306bb7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:03.061459 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5851738-dd8a-40ca-9e9a-6ae14b6a4656 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:03.084418 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55056490-2d83-4b2b-a734-57fc61306bb7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:03.097018 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 830/1686] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Sep 13 15:29:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:29:03.099134 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5851738-dd8a-40ca-9e9a-6ae14b6a4656 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:03.099433 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55056490-2d83-4b2b-a734-57fc61306bb7 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:03.130509 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5851738-dd8a-40ca-9e9a-6ae14b6a4656 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:03.147280 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7e8469-e35b-4173-b105-2ba9ce59394e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:03.147924 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7e8469-e35b-4173-b105-2ba9ce59394e admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:03.148280 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7e8469-e35b-4173-b105-2ba9ce59394e admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:03.149041 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7e8469-e35b-4173-b105-2ba9ce59394e admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:03.149312 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7e8469-e35b-4173-b105-2ba9ce59394e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:03.151763 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7e8469-e35b-4173-b105-2ba9ce59394e admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:03.159967 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 857/1687] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:29:03 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:29:03.160999 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55056490-2d83-4b2b-a734-57fc61306bb7 service neutron] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:03.168254 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-55056490-2d83-4b2b-a734-57fc61306bb7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:03.225364 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 831/1688] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 13 15:29:03 2022] POST /identity/v3/projects => generated 357 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 15:29:03.232098 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7e8469-e35b-4173-b105-2ba9ce59394e admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:03.232634 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55056490-2d83-4b2b-a734-57fc61306bb7 service neutron] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:03.415959 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7e8469-e35b-4173-b105-2ba9ce59394e admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:03.426120 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82e247c-8e77-4560-bafe-02cfb35bdb09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:03.433327 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228d4bf2-3043-4900-bcd1-9e0063fa1adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:03.434331 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82e247c-8e77-4560-bafe-02cfb35bdb09 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:03.434745 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82e247c-8e77-4560-bafe-02cfb35bdb09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:03.435034 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82e247c-8e77-4560-bafe-02cfb35bdb09 admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:03.436392 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228d4bf2-3043-4900-bcd1-9e0063fa1adf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:03.436392 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228d4bf2-3043-4900-bcd1-9e0063fa1adf admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:03.436620 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228d4bf2-3043-4900-bcd1-9e0063fa1adf admin admin] PATH_INFO: `/v3/projects/4fa72cc7370e41eba2d897de6d0b48ee` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:03.438599 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82e247c-8e77-4560-bafe-02cfb35bdb09 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:03.441747 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228d4bf2-3043-4900-bcd1-9e0063fa1adf admin admin] RBAC: Authorizing `identity:delete_project(project_id=4fa72cc7370e41eba2d897de6d0b48ee)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:03.442255 dv-cinder-857434-2-smb devstack@keystone.service[81449]: WARNING py.warnings [None req-228d4bf2-3043-4900-bcd1-9e0063fa1adf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 13 15:29:03.442255 dv-cinder-857434-2-smb devstack@keystone.service[81449]: warnings.warn(msg) Sep 13 15:29:03.442255 dv-cinder-857434-2-smb devstack@keystone.service[81449]: Sep 13 15:29:03.444095 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82e247c-8e77-4560-bafe-02cfb35bdb09 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:03.446103 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228d4bf2-3043-4900-bcd1-9e0063fa1adf admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:03.511279 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 832/1689] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 13 15:29:03 2022] POST /identity/v3/users => generated 279 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:29:03.516688 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82e247c-8e77-4560-bafe-02cfb35bdb09 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:03.565588 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82e247c-8e77-4560-bafe-02cfb35bdb09 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:03.596221 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285bfdd2-4979-4c6d-ab53-638689e6c8b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:03.603873 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285bfdd2-4979-4c6d-ab53-638689e6c8b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:03.604780 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285bfdd2-4979-4c6d-ab53-638689e6c8b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:03.605070 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285bfdd2-4979-4c6d-ab53-638689e6c8b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:03.605776 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285bfdd2-4979-4c6d-ab53-638689e6c8b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:03.607417 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285bfdd2-4979-4c6d-ab53-638689e6c8b7 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:03.664872 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-228d4bf2-3043-4900-bcd1-9e0063fa1adf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4fa72cc7370e41eba2d897de6d0b48ee', 'request_id': 'req-228d4bf2-3043-4900-bcd1-9e0063fa1adf'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:03.698326 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 833/1690] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:29:03 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 15:29:03.699106 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285bfdd2-4979-4c6d-ab53-638689e6c8b7 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:03.713012 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-285bfdd2-4979-4c6d-ab53-638689e6c8b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:03.732481 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-228d4bf2-3043-4900-bcd1-9e0063fa1adf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4fa72cc7370e41eba2d897de6d0b48ee', 'request_id': 'req-228d4bf2-3043-4900-bcd1-9e0063fa1adf'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:03.741795 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285bfdd2-4979-4c6d-ab53-638689e6c8b7 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:03.752698 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-228d4bf2-3043-4900-bcd1-9e0063fa1adf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4fa72cc7370e41eba2d897de6d0b48ee', 'request_id': 'req-228d4bf2-3043-4900-bcd1-9e0063fa1adf'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:03.771580 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=90,keystone:DELETE=8,keystone:INSERT=2 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:29:03.796083 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-228d4bf2-3043-4900-bcd1-9e0063fa1adf admin admin] The token cache is being invalidate because project 4fa72cc7370e41eba2d897de6d0b48ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 15:29:03.796552 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-228d4bf2-3043-4900-bcd1-9e0063fa1adf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:03.797436 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-228d4bf2-3043-4900-bcd1-9e0063fa1adf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:03.802881 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 858/1691] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 13 15:29:03 2022] DELETE /identity/v3/projects/4fa72cc7370e41eba2d897de6d0b48ee => generated 0 bytes in 639 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:29:03.804333 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228d4bf2-3043-4900-bcd1-9e0063fa1adf admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:03.811103 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-228d4bf2-3043-4900-bcd1-9e0063fa1adf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:03.845155 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:29:03.916490 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159ed7b1-cc7d-4720-b1e5-157028222961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:03.919008 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159ed7b1-cc7d-4720-b1e5-157028222961 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:03.919845 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159ed7b1-cc7d-4720-b1e5-157028222961 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:03.924166 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159ed7b1-cc7d-4720-b1e5-157028222961 admin admin] PATH_INFO: `/v3/users/0f80c49b77d1446d9ff42c5c4ddc82a8` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:03.924166 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159ed7b1-cc7d-4720-b1e5-157028222961 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f80c49b77d1446d9ff42c5c4ddc82a8)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:03.927010 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159ed7b1-cc7d-4720-b1e5-157028222961 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:03.976496 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228d4bf2-3043-4900-bcd1-9e0063fa1adf admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:04.005549 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fafa78-65a4-4cc1-8e58-b62d9e2fb4ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:04.006671 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fafa78-65a4-4cc1-8e58-b62d9e2fb4ab admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:04.010139 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fafa78-65a4-4cc1-8e58-b62d9e2fb4ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:04.010802 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fafa78-65a4-4cc1-8e58-b62d9e2fb4ab admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:04.014746 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fafa78-65a4-4cc1-8e58-b62d9e2fb4ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:04.023155 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fafa78-65a4-4cc1-8e58-b62d9e2fb4ab admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:04.070817 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 859/1692] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:29:03 2022] GET /identity/v3/roles => generated 1420 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 15:29:04.072198 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1141bf6-98ba-4c68-8750-7d9b5b3458bd None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:04.074757 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1141bf6-98ba-4c68-8750-7d9b5b3458bd None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:04.075051 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1141bf6-98ba-4c68-8750-7d9b5b3458bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:04.082217 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-159ed7b1-cc7d-4720-b1e5-157028222961 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f80c49b77d1446d9ff42c5c4ddc82a8'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:04.083931 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-159ed7b1-cc7d-4720-b1e5-157028222961 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f80c49b77d1446d9ff42c5c4ddc82a8'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:04.084787 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-159ed7b1-cc7d-4720-b1e5-157028222961 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f80c49b77d1446d9ff42c5c4ddc82a8'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:04.104877 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-159ed7b1-cc7d-4720-b1e5-157028222961 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f80c49b77d1446d9ff42c5c4ddc82a8'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:04.128582 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-d1141bf6-98ba-4c68-8750-7d9b5b3458bd None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:29:04.130686 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-d1141bf6-98ba-4c68-8750-7d9b5b3458bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:04.132723 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-159ed7b1-cc7d-4720-b1e5-157028222961 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f80c49b77d1446d9ff42c5c4ddc82a8'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:04.159219 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 834/1693] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 13 15:29:03 2022] DELETE /identity/v3/users/0f80c49b77d1446d9ff42c5c4ddc82a8 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:29:04.160434 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159ed7b1-cc7d-4720-b1e5-157028222961 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:04.161585 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 860/1694] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:29:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:29:04.166998 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-159ed7b1-cc7d-4720-b1e5-157028222961 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:04.167170 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c897edaf-4253-4f4b-a089-4e893b06a3a4 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:04.167429 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c897edaf-4253-4f4b-a089-4e893b06a3a4 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:04.168556 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c897edaf-4253-4f4b-a089-4e893b06a3a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:04.213537 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-c897edaf-4253-4f4b-a089-4e893b06a3a4 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:29:04.214844 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-c897edaf-4253-4f4b-a089-4e893b06a3a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:04.332064 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159ed7b1-cc7d-4720-b1e5-157028222961 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:04.345150 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621b0559-dec4-4e0a-be4a-f2dd9d393554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:04.346133 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621b0559-dec4-4e0a-be4a-f2dd9d393554 admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:04.346462 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621b0559-dec4-4e0a-be4a-f2dd9d393554 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:04.346847 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621b0559-dec4-4e0a-be4a-f2dd9d393554 admin admin] PATH_INFO: `/v3/projects/7eb0299975764046ba7aaab1aee5f760/users/e8e2555a91654fa2b6c23a9252531834/roles/3fae3d3a28e147d3b2bede2378ff79ae` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:04.381985 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621b0559-dec4-4e0a-be4a-f2dd9d393554 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7eb0299975764046ba7aaab1aee5f760, user_id=e8e2555a91654fa2b6c23a9252531834, role_id=3fae3d3a28e147d3b2bede2378ff79ae)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:04.390089 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621b0559-dec4-4e0a-be4a-f2dd9d393554 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:04.414180 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 835/1695] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 13 15:29:04 2022] PUT /identity/v3/projects/7eb0299975764046ba7aaab1aee5f760/users/e8e2555a91654fa2b6c23a9252531834/roles/3fae3d3a28e147d3b2bede2378ff79ae => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:29:04.419782 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb60b590-b344-4f67-86bc-dfe49c719adf None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:04.420352 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb60b590-b344-4f67-86bc-dfe49c719adf None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:04.420784 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb60b590-b344-4f67-86bc-dfe49c719adf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:04.456259 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 861/1696] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:29:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:29:04.460351 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d898886-953a-4e85-b618-398aadd0ad30 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:04.460651 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d898886-953a-4e85-b618-398aadd0ad30 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:04.460938 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d898886-953a-4e85-b618-398aadd0ad30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:04.481046 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-bb60b590-b344-4f67-86bc-dfe49c719adf None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:29:04.482348 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-bb60b590-b344-4f67-86bc-dfe49c719adf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:04.550161 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:29:04.618207 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-9d898886-953a-4e85-b618-398aadd0ad30 None None] MFA Rules not processed for user `e8e2555a91654fa2b6c23a9252531834`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:29:04.621580 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-9d898886-953a-4e85-b618-398aadd0ad30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:04.658426 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 836/1697] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:29:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:29:04.659605 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb60b590-b344-4f67-86bc-dfe49c719adf None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:04.664433 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-bb60b590-b344-4f67-86bc-dfe49c719adf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:04.923928 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb60b590-b344-4f67-86bc-dfe49c719adf None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:04.944023 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 862/1698] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:29:04 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 487 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:29:04.945021 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d898886-953a-4e85-b618-398aadd0ad30 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:04.950526 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acac1657-99e5-4711-892d-89c073c6642a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b56f96cb3184a3ba82c8a0c3427e268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:04.952857 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acac1657-99e5-4711-892d-89c073c6642a service placement] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:04.953754 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acac1657-99e5-4711-892d-89c073c6642a service placement] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:04.954435 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acac1657-99e5-4711-892d-89c073c6642a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:04.962585 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-acac1657-99e5-4711-892d-89c073c6642a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:05.000274 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d898886-953a-4e85-b618-398aadd0ad30 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:05.020210 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b079415e-ea61-47fd-8f24-3978d4a25c80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:05.020876 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b079415e-ea61-47fd-8f24-3978d4a25c80 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:05.021307 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b079415e-ea61-47fd-8f24-3978d4a25c80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:05.022174 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acac1657-99e5-4711-892d-89c073c6642a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:05.024439 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b079415e-ea61-47fd-8f24-3978d4a25c80 admin admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:05.026572 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b079415e-ea61-47fd-8f24-3978d4a25c80 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:29:05.026780 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b079415e-ea61-47fd-8f24-3978d4a25c80 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:05.028415 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b079415e-ea61-47fd-8f24-3978d4a25c80 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:05.030375 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acac1657-99e5-4711-892d-89c073c6642a service placement] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:05.069683 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 837/1699] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:29:04 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:29:05.075632 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:DELETE=1,keystone:SELECT=99 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:29:05.076006 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acac1657-99e5-4711-892d-89c073c6642a service placement] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:05.085145 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-acac1657-99e5-4711-892d-89c073c6642a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:05.086418 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 863/1700] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Sep 13 15:29:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:29:05.087323 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b079415e-ea61-47fd-8f24-3978d4a25c80 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:05.121652 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b079415e-ea61-47fd-8f24-3978d4a25c80 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:05.149994 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26f6d98-d3b5-4af7-89d6-657142351768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:05.150707 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26f6d98-d3b5-4af7-89d6-657142351768 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:05.153149 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26f6d98-d3b5-4af7-89d6-657142351768 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:05.153444 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26f6d98-d3b5-4af7-89d6-657142351768 admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:05.156147 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26f6d98-d3b5-4af7-89d6-657142351768 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:05.163483 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26f6d98-d3b5-4af7-89d6-657142351768 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:05.249416 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 864/1701] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 13 15:29:05 2022] POST /identity/v3/projects => generated 357 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:29:05.251494 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26f6d98-d3b5-4af7-89d6-657142351768 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:05.259787 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-d26f6d98-d3b5-4af7-89d6-657142351768 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:05.284385 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acac1657-99e5-4711-892d-89c073c6642a service placement] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:05.430938 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7643d683-c2b6-424f-9815-7e96f7a1c75e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41675154bbba47388040966f75d84c3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:05.432896 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7643d683-c2b6-424f-9815-7e96f7a1c75e service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:05.433021 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7643d683-c2b6-424f-9815-7e96f7a1c75e service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:05.433306 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7643d683-c2b6-424f-9815-7e96f7a1c75e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:05.444074 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26f6d98-d3b5-4af7-89d6-657142351768 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:05.467396 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b7728e-a95c-4b16-b7e3-a92fcc513d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:05.469539 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b7728e-a95c-4b16-b7e3-a92fcc513d1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:05.470044 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b7728e-a95c-4b16-b7e3-a92fcc513d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:05.470577 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b7728e-a95c-4b16-b7e3-a92fcc513d1d admin admin] PATH_INFO: `/v3/users/751c7fa792ac4769855fc2e69096e1b5` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:05.472684 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b7728e-a95c-4b16-b7e3-a92fcc513d1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=751c7fa792ac4769855fc2e69096e1b5)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:05.483961 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7643d683-c2b6-424f-9815-7e96f7a1c75e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:05.484557 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b7728e-a95c-4b16-b7e3-a92fcc513d1d admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:05.485364 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7643d683-c2b6-424f-9815-7e96f7a1c75e service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:05.517952 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 838/1702] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:29:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:29:05.518873 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7643d683-c2b6-424f-9815-7e96f7a1c75e service neutron] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:05.542340 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7643d683-c2b6-424f-9815-7e96f7a1c75e service neutron] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:05.580037 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a88ade0-3a1c-432c-8481-d8c712c84e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:05.581158 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a88ade0-3a1c-432c-8481-d8c712c84e2f admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:05.581657 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a88ade0-3a1c-432c-8481-d8c712c84e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:05.582168 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a88ade0-3a1c-432c-8481-d8c712c84e2f admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:05.583320 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a88ade0-3a1c-432c-8481-d8c712c84e2f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:05.585540 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a88ade0-3a1c-432c-8481-d8c712c84e2f admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:05.677954 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 839/1703] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 13 15:29:05 2022] POST /identity/v3/projects => generated 387 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:29:05.678974 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a88ade0-3a1c-432c-8481-d8c712c84e2f admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:05.687558 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-91b7728e-a95c-4b16-b7e3-a92fcc513d1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '751c7fa792ac4769855fc2e69096e1b5'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:05.688020 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:29:05.690100 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-91b7728e-a95c-4b16-b7e3-a92fcc513d1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '751c7fa792ac4769855fc2e69096e1b5'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:05.691348 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-91b7728e-a95c-4b16-b7e3-a92fcc513d1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '751c7fa792ac4769855fc2e69096e1b5'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:05.732041 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-91b7728e-a95c-4b16-b7e3-a92fcc513d1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '751c7fa792ac4769855fc2e69096e1b5'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:05.774649 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-91b7728e-a95c-4b16-b7e3-a92fcc513d1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '751c7fa792ac4769855fc2e69096e1b5'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:05.804100 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 865/1704] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 13 15:29:05 2022] DELETE /identity/v3/users/751c7fa792ac4769855fc2e69096e1b5 => generated 0 bytes in 554 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:29:05.806536 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00335ffb-9157-4a18-96b7-bde9b61e7322 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:05.807919 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00335ffb-9157-4a18-96b7-bde9b61e7322 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:05.810051 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00335ffb-9157-4a18-96b7-bde9b61e7322 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:05.931534 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a88ade0-3a1c-432c-8481-d8c712c84e2f admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:05.943206 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-00335ffb-9157-4a18-96b7-bde9b61e7322 None None] MFA Rules not processed for user `0f2d373741034946bb989002d4b895ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:29:05.950066 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-00335ffb-9157-4a18-96b7-bde9b61e7322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:06.096833 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:29:06.142588 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ee34cd-f3c2-4dfe-b171-8c885618892c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:06.143341 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ee34cd-f3c2-4dfe-b171-8c885618892c admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:06.143731 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ee34cd-f3c2-4dfe-b171-8c885618892c admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:06.144216 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ee34cd-f3c2-4dfe-b171-8c885618892c admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:06.145753 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ee34cd-f3c2-4dfe-b171-8c885618892c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:06.148594 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ee34cd-f3c2-4dfe-b171-8c885618892c admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:06.168063 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 866/1705] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:29:05 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 363 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:29:06.169084 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00335ffb-9157-4a18-96b7-bde9b61e7322 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:06.172391 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-00335ffb-9157-4a18-96b7-bde9b61e7322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:06.233551 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 840/1706] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 13 15:29:05 2022] POST /identity/v3/users => generated 285 bytes in 555 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:29:06.235033 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a83f989-7b22-45e4-9a65-d5763575c586 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:06.237192 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a83f989-7b22-45e4-9a65-d5763575c586 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:06.238827 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a83f989-7b22-45e4-9a65-d5763575c586 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:06.240198 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00335ffb-9157-4a18-96b7-bde9b61e7322 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:06.277398 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e84f53-a367-4238-89ae-5c0372d3a634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:06.280185 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e84f53-a367-4238-89ae-5c0372d3a634 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:06.280746 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e84f53-a367-4238-89ae-5c0372d3a634 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:06.286447 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e84f53-a367-4238-89ae-5c0372d3a634 admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:06.287602 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e84f53-a367-4238-89ae-5c0372d3a634 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:06.297342 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-8a83f989-7b22-45e4-9a65-d5763575c586 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:29:06.301444 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-8a83f989-7b22-45e4-9a65-d5763575c586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:06.301968 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e84f53-a367-4238-89ae-5c0372d3a634 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:06.327750 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 841/1707] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:29:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:29:06.327750 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5622123f-ad04-42f3-a035-fbdc8580ad50 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:06.327750 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5622123f-ad04-42f3-a035-fbdc8580ad50 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:06.329328 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5622123f-ad04-42f3-a035-fbdc8580ad50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:06.380104 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-5622123f-ad04-42f3-a035-fbdc8580ad50 None None] MFA Rules not processed for user `0f2d373741034946bb989002d4b895ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:29:06.385448 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-5622123f-ad04-42f3-a035-fbdc8580ad50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:06.402531 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 867/1708] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 13 15:29:06 2022] POST /identity/v3/users => generated 294 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:29:06.404860 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e84f53-a367-4238-89ae-5c0372d3a634 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:06.408391 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-b3e84f53-a367-4238-89ae-5c0372d3a634 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:06.416850 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 842/1709] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:29:06 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:29:06.431709 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e84f53-a367-4238-89ae-5c0372d3a634 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:06.435159 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5622123f-ad04-42f3-a035-fbdc8580ad50 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:06.438375 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-5622123f-ad04-42f3-a035-fbdc8580ad50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:06.438563 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9fda40-82c4-4a6c-a44d-f66d95c583b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:06.439165 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9fda40-82c4-4a6c-a44d-f66d95c583b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:06.443797 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9fda40-82c4-4a6c-a44d-f66d95c583b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:06.444237 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9fda40-82c4-4a6c-a44d-f66d95c583b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:06.449429 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9fda40-82c4-4a6c-a44d-f66d95c583b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:06.452817 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9fda40-82c4-4a6c-a44d-f66d95c583b6 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:06.472407 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 868/1710] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:29:06 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 15:29:06.472407 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9fda40-82c4-4a6c-a44d-f66d95c583b6 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:06.491092 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9fda40-82c4-4a6c-a44d-f66d95c583b6 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:06.499675 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff52ed1-22dd-4879-af44-bf5ad0f9475e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:06.501187 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff52ed1-22dd-4879-af44-bf5ad0f9475e admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:06.501589 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff52ed1-22dd-4879-af44-bf5ad0f9475e admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:06.501962 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff52ed1-22dd-4879-af44-bf5ad0f9475e admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:06.502885 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff52ed1-22dd-4879-af44-bf5ad0f9475e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:06.505411 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff52ed1-22dd-4879-af44-bf5ad0f9475e admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:06.526160 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 869/1711] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:29:06 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 15:29:06.526160 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff52ed1-22dd-4879-af44-bf5ad0f9475e admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:06.529375 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-5ff52ed1-22dd-4879-af44-bf5ad0f9475e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:06.624880 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5622123f-ad04-42f3-a035-fbdc8580ad50 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:06.635248 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf685ce8-f759-4fa5-98eb-e23e758a05f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41675154bbba47388040966f75d84c3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:06.636036 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf685ce8-f759-4fa5-98eb-e23e758a05f3 service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:06.636318 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf685ce8-f759-4fa5-98eb-e23e758a05f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:06.636605 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf685ce8-f759-4fa5-98eb-e23e758a05f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:06.651203 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf685ce8-f759-4fa5-98eb-e23e758a05f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:06.654959 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf685ce8-f759-4fa5-98eb-e23e758a05f3 service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:06.687867 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 843/1712] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:29:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:29:06.688937 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf685ce8-f759-4fa5-98eb-e23e758a05f3 service neutron] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:06.693539 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-cf685ce8-f759-4fa5-98eb-e23e758a05f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:06.720514 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf685ce8-f759-4fa5-98eb-e23e758a05f3 service neutron] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:06.734122 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f764de8-e1e8-4983-a234-f08d752aed3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:06.736885 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f764de8-e1e8-4983-a234-f08d752aed3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:06.737306 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f764de8-e1e8-4983-a234-f08d752aed3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:06.738488 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f764de8-e1e8-4983-a234-f08d752aed3e admin admin] PATH_INFO: `/v3/projects/5ee1ae8ffa4146e6a6a1b48ccd92af3d` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:06.742049 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f764de8-e1e8-4983-a234-f08d752aed3e admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ee1ae8ffa4146e6a6a1b48ccd92af3d)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:06.748548 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f764de8-e1e8-4983-a234-f08d752aed3e admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:06.776013 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff52ed1-22dd-4879-af44-bf5ad0f9475e admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:06.795776 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60b2917-b2da-4c44-90b9-77219e6877a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62aad71c6c1a4469805762bba330bf0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:06.798936 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60b2917-b2da-4c44-90b9-77219e6877a8 service nova] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:06.799513 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60b2917-b2da-4c44-90b9-77219e6877a8 service nova] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:06.800061 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60b2917-b2da-4c44-90b9-77219e6877a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:06.840565 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60b2917-b2da-4c44-90b9-77219e6877a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:06.842750 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60b2917-b2da-4c44-90b9-77219e6877a8 service nova] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:06.847393 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:29:06.909776 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 870/1713] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:29:06 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:29:06.917227 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60b2917-b2da-4c44-90b9-77219e6877a8 service nova] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:06.935616 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-0f764de8-e1e8-4983-a234-f08d752aed3e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ee1ae8ffa4146e6a6a1b48ccd92af3d', 'request_id': 'req-0f764de8-e1e8-4983-a234-f08d752aed3e'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:06.947618 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60b2917-b2da-4c44-90b9-77219e6877a8 service nova] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:06.959579 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-0f764de8-e1e8-4983-a234-f08d752aed3e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ee1ae8ffa4146e6a6a1b48ccd92af3d', 'request_id': 'req-0f764de8-e1e8-4983-a234-f08d752aed3e'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:06.974252 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-0f764de8-e1e8-4983-a234-f08d752aed3e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ee1ae8ffa4146e6a6a1b48ccd92af3d', 'request_id': 'req-0f764de8-e1e8-4983-a234-f08d752aed3e'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:07.001082 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-0f764de8-e1e8-4983-a234-f08d752aed3e admin admin] The token cache is being invalidate because project 5ee1ae8ffa4146e6a6a1b48ccd92af3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 15:29:07.004273 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-0f764de8-e1e8-4983-a234-f08d752aed3e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:07.006629 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-0f764de8-e1e8-4983-a234-f08d752aed3e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:07.017528 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 844/1714] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 13 15:29:06 2022] DELETE /identity/v3/projects/5ee1ae8ffa4146e6a6a1b48ccd92af3d => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:29:07.018778 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f764de8-e1e8-4983-a234-f08d752aed3e admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:07.020967 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-0f764de8-e1e8-4983-a234-f08d752aed3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:07.250441 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f764de8-e1e8-4983-a234-f08d752aed3e admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:07.253601 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5c69ea-3647-4f1f-86f1-9005fe7d6fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:07.255286 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5c69ea-3647-4f1f-86f1-9005fe7d6fe8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:07.255667 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5c69ea-3647-4f1f-86f1-9005fe7d6fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:07.255948 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5c69ea-3647-4f1f-86f1-9005fe7d6fe8 admin admin] PATH_INFO: `/v3/projects/bb0bc81ebeca4025891889090b371f40/users/18e4b76c30fc45c299dd0bd48c345d61/roles/f34412ad29f1478cba775b033129f71f` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:07.263611 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa92b47-0d85-4cfa-8345-da84ff63f178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:07.264257 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa92b47-0d85-4cfa-8345-da84ff63f178 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:07.264545 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa92b47-0d85-4cfa-8345-da84ff63f178 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:07.264827 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa92b47-0d85-4cfa-8345-da84ff63f178 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:07.265551 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa92b47-0d85-4cfa-8345-da84ff63f178 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:07.268959 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa92b47-0d85-4cfa-8345-da84ff63f178 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:07.327558 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5c69ea-3647-4f1f-86f1-9005fe7d6fe8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb0bc81ebeca4025891889090b371f40, user_id=18e4b76c30fc45c299dd0bd48c345d61, role_id=f34412ad29f1478cba775b033129f71f)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:07.340675 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5c69ea-3647-4f1f-86f1-9005fe7d6fe8 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:07.359151 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 845/1715] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:29:07 2022] GET /identity/v3/roles => generated 1420 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 15:29:07.365501 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be511a9c-c13a-4524-9c79-81afdf2aabea None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:07.366028 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be511a9c-c13a-4524-9c79-81afdf2aabea None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:07.369485 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be511a9c-c13a-4524-9c79-81afdf2aabea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:07.423987 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 871/1716] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 13 15:29:06 2022] PUT /identity/v3/projects/bb0bc81ebeca4025891889090b371f40/users/18e4b76c30fc45c299dd0bd48c345d61/roles/f34412ad29f1478cba775b033129f71f => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:29:07.425062 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5c69ea-3647-4f1f-86f1-9005fe7d6fe8 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:07.460478 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-be511a9c-c13a-4524-9c79-81afdf2aabea None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:29:07.462231 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-be511a9c-c13a-4524-9c79-81afdf2aabea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:07.480619 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:29:07.562685 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 846/1717] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:29:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:29:07.563714 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be511a9c-c13a-4524-9c79-81afdf2aabea None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:07.565278 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-be511a9c-c13a-4524-9c79-81afdf2aabea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:07.579912 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be511a9c-c13a-4524-9c79-81afdf2aabea None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:07.586957 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bce737-951c-4421-a80d-8d3aaf571a42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:07.587730 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bce737-951c-4421-a80d-8d3aaf571a42 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:07.588012 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bce737-951c-4421-a80d-8d3aaf571a42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:07.588295 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bce737-951c-4421-a80d-8d3aaf571a42 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:07.588951 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bce737-951c-4421-a80d-8d3aaf571a42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:07.591262 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bce737-951c-4421-a80d-8d3aaf571a42 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:07.617642 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 847/1718] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:29:07 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 15:29:07.620914 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b655ef27-cf12-401c-98e3-c9a380fe4f7f None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:07.623421 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b655ef27-cf12-401c-98e3-c9a380fe4f7f None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:07.623772 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b655ef27-cf12-401c-98e3-c9a380fe4f7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:07.656661 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5c69ea-3647-4f1f-86f1-9005fe7d6fe8 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:07.668170 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d1b9d5-2118-470f-ba66-0527f99d26dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:07.670829 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d1b9d5-2118-470f-ba66-0527f99d26dd admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:07.671134 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d1b9d5-2118-470f-ba66-0527f99d26dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:07.671504 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d1b9d5-2118-470f-ba66-0527f99d26dd admin admin] PATH_INFO: `/v3/projects/4d4ad8a10fe64d88af0d059ce5ae632c/users/ceae7fa73eee438e9fbe750bb679c142/roles/3fae3d3a28e147d3b2bede2378ff79ae` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:07.679916 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-b655ef27-cf12-401c-98e3-c9a380fe4f7f None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:29:07.685256 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-b655ef27-cf12-401c-98e3-c9a380fe4f7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:07.732653 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 848/1719] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:29:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:29:07.733600 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b655ef27-cf12-401c-98e3-c9a380fe4f7f None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:07.760816 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b655ef27-cf12-401c-98e3-c9a380fe4f7f None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:07.777972 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619b340b-52aa-41e4-8d39-e4423acf58a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:07.780269 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619b340b-52aa-41e4-8d39-e4423acf58a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:07.780568 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619b340b-52aa-41e4-8d39-e4423acf58a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:07.781382 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619b340b-52aa-41e4-8d39-e4423acf58a9 admin admin] PATH_INFO: `/v3/projects/bb0bc81ebeca4025891889090b371f40/users/18e4b76c30fc45c299dd0bd48c345d61/roles/f34412ad29f1478cba775b033129f71f` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:07.795606 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619b340b-52aa-41e4-8d39-e4423acf58a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb0bc81ebeca4025891889090b371f40, user_id=18e4b76c30fc45c299dd0bd48c345d61, role_id=f34412ad29f1478cba775b033129f71f)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:07.795777 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d1b9d5-2118-470f-ba66-0527f99d26dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d4ad8a10fe64d88af0d059ce5ae632c, user_id=ceae7fa73eee438e9fbe750bb679c142, role_id=3fae3d3a28e147d3b2bede2378ff79ae)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:07.795777 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d1b9d5-2118-470f-ba66-0527f99d26dd admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:07.796029 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619b340b-52aa-41e4-8d39-e4423acf58a9 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:07.836023 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 872/1720] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 13 15:29:07 2022] PUT /identity/v3/projects/4d4ad8a10fe64d88af0d059ce5ae632c/users/ceae7fa73eee438e9fbe750bb679c142/roles/3fae3d3a28e147d3b2bede2378ff79ae => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:29:07.837241 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d1b9d5-2118-470f-ba66-0527f99d26dd admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:07.837361 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 849/1721] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 13 15:29:07 2022] PUT /identity/v3/projects/bb0bc81ebeca4025891889090b371f40/users/18e4b76c30fc45c299dd0bd48c345d61/roles/f34412ad29f1478cba775b033129f71f => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:29:07.847158 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac58494-1924-41f8-91dc-5c4b45c9af3e None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:07.847572 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac58494-1924-41f8-91dc-5c4b45c9af3e None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:07.847863 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac58494-1924-41f8-91dc-5c4b45c9af3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:07.894378 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-9ac58494-1924-41f8-91dc-5c4b45c9af3e None None] MFA Rules not processed for user `ceae7fa73eee438e9fbe750bb679c142`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:29:07.896920 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-9ac58494-1924-41f8-91dc-5c4b45c9af3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:07.905265 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:29:08.070483 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 850/1722] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:29:07 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:29:08.076124 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ce4133-a51d-4b18-987f-680ded5c1b12 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:08.077221 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ce4133-a51d-4b18-987f-680ded5c1b12 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:08.077221 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ce4133-a51d-4b18-987f-680ded5c1b12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:08.093351 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d1b9d5-2118-470f-ba66-0527f99d26dd admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:08.111525 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de536749-5849-46ee-adf0-af3ac6434eb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:08.112179 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de536749-5849-46ee-adf0-af3ac6434eb5 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:08.112469 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de536749-5849-46ee-adf0-af3ac6434eb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:08.112756 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de536749-5849-46ee-adf0-af3ac6434eb5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:08.113423 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de536749-5849-46ee-adf0-af3ac6434eb5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:29:08.113979 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de536749-5849-46ee-adf0-af3ac6434eb5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:08.115889 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de536749-5849-46ee-adf0-af3ac6434eb5 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:08.162842 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-20ce4133-a51d-4b18-987f-680ded5c1b12 None None] MFA Rules not processed for user `18e4b76c30fc45c299dd0bd48c345d61`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:29:08.174019 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-20ce4133-a51d-4b18-987f-680ded5c1b12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:08.174138 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 873/1723] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Sep 13 15:29:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:29:08.174138 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de536749-5849-46ee-adf0-af3ac6434eb5 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:08.182589 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-de536749-5849-46ee-adf0-af3ac6434eb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:08.227255 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de536749-5849-46ee-adf0-af3ac6434eb5 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:08.244479 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc97288-4938-4ac1-beac-69f68e55d374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:08.245323 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc97288-4938-4ac1-beac-69f68e55d374 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:08.245617 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc97288-4938-4ac1-beac-69f68e55d374 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:08.245926 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc97288-4938-4ac1-beac-69f68e55d374 admin admin] PATH_INFO: `/v3/projects/0136a24dbc324417ace7dccec88f42f7` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:08.247494 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc97288-4938-4ac1-beac-69f68e55d374 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0136a24dbc324417ace7dccec88f42f7)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:08.249692 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc97288-4938-4ac1-beac-69f68e55d374 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:08.398903 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-cdc97288-4938-4ac1-beac-69f68e55d374 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0136a24dbc324417ace7dccec88f42f7', 'request_id': 'req-cdc97288-4938-4ac1-beac-69f68e55d374'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:08.435405 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 851/1724] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:29:08 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 361 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:29:08.435997 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e262b0-b4bc-40d8-8600-22bf5accd295 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:08.436329 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e262b0-b4bc-40d8-8600-22bf5accd295 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:08.436616 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e262b0-b4bc-40d8-8600-22bf5accd295 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:08.438280 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 852/1725] 10.222.0.27 () {54 vars in 912 bytes} [Tue Sep 13 15:29:08 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:29:08.439020 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e262b0-b4bc-40d8-8600-22bf5accd295 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:08.440631 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-cdc97288-4938-4ac1-beac-69f68e55d374 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0136a24dbc324417ace7dccec88f42f7', 'request_id': 'req-cdc97288-4938-4ac1-beac-69f68e55d374'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:08.470801 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-cdc97288-4938-4ac1-beac-69f68e55d374 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0136a24dbc324417ace7dccec88f42f7', 'request_id': 'req-cdc97288-4938-4ac1-beac-69f68e55d374'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:08.494167 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-cdc97288-4938-4ac1-beac-69f68e55d374 admin admin] The token cache is being invalidate because project 0136a24dbc324417ace7dccec88f42f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 15:29:08.494476 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-cdc97288-4938-4ac1-beac-69f68e55d374 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:08.496863 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-cdc97288-4938-4ac1-beac-69f68e55d374 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:08.501411 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 874/1726] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 13 15:29:08 2022] DELETE /identity/v3/projects/0136a24dbc324417ace7dccec88f42f7 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:29:08.502344 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc97288-4938-4ac1-beac-69f68e55d374 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:08.503760 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-cdc97288-4938-4ac1-beac-69f68e55d374 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:08.540298 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:29:08.558237 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e262b0-b4bc-40d8-8600-22bf5accd295 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:08.564613 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58101d64-6a39-4698-8308-f6a9d4df8212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:08.565253 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58101d64-6a39-4698-8308-f6a9d4df8212 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:08.565586 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58101d64-6a39-4698-8308-f6a9d4df8212 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:08.565923 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58101d64-6a39-4698-8308-f6a9d4df8212 admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:08.568746 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58101d64-6a39-4698-8308-f6a9d4df8212 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:08.571534 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58101d64-6a39-4698-8308-f6a9d4df8212 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:08.614076 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 853/1727] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 13 15:29:08 2022] POST /identity/v3/projects => generated 385 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:29:08.616251 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82c5778-e8f4-488c-ba4b-6691879f946f None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:08.616546 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82c5778-e8f4-488c-ba4b-6691879f946f None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:08.616833 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82c5778-e8f4-488c-ba4b-6691879f946f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:08.618312 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc97288-4938-4ac1-beac-69f68e55d374 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:08.639637 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-d82c5778-e8f4-488c-ba4b-6691879f946f None None] MFA Rules not processed for user `7fe1e310cd5b4506bc6e10a2f5742cbb`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:29:08.640884 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-d82c5778-e8f4-488c-ba4b-6691879f946f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:08.675357 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:29:08.743952 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3007f8-bd93-4a96-9293-318fdad35bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:08.744866 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3007f8-bd93-4a96-9293-318fdad35bd6 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:08.745279 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3007f8-bd93-4a96-9293-318fdad35bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:08.746038 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3007f8-bd93-4a96-9293-318fdad35bd6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:08.746644 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3007f8-bd93-4a96-9293-318fdad35bd6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:08.749108 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3007f8-bd93-4a96-9293-318fdad35bd6 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:08.790226 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 875/1728] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 13 15:29:08 2022] POST /identity/v3/projects => generated 405 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:29:08.791712 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3007f8-bd93-4a96-9293-318fdad35bd6 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:08.794247 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-ce3007f8-bd93-4a96-9293-318fdad35bd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:08.795614 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 854/1729] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:29:08 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:29:08.797628 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0871c70b-3416-487a-85ee-dd117a472b3c None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:08.797959 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0871c70b-3416-487a-85ee-dd117a472b3c None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:08.798243 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0871c70b-3416-487a-85ee-dd117a472b3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:08.832917 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-0871c70b-3416-487a-85ee-dd117a472b3c None None] MFA Rules not processed for user `41675154bbba47388040966f75d84c3c`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:29:08.834396 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-0871c70b-3416-487a-85ee-dd117a472b3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:08.884204 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3007f8-bd93-4a96-9293-318fdad35bd6 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:08.898082 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72bcc8f-dba2-45d0-ba6e-afbac1223f28 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97acd23097d54bf7805c3cef60626ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:08.898730 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72bcc8f-dba2-45d0-ba6e-afbac1223f28 service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:08.899015 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72bcc8f-dba2-45d0-ba6e-afbac1223f28 service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:08.899294 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72bcc8f-dba2-45d0-ba6e-afbac1223f28 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:08.904167 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-f72bcc8f-dba2-45d0-ba6e-afbac1223f28 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:09.021173 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 855/1730] 10.222.0.27 () {58 vars in 1009 bytes} [Tue Sep 13 15:29:08 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:29:09.022366 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0871c70b-3416-487a-85ee-dd117a472b3c None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:09.024608 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-0871c70b-3416-487a-85ee-dd117a472b3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:09.068388 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72bcc8f-dba2-45d0-ba6e-afbac1223f28 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:09.071097 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72bcc8f-dba2-45d0-ba6e-afbac1223f28 service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:09.078853 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:29:09.091134 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 876/1731] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:29:08 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:29:09.092592 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72bcc8f-dba2-45d0-ba6e-afbac1223f28 service cinder] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:09.094521 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-f72bcc8f-dba2-45d0-ba6e-afbac1223f28 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:09.223723 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72bcc8f-dba2-45d0-ba6e-afbac1223f28 service cinder] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:09.238082 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0871c70b-3416-487a-85ee-dd117a472b3c None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:09.251625 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b59ad7-6ddc-42bc-ac26-b221f402ba09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:09.262477 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdf9291-c0b7-495f-ac3b-58f49639cbdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:09.269989 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdf9291-c0b7-495f-ac3b-58f49639cbdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:09.270209 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b59ad7-6ddc-42bc-ac26-b221f402ba09 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:09.270209 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b59ad7-6ddc-42bc-ac26-b221f402ba09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:09.270209 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b59ad7-6ddc-42bc-ac26-b221f402ba09 admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:09.272617 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdf9291-c0b7-495f-ac3b-58f49639cbdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:09.272882 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdf9291-c0b7-495f-ac3b-58f49639cbdf admin admin] PATH_INFO: `/v3/users/5adb0e0b2dcb45e59a1d5ad892a5f6b4` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:09.276088 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdf9291-c0b7-495f-ac3b-58f49639cbdf admin admin] RBAC: Authorizing `identity:delete_user(user_id=5adb0e0b2dcb45e59a1d5ad892a5f6b4)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:09.277906 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b59ad7-6ddc-42bc-ac26-b221f402ba09 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:09.279908 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdf9291-c0b7-495f-ac3b-58f49639cbdf admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:09.294768 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b59ad7-6ddc-42bc-ac26-b221f402ba09 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:09.360653 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 877/1732] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 13 15:29:09 2022] POST /identity/v3/users => generated 299 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:29:09.361884 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b59ad7-6ddc-42bc-ac26-b221f402ba09 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:09.422999 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b59ad7-6ddc-42bc-ac26-b221f402ba09 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:09.425583 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-cbdf9291-c0b7-495f-ac3b-58f49639cbdf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5adb0e0b2dcb45e59a1d5ad892a5f6b4'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:09.426896 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-cbdf9291-c0b7-495f-ac3b-58f49639cbdf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5adb0e0b2dcb45e59a1d5ad892a5f6b4'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:09.427732 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-cbdf9291-c0b7-495f-ac3b-58f49639cbdf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5adb0e0b2dcb45e59a1d5ad892a5f6b4'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:09.442852 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f8cbaf-9e7a-4c3c-8bfe-46faec135a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:09.443430 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f8cbaf-9e7a-4c3c-8bfe-46faec135a79 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:09.446789 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f8cbaf-9e7a-4c3c-8bfe-46faec135a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:09.450567 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-cbdf9291-c0b7-495f-ac3b-58f49639cbdf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5adb0e0b2dcb45e59a1d5ad892a5f6b4'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:09.451441 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f8cbaf-9e7a-4c3c-8bfe-46faec135a79 admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:09.452624 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f8cbaf-9e7a-4c3c-8bfe-46faec135a79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:09.462411 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f8cbaf-9e7a-4c3c-8bfe-46faec135a79 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:09.496547 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-cbdf9291-c0b7-495f-ac3b-58f49639cbdf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5adb0e0b2dcb45e59a1d5ad892a5f6b4'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:09.503335 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:29:09.539448 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 878/1733] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 13 15:29:09 2022] POST /identity/v3/users => generated 303 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:29:09.548962 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f8cbaf-9e7a-4c3c-8bfe-46faec135a79 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:09.554565 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-55f8cbaf-9e7a-4c3c-8bfe-46faec135a79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:09.557956 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 856/1734] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 13 15:29:09 2022] DELETE /identity/v3/users/5adb0e0b2dcb45e59a1d5ad892a5f6b4 => generated 0 bytes in 533 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:29:09.561530 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdf9291-c0b7-495f-ac3b-58f49639cbdf admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:09.565516 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-cbdf9291-c0b7-495f-ac3b-58f49639cbdf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:09.603260 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f8cbaf-9e7a-4c3c-8bfe-46faec135a79 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:09.764052 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdf9291-c0b7-495f-ac3b-58f49639cbdf admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:09.771310 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b167c94-fe00-49e5-a8de-d6b838abd90f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41675154bbba47388040966f75d84c3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:09.771950 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b167c94-fe00-49e5-a8de-d6b838abd90f service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:09.772281 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b167c94-fe00-49e5-a8de-d6b838abd90f service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:09.774204 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b167c94-fe00-49e5-a8de-d6b838abd90f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:09.776259 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0120291a-9e0e-4473-b7a2-94e9037cd8c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97acd23097d54bf7805c3cef60626ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:09.777113 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0120291a-9e0e-4473-b7a2-94e9037cd8c2 service cinder] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:09.777447 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0120291a-9e0e-4473-b7a2-94e9037cd8c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:09.777790 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0120291a-9e0e-4473-b7a2-94e9037cd8c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:09.779945 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-0b167c94-fe00-49e5-a8de-d6b838abd90f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:09.784051 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-0120291a-9e0e-4473-b7a2-94e9037cd8c2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:09.805910 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b167c94-fe00-49e5-a8de-d6b838abd90f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:09.808863 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b167c94-fe00-49e5-a8de-d6b838abd90f service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:09.835395 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 879/1735] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:29:09 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:29:09.844628 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b167c94-fe00-49e5-a8de-d6b838abd90f service neutron] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:09.849973 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-0b167c94-fe00-49e5-a8de-d6b838abd90f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:09.947077 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0120291a-9e0e-4473-b7a2-94e9037cd8c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:09.948512 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0120291a-9e0e-4473-b7a2-94e9037cd8c2 service cinder] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:09.983447 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 857/1736] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:29:09 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:29:09.984439 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0120291a-9e0e-4473-b7a2-94e9037cd8c2 service cinder] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:09.993423 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-0120291a-9e0e-4473-b7a2-94e9037cd8c2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:10.043448 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b167c94-fe00-49e5-a8de-d6b838abd90f service neutron] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:10.062029 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a4c80c-cc54-4ab0-8ac1-d08dc30d2caa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:10.062672 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a4c80c-cc54-4ab0-8ac1-d08dc30d2caa admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:10.062963 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a4c80c-cc54-4ab0-8ac1-d08dc30d2caa admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:10.063244 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a4c80c-cc54-4ab0-8ac1-d08dc30d2caa admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:10.063908 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a4c80c-cc54-4ab0-8ac1-d08dc30d2caa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:10.084997 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a4c80c-cc54-4ab0-8ac1-d08dc30d2caa admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:10.116180 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 880/1737] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:29:09 2022] GET /identity/v3/roles => generated 1420 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 15:29:10.120302 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b47f82-dd63-438b-a7e4-86a44ec4cca1 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:10.120706 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b47f82-dd63-438b-a7e4-86a44ec4cca1 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:10.121508 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b47f82-dd63-438b-a7e4-86a44ec4cca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:10.179958 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:29:10.250135 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-04b47f82-dd63-438b-a7e4-86a44ec4cca1 None None] MFA Rules not processed for user `e97bcdb20f1e416ea41b99c226617faf`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:29:10.251720 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-04b47f82-dd63-438b-a7e4-86a44ec4cca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:10.264367 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0120291a-9e0e-4473-b7a2-94e9037cd8c2 service cinder] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:10.287183 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fe382f-f0ed-43e7-b07f-f4ee09a9f87f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:10.287940 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fe382f-f0ed-43e7-b07f-f4ee09a9f87f admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:10.288657 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fe382f-f0ed-43e7-b07f-f4ee09a9f87f admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:10.288954 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fe382f-f0ed-43e7-b07f-f4ee09a9f87f admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:10.289624 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fe382f-f0ed-43e7-b07f-f4ee09a9f87f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:10.298758 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fe382f-f0ed-43e7-b07f-f4ee09a9f87f admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:10.325495 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 858/1738] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:29:09 2022] GET /identity/v3/roles => generated 1420 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 15:29:10.328553 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fe382f-f0ed-43e7-b07f-f4ee09a9f87f admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:10.354625 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fe382f-f0ed-43e7-b07f-f4ee09a9f87f admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:10.369662 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98593837-026f-4276-8e7a-6263189afa24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:10.370557 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98593837-026f-4276-8e7a-6263189afa24 admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:10.371662 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98593837-026f-4276-8e7a-6263189afa24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:10.372051 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98593837-026f-4276-8e7a-6263189afa24 admin admin] PATH_INFO: `/v3/projects/74295bd678b34058a9e31ccc740e879e/users/f280998ca51648999931a84dcfa2f8c7/roles/f34412ad29f1478cba775b033129f71f` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:10.392471 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 881/1739] 10.222.0.27 () {58 vars in 1009 bytes} [Tue Sep 13 15:29:10 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:29:10.394105 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b47f82-dd63-438b-a7e4-86a44ec4cca1 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:10.410364 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98593837-026f-4276-8e7a-6263189afa24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74295bd678b34058a9e31ccc740e879e, user_id=f280998ca51648999931a84dcfa2f8c7, role_id=f34412ad29f1478cba775b033129f71f)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:10.419901 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98593837-026f-4276-8e7a-6263189afa24 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:10.429165 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b47f82-dd63-438b-a7e4-86a44ec4cca1 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:10.444062 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8d2006-92e3-4c42-a257-1a749138de11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:10.445786 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8d2006-92e3-4c42-a257-1a749138de11 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:10.446196 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8d2006-92e3-4c42-a257-1a749138de11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:10.447083 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8d2006-92e3-4c42-a257-1a749138de11 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:10.450006 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 859/1740] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 13 15:29:10 2022] PUT /identity/v3/projects/74295bd678b34058a9e31ccc740e879e/users/f280998ca51648999931a84dcfa2f8c7/roles/f34412ad29f1478cba775b033129f71f => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:29:10.454166 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98593837-026f-4276-8e7a-6263189afa24 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:10.454348 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8d2006-92e3-4c42-a257-1a749138de11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:10.456477 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8d2006-92e3-4c42-a257-1a749138de11 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:10.486430 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:INSERT=2,keystone:DELETE=1,keystone:SELECT=97 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:29:10.489646 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 882/1741] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:29:10 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 15:29:10.492618 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8d2006-92e3-4c42-a257-1a749138de11 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:10.525195 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8d2006-92e3-4c42-a257-1a749138de11 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:10.548702 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98593837-026f-4276-8e7a-6263189afa24 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:10.555758 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc525a33-6905-4953-bc64-de08559af61f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:10.556536 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc525a33-6905-4953-bc64-de08559af61f admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:10.556880 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc525a33-6905-4953-bc64-de08559af61f admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:10.557305 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc525a33-6905-4953-bc64-de08559af61f admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:10.558230 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc525a33-6905-4953-bc64-de08559af61f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:10.560162 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc525a33-6905-4953-bc64-de08559af61f admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:10.572389 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 860/1742] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:29:10 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 15:29:10.578212 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc525a33-6905-4953-bc64-de08559af61f admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:10.600668 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc525a33-6905-4953-bc64-de08559af61f admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:10.605416 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8773078f-145b-4129-ba6d-4d8f2098b1cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:10.606909 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8773078f-145b-4129-ba6d-4d8f2098b1cc admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:10.607311 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8773078f-145b-4129-ba6d-4d8f2098b1cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:10.607697 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8773078f-145b-4129-ba6d-4d8f2098b1cc admin admin] PATH_INFO: `/v3/projects/74295bd678b34058a9e31ccc740e879e/users/f280998ca51648999931a84dcfa2f8c7/roles/f34412ad29f1478cba775b033129f71f` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:10.610678 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8773078f-145b-4129-ba6d-4d8f2098b1cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=74295bd678b34058a9e31ccc740e879e, user_id=f280998ca51648999931a84dcfa2f8c7, role_id=f34412ad29f1478cba775b033129f71f)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:10.616289 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8773078f-145b-4129-ba6d-4d8f2098b1cc admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:10.643978 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 861/1743] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 13 15:29:10 2022] PUT /identity/v3/projects/74295bd678b34058a9e31ccc740e879e/users/f280998ca51648999931a84dcfa2f8c7/roles/f34412ad29f1478cba775b033129f71f => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 15:29:10.655962 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f16833-848e-41b7-9209-b963ff405445 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:10.656597 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f16833-848e-41b7-9209-b963ff405445 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:10.656731 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f16833-848e-41b7-9209-b963ff405445 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:10.693511 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee6a2c2-55b2-4606-b8d9-4499b9dd0314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:10.695908 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee6a2c2-55b2-4606-b8d9-4499b9dd0314 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:10.696284 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee6a2c2-55b2-4606-b8d9-4499b9dd0314 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:10.696678 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee6a2c2-55b2-4606-b8d9-4499b9dd0314 admin admin] PATH_INFO: `/v3/projects/5b13b5b67a9a4346a61e09001d082d9b/users/9ecef7e619bb4a77b9cb9707671ac004/roles/3fae3d3a28e147d3b2bede2378ff79ae` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:10.728737 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-f1f16833-848e-41b7-9209-b963ff405445 None None] MFA Rules not processed for user `f280998ca51648999931a84dcfa2f8c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:29:10.730569 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee6a2c2-55b2-4606-b8d9-4499b9dd0314 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b13b5b67a9a4346a61e09001d082d9b, user_id=9ecef7e619bb4a77b9cb9707671ac004, role_id=3fae3d3a28e147d3b2bede2378ff79ae)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:10.733324 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-f1f16833-848e-41b7-9209-b963ff405445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:10.733849 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee6a2c2-55b2-4606-b8d9-4499b9dd0314 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:10.759264 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 883/1744] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 13 15:29:10 2022] PUT /identity/v3/projects/5b13b5b67a9a4346a61e09001d082d9b/users/9ecef7e619bb4a77b9cb9707671ac004/roles/3fae3d3a28e147d3b2bede2378ff79ae => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:29:10.772422 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20e5a27-278b-4f8a-ad9e-2dee71c96f72 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:10.774778 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20e5a27-278b-4f8a-ad9e-2dee71c96f72 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:10.775629 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20e5a27-278b-4f8a-ad9e-2dee71c96f72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:10.851194 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-f20e5a27-278b-4f8a-ad9e-2dee71c96f72 None None] MFA Rules not processed for user `9ecef7e619bb4a77b9cb9707671ac004`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:29:10.853258 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-f20e5a27-278b-4f8a-ad9e-2dee71c96f72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:10.982066 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:29:11.024565 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 862/1745] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:29:10 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 370 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:29:11.027630 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f16833-848e-41b7-9209-b963ff405445 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:11.031638 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-f1f16833-848e-41b7-9209-b963ff405445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:11.044497 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 884/1746] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:29:10 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:29:11.045559 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20e5a27-278b-4f8a-ad9e-2dee71c96f72 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:11.052157 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-f20e5a27-278b-4f8a-ad9e-2dee71c96f72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:11.165927 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20e5a27-278b-4f8a-ad9e-2dee71c96f72 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:11.172328 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70950b34-c1c3-4c27-9726-feab9013ed12 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97acd23097d54bf7805c3cef60626ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:11.173061 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70950b34-c1c3-4c27-9726-feab9013ed12 service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:11.173344 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70950b34-c1c3-4c27-9726-feab9013ed12 service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:11.173625 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70950b34-c1c3-4c27-9726-feab9013ed12 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:11.333525 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f16833-848e-41b7-9209-b963ff405445 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:11.353741 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70950b34-c1c3-4c27-9726-feab9013ed12 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:11.355397 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70950b34-c1c3-4c27-9726-feab9013ed12 service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:11.355530 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:29:11.370146 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 885/1747] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:29:11 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:29:11.371170 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70950b34-c1c3-4c27-9726-feab9013ed12 service cinder] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:11.637107 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70950b34-c1c3-4c27-9726-feab9013ed12 service cinder] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:11.651344 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec9e611-d6aa-4287-81cd-7918c99b3380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:11.651987 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec9e611-d6aa-4287-81cd-7918c99b3380 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:11.654034 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec9e611-d6aa-4287-81cd-7918c99b3380 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:11.654380 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec9e611-d6aa-4287-81cd-7918c99b3380 admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:11.656373 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec9e611-d6aa-4287-81cd-7918c99b3380 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:11.661486 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec9e611-d6aa-4287-81cd-7918c99b3380 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:11.678447 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9218367a-be7f-42ee-9857-439594003dd5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc735644be394e0abe73e709373e2003', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:11.681870 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9218367a-be7f-42ee-9857-439594003dd5 service swift] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:11.682164 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9218367a-be7f-42ee-9857-439594003dd5 service swift] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:11.682449 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9218367a-be7f-42ee-9857-439594003dd5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:11.773242 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 886/1748] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 13 15:29:11 2022] POST /identity/v3/projects => generated 403 bytes in 402 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:29:11.774913 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec9e611-d6aa-4287-81cd-7918c99b3380 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:11.844135 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9218367a-be7f-42ee-9857-439594003dd5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:11.845468 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:29:11.846474 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9218367a-be7f-42ee-9857-439594003dd5 service swift] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:11.857142 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 863/1749] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Sep 13 15:29:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 832 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 15:29:11.859235 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9218367a-be7f-42ee-9857-439594003dd5 service swift] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:11.883226 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9218367a-be7f-42ee-9857-439594003dd5 service swift] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:12.097514 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec9e611-d6aa-4287-81cd-7918c99b3380 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:12.133319 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2598dd36-a344-46bd-a475-5ed9feca71f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:12.134218 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f959868e-aad4-4820-b7a8-0ae6ab42821b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:12.138410 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f959868e-aad4-4820-b7a8-0ae6ab42821b admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:12.139636 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f959868e-aad4-4820-b7a8-0ae6ab42821b admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:12.139930 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f959868e-aad4-4820-b7a8-0ae6ab42821b admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:12.142811 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f959868e-aad4-4820-b7a8-0ae6ab42821b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:12.146086 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f959868e-aad4-4820-b7a8-0ae6ab42821b admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:12.147091 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2598dd36-a344-46bd-a475-5ed9feca71f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:12.153943 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2598dd36-a344-46bd-a475-5ed9feca71f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:12.154689 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2598dd36-a344-46bd-a475-5ed9feca71f3 admin admin] PATH_INFO: `/v3/users/ceae7fa73eee438e9fbe750bb679c142` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:12.160062 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2598dd36-a344-46bd-a475-5ed9feca71f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ceae7fa73eee438e9fbe750bb679c142)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:12.172349 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2598dd36-a344-46bd-a475-5ed9feca71f3 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:12.229607 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 864/1750] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 13 15:29:11 2022] POST /identity/v3/users => generated 308 bytes in 372 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:29:12.231295 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712413f1-e3ea-4179-9cf9-32f681da12c2 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:12.231624 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712413f1-e3ea-4179-9cf9-32f681da12c2 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:12.231904 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712413f1-e3ea-4179-9cf9-32f681da12c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:12.333048 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-712413f1-e3ea-4179-9cf9-32f681da12c2 None None] MFA Rules not processed for user `0f2d373741034946bb989002d4b895ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:29:12.337613 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-712413f1-e3ea-4179-9cf9-32f681da12c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:12.459251 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:29:12.466154 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-2598dd36-a344-46bd-a475-5ed9feca71f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ceae7fa73eee438e9fbe750bb679c142'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:12.467555 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-2598dd36-a344-46bd-a475-5ed9feca71f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ceae7fa73eee438e9fbe750bb679c142'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:12.469166 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-2598dd36-a344-46bd-a475-5ed9feca71f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ceae7fa73eee438e9fbe750bb679c142'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:12.492019 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-2598dd36-a344-46bd-a475-5ed9feca71f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ceae7fa73eee438e9fbe750bb679c142'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:12.545625 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-2598dd36-a344-46bd-a475-5ed9feca71f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ceae7fa73eee438e9fbe750bb679c142'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:12.558413 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 865/1751] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:29:12 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:29:12.559589 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712413f1-e3ea-4179-9cf9-32f681da12c2 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:12.561498 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-712413f1-e3ea-4179-9cf9-32f681da12c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:12.606002 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 887/1752] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 13 15:29:11 2022] DELETE /identity/v3/users/ceae7fa73eee438e9fbe750bb679c142 => generated 0 bytes in 833 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:29:12.636509 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2ab03f-ddf3-4391-851f-2e5f2cdf39c6 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:12.636854 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2ab03f-ddf3-4391-851f-2e5f2cdf39c6 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:12.637147 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2ab03f-ddf3-4391-851f-2e5f2cdf39c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:12.684359 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712413f1-e3ea-4179-9cf9-32f681da12c2 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:12.728900 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-bd2ab03f-ddf3-4391-851f-2e5f2cdf39c6 None None] MFA Rules not processed for user `41675154bbba47388040966f75d84c3c`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:29:12.736286 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-bd2ab03f-ddf3-4391-851f-2e5f2cdf39c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:12.926021 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbdcdb3-b2c0-468a-b9e4-97f568c56a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:12.928919 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbdcdb3-b2c0-468a-b9e4-97f568c56a7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:12.931040 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbdcdb3-b2c0-468a-b9e4-97f568c56a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:12.932572 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 888/1753] 10.222.0.15 () {58 vars in 1015 bytes} [Tue Sep 13 15:29:12 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:29:12.932877 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbdcdb3-b2c0-468a-b9e4-97f568c56a7b admin admin] PATH_INFO: `/v3/projects/2c7ce4f5290e445eb69f378dc77b3940` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:12.934602 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2ab03f-ddf3-4391-851f-2e5f2cdf39c6 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:12.936428 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-bd2ab03f-ddf3-4391-851f-2e5f2cdf39c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:12.937418 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbdcdb3-b2c0-468a-b9e4-97f568c56a7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c7ce4f5290e445eb69f378dc77b3940)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:12.943838 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbdcdb3-b2c0-468a-b9e4-97f568c56a7b admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:12.959131 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2ab03f-ddf3-4391-851f-2e5f2cdf39c6 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:12.966358 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5652b0f2-1f7f-4455-a109-667d3877d86c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:12.967609 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5652b0f2-1f7f-4455-a109-667d3877d86c admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:12.968319 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5652b0f2-1f7f-4455-a109-667d3877d86c admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:12.968792 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5652b0f2-1f7f-4455-a109-667d3877d86c admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:12.969937 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5652b0f2-1f7f-4455-a109-667d3877d86c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:12.972066 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5652b0f2-1f7f-4455-a109-667d3877d86c admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:12.998346 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 889/1754] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:29:12 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 15:29:13.001733 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbedc0bd-d3a5-487a-954f-7cf84603038e None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:13.002284 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbedc0bd-d3a5-487a-954f-7cf84603038e None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:13.002868 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbedc0bd-d3a5-487a-954f-7cf84603038e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:13.092221 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-bbedc0bd-d3a5-487a-954f-7cf84603038e None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:29:13.108691 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-bbedc0bd-d3a5-487a-954f-7cf84603038e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:13.133020 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 890/1755] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:29:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:29:13.134144 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbedc0bd-d3a5-487a-954f-7cf84603038e None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:13.135728 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-bbedc0bd-d3a5-487a-954f-7cf84603038e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:13.155163 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbedc0bd-d3a5-487a-954f-7cf84603038e None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:13.199362 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-bfbdcdb3-b2c0-468a-b9e4-97f568c56a7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c7ce4f5290e445eb69f378dc77b3940', 'request_id': 'req-bfbdcdb3-b2c0-468a-b9e4-97f568c56a7b'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:13.210931 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-bfbdcdb3-b2c0-468a-b9e4-97f568c56a7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c7ce4f5290e445eb69f378dc77b3940', 'request_id': 'req-bfbdcdb3-b2c0-468a-b9e4-97f568c56a7b'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:13.232955 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-bfbdcdb3-b2c0-468a-b9e4-97f568c56a7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c7ce4f5290e445eb69f378dc77b3940', 'request_id': 'req-bfbdcdb3-b2c0-468a-b9e4-97f568c56a7b'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:13.259625 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-bfbdcdb3-b2c0-468a-b9e4-97f568c56a7b admin admin] The token cache is being invalidate because project 2c7ce4f5290e445eb69f378dc77b3940 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 15:29:13.259925 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-bfbdcdb3-b2c0-468a-b9e4-97f568c56a7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:13.262622 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-bfbdcdb3-b2c0-468a-b9e4-97f568c56a7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:13.268946 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 866/1756] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 13 15:29:12 2022] DELETE /identity/v3/projects/2c7ce4f5290e445eb69f378dc77b3940 => generated 0 bytes in 710 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:29:13.271041 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbdcdb3-b2c0-468a-b9e4-97f568c56a7b admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:13.276149 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-bfbdcdb3-b2c0-468a-b9e4-97f568c56a7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:13.307648 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:29:13.465675 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da757fee-0e5e-49d5-8426-0c6dd4ba1928 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41675154bbba47388040966f75d84c3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:13.471238 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da757fee-0e5e-49d5-8426-0c6dd4ba1928 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:13.471794 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da757fee-0e5e-49d5-8426-0c6dd4ba1928 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:13.472325 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da757fee-0e5e-49d5-8426-0c6dd4ba1928 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:13.490659 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbdcdb3-b2c0-468a-b9e4-97f568c56a7b admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:13.500247 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-da757fee-0e5e-49d5-8426-0c6dd4ba1928 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:13.515229 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3984b3b2-a415-4f42-8680-9d65a984df89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:13.518764 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3984b3b2-a415-4f42-8680-9d65a984df89 admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:13.520847 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3984b3b2-a415-4f42-8680-9d65a984df89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:13.521532 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3984b3b2-a415-4f42-8680-9d65a984df89 admin admin] PATH_INFO: `/v3/projects/4102388053024be3832a7fc7184e1ae8/users/cc0ad8e8dc5f46c79fa526501e1c2366/roles/f34412ad29f1478cba775b033129f71f` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:13.581028 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3984b3b2-a415-4f42-8680-9d65a984df89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4102388053024be3832a7fc7184e1ae8, user_id=cc0ad8e8dc5f46c79fa526501e1c2366, role_id=f34412ad29f1478cba775b033129f71f)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:13.586294 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3984b3b2-a415-4f42-8680-9d65a984df89 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:13.587256 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da757fee-0e5e-49d5-8426-0c6dd4ba1928 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:13.601524 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da757fee-0e5e-49d5-8426-0c6dd4ba1928 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:13.619447 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:29:13.654779 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 891/1757] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:29:13 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 516 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:29:13.654779 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da757fee-0e5e-49d5-8426-0c6dd4ba1928 service neutron] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:13.666080 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-da757fee-0e5e-49d5-8426-0c6dd4ba1928 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:13.668413 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 867/1758] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 13 15:29:13 2022] PUT /identity/v3/projects/4102388053024be3832a7fc7184e1ae8/users/cc0ad8e8dc5f46c79fa526501e1c2366/roles/f34412ad29f1478cba775b033129f71f => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:29:13.677030 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751d60e2-2da1-4e00-b97c-aec5f0f601e6 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:13.678881 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751d60e2-2da1-4e00-b97c-aec5f0f601e6 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:13.682794 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751d60e2-2da1-4e00-b97c-aec5f0f601e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:13.705968 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da757fee-0e5e-49d5-8426-0c6dd4ba1928 service neutron] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:13.823160 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-751d60e2-2da1-4e00-b97c-aec5f0f601e6 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:29:13.830806 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-751d60e2-2da1-4e00-b97c-aec5f0f601e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:14.030852 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f340faf7-efc9-4fc4-be15-be7b89d044b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41675154bbba47388040966f75d84c3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:14.032032 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f340faf7-efc9-4fc4-be15-be7b89d044b9 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:14.032526 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f340faf7-efc9-4fc4-be15-be7b89d044b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:14.033011 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f340faf7-efc9-4fc4-be15-be7b89d044b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:14.057742 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-f340faf7-efc9-4fc4-be15-be7b89d044b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:14.261228 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 868/1759] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:29:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 593 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:29:14.262197 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751d60e2-2da1-4e00-b97c-aec5f0f601e6 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:14.297451 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751d60e2-2da1-4e00-b97c-aec5f0f601e6 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:14.314170 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642d63b2-a161-4561-8072-7485b92da44d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:14.314812 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642d63b2-a161-4561-8072-7485b92da44d admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:14.315098 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642d63b2-a161-4561-8072-7485b92da44d admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:14.315379 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642d63b2-a161-4561-8072-7485b92da44d admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:14.320128 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642d63b2-a161-4561-8072-7485b92da44d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:14.324485 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642d63b2-a161-4561-8072-7485b92da44d admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:14.361384 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 869/1760] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:29:14 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 15:29:14.362673 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281c4b35-d8d7-432d-97c1-2da4fc92edfe None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:14.362968 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281c4b35-d8d7-432d-97c1-2da4fc92edfe None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:14.363248 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281c4b35-d8d7-432d-97c1-2da4fc92edfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:14.372766 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f340faf7-efc9-4fc4-be15-be7b89d044b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:14.376983 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f340faf7-efc9-4fc4-be15-be7b89d044b9 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:14.402140 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 892/1761] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:29:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 749 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:29:14.403890 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f340faf7-efc9-4fc4-be15-be7b89d044b9 service neutron] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:14.415207 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f340faf7-efc9-4fc4-be15-be7b89d044b9 service neutron] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:14.423544 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811903cc-a07c-4a73-9cc8-3b6c074b3e15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:14.424612 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811903cc-a07c-4a73-9cc8-3b6c074b3e15 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:14.425110 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811903cc-a07c-4a73-9cc8-3b6c074b3e15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:14.425657 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811903cc-a07c-4a73-9cc8-3b6c074b3e15 admin admin] PATH_INFO: `/v3/projects/4102388053024be3832a7fc7184e1ae8/users/cc0ad8e8dc5f46c79fa526501e1c2366/roles/f34412ad29f1478cba775b033129f71f` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:14.428098 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-281c4b35-d8d7-432d-97c1-2da4fc92edfe None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:29:14.429415 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-281c4b35-d8d7-432d-97c1-2da4fc92edfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:14.434031 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811903cc-a07c-4a73-9cc8-3b6c074b3e15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4102388053024be3832a7fc7184e1ae8, user_id=cc0ad8e8dc5f46c79fa526501e1c2366, role_id=f34412ad29f1478cba775b033129f71f)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:14.437985 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811903cc-a07c-4a73-9cc8-3b6c074b3e15 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:14.464686 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 893/1762] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 13 15:29:14 2022] PUT /identity/v3/projects/4102388053024be3832a7fc7184e1ae8/users/cc0ad8e8dc5f46c79fa526501e1c2366/roles/f34412ad29f1478cba775b033129f71f => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:29:14.481262 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920d76c2-1853-4aa9-aaa8-af69f8dc5952 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:14.481627 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920d76c2-1853-4aa9-aaa8-af69f8dc5952 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:14.482008 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920d76c2-1853-4aa9-aaa8-af69f8dc5952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:14.551068 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-920d76c2-1853-4aa9-aaa8-af69f8dc5952 None None] MFA Rules not processed for user `cc0ad8e8dc5f46c79fa526501e1c2366`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:29:14.552280 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-920d76c2-1853-4aa9-aaa8-af69f8dc5952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:14.696597 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 870/1763] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:29:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:29:14.703953 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281c4b35-d8d7-432d-97c1-2da4fc92edfe None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:14.740620 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281c4b35-d8d7-432d-97c1-2da4fc92edfe None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:14.759825 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e99a8c2-9493-49c3-8004-00c67aaf5b40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:14.760429 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e99a8c2-9493-49c3-8004-00c67aaf5b40 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:14.760700 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e99a8c2-9493-49c3-8004-00c67aaf5b40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:14.760983 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e99a8c2-9493-49c3-8004-00c67aaf5b40 admin admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:14.761658 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e99a8c2-9493-49c3-8004-00c67aaf5b40 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:29:14.762015 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e99a8c2-9493-49c3-8004-00c67aaf5b40 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:14.763647 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e99a8c2-9493-49c3-8004-00c67aaf5b40 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:14.778967 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:29:14.796613 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 894/1764] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:29:14 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:29:14.812525 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920d76c2-1853-4aa9-aaa8-af69f8dc5952 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:14.814249 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-920d76c2-1853-4aa9-aaa8-af69f8dc5952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:14.815197 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 871/1765] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Sep 13 15:29:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:29:14.821572 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e99a8c2-9493-49c3-8004-00c67aaf5b40 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:14.874209 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e99a8c2-9493-49c3-8004-00c67aaf5b40 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:14.882947 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9567a4b1-d22a-4efe-98b4-e0687e948f51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:14.883960 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9567a4b1-d22a-4efe-98b4-e0687e948f51 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:14.884507 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9567a4b1-d22a-4efe-98b4-e0687e948f51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:14.885112 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9567a4b1-d22a-4efe-98b4-e0687e948f51 admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:14.886124 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9567a4b1-d22a-4efe-98b4-e0687e948f51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:14.889086 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9567a4b1-d22a-4efe-98b4-e0687e948f51 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:14.940110 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 872/1766] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 13 15:29:14 2022] POST /identity/v3/projects => generated 375 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:29:14.954776 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9567a4b1-d22a-4efe-98b4-e0687e948f51 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:14.961782 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920d76c2-1853-4aa9-aaa8-af69f8dc5952 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:15.033194 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:29:15.062333 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9567a4b1-d22a-4efe-98b4-e0687e948f51 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:15.069607 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fe3c08-331c-4347-969e-848d14f9c718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:15.070404 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fe3c08-331c-4347-969e-848d14f9c718 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:15.070836 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fe3c08-331c-4347-969e-848d14f9c718 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:15.071235 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fe3c08-331c-4347-969e-848d14f9c718 admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:15.072207 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fe3c08-331c-4347-969e-848d14f9c718 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:15.074492 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fe3c08-331c-4347-969e-848d14f9c718 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:15.083609 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7fef0c-afb6-42dd-abf9-de9d088e41d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97acd23097d54bf7805c3cef60626ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:15.084552 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7fef0c-afb6-42dd-abf9-de9d088e41d8 service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:15.085049 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7fef0c-afb6-42dd-abf9-de9d088e41d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:15.085477 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7fef0c-afb6-42dd-abf9-de9d088e41d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:15.133192 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 873/1767] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 13 15:29:14 2022] POST /identity/v3/users => generated 288 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:29:15.136631 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fe3c08-331c-4347-969e-848d14f9c718 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:15.167690 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fe3c08-331c-4347-969e-848d14f9c718 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:15.183299 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576e7ce2-7fc7-4a03-a40b-0081f3d0dd13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:15.198392 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576e7ce2-7fc7-4a03-a40b-0081f3d0dd13 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:15.201462 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576e7ce2-7fc7-4a03-a40b-0081f3d0dd13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:15.202431 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576e7ce2-7fc7-4a03-a40b-0081f3d0dd13 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:15.209002 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576e7ce2-7fc7-4a03-a40b-0081f3d0dd13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:15.214520 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576e7ce2-7fc7-4a03-a40b-0081f3d0dd13 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:15.247375 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 874/1768] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:29:15 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 15:29:15.251545 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576e7ce2-7fc7-4a03-a40b-0081f3d0dd13 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:15.283456 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576e7ce2-7fc7-4a03-a40b-0081f3d0dd13 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:15.303196 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8ebc22-9b72-468c-ac1b-637cfde73696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:15.303806 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8ebc22-9b72-468c-ac1b-637cfde73696 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:15.304171 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8ebc22-9b72-468c-ac1b-637cfde73696 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:15.304457 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8ebc22-9b72-468c-ac1b-637cfde73696 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:15.312862 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8ebc22-9b72-468c-ac1b-637cfde73696 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:15.313921 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7fef0c-afb6-42dd-abf9-de9d088e41d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:15.317520 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8ebc22-9b72-468c-ac1b-637cfde73696 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:15.320842 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7fef0c-afb6-42dd-abf9-de9d088e41d8 service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:15.362152 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 875/1769] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:29:15 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 15:29:15.367017 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8ebc22-9b72-468c-ac1b-637cfde73696 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:15.370081 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 895/1770] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:29:14 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 558 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:29:15.426337 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8ebc22-9b72-468c-ac1b-637cfde73696 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:15.441044 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca63410-5a6d-47a6-8a9f-1ab781115289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:15.442072 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca63410-5a6d-47a6-8a9f-1ab781115289 admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:15.442366 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca63410-5a6d-47a6-8a9f-1ab781115289 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:15.442816 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca63410-5a6d-47a6-8a9f-1ab781115289 admin admin] PATH_INFO: `/v3/projects/6252d13df0264d40a8178fbb4da85930/users/ce78f15e45d34cf6aaefdd1432e8dda5/roles/3fae3d3a28e147d3b2bede2378ff79ae` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:15.478830 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca63410-5a6d-47a6-8a9f-1ab781115289 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6252d13df0264d40a8178fbb4da85930, user_id=ce78f15e45d34cf6aaefdd1432e8dda5, role_id=3fae3d3a28e147d3b2bede2378ff79ae)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:15.484373 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca63410-5a6d-47a6-8a9f-1ab781115289 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:15.542042 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 876/1771] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 13 15:29:15 2022] PUT /identity/v3/projects/6252d13df0264d40a8178fbb4da85930/users/ce78f15e45d34cf6aaefdd1432e8dda5/roles/3fae3d3a28e147d3b2bede2378ff79ae => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 15:29:15.557234 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4141a959-feb4-4ccf-82ff-c3b143fa4faa None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:15.557778 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4141a959-feb4-4ccf-82ff-c3b143fa4faa None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:15.558069 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4141a959-feb4-4ccf-82ff-c3b143fa4faa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:15.679047 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-4141a959-feb4-4ccf-82ff-c3b143fa4faa None None] MFA Rules not processed for user `ce78f15e45d34cf6aaefdd1432e8dda5`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:29:15.680329 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-4141a959-feb4-4ccf-82ff-c3b143fa4faa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:15.985259 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:29:16.074247 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca63410-5a6d-47a6-8a9f-1ab781115289 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:16.136106 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 896/1772] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:29:15 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 580 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:29:16.160032 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4141a959-feb4-4ccf-82ff-c3b143fa4faa None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:16.424758 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca63410-5a6d-47a6-8a9f-1ab781115289 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:16.439585 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27edb2e2-7470-4b33-b1b8-b06f812f8122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:16.440197 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27edb2e2-7470-4b33-b1b8-b06f812f8122 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:16.440477 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27edb2e2-7470-4b33-b1b8-b06f812f8122 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:16.447342 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27edb2e2-7470-4b33-b1b8-b06f812f8122 admin admin] PATH_INFO: `/v3/users/9ecef7e619bb4a77b9cb9707671ac004` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:16.453791 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27edb2e2-7470-4b33-b1b8-b06f812f8122 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ecef7e619bb4a77b9cb9707671ac004)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:16.455852 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27edb2e2-7470-4b33-b1b8-b06f812f8122 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:16.491954 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4141a959-feb4-4ccf-82ff-c3b143fa4faa None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:16.501852 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8b6064-bd79-47ec-9ad2-db662fd24166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:16.502501 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8b6064-bd79-47ec-9ad2-db662fd24166 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:16.505720 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8b6064-bd79-47ec-9ad2-db662fd24166 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:16.506062 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8b6064-bd79-47ec-9ad2-db662fd24166 admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:16.508172 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8b6064-bd79-47ec-9ad2-db662fd24166 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:16.508683 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8b6064-bd79-47ec-9ad2-db662fd24166 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:16.579545 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 897/1773] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 13 15:29:16 2022] POST /identity/v3/projects => generated 377 bytes in 421 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:29:16.580748 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8b6064-bd79-47ec-9ad2-db662fd24166 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:16.780180 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-27edb2e2-7470-4b33-b1b8-b06f812f8122 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ecef7e619bb4a77b9cb9707671ac004'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:16.786417 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-27edb2e2-7470-4b33-b1b8-b06f812f8122 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ecef7e619bb4a77b9cb9707671ac004'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:16.788415 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-27edb2e2-7470-4b33-b1b8-b06f812f8122 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ecef7e619bb4a77b9cb9707671ac004'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:16.820622 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8b6064-bd79-47ec-9ad2-db662fd24166 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:16.823120 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-27edb2e2-7470-4b33-b1b8-b06f812f8122 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ecef7e619bb4a77b9cb9707671ac004'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:16.829215 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a903f39f-1bf5-48dd-9df7-e98beda99ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:16.830468 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a903f39f-1bf5-48dd-9df7-e98beda99ec4 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:16.831160 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a903f39f-1bf5-48dd-9df7-e98beda99ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:16.831632 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a903f39f-1bf5-48dd-9df7-e98beda99ec4 admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:16.833093 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a903f39f-1bf5-48dd-9df7-e98beda99ec4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:16.836212 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a903f39f-1bf5-48dd-9df7-e98beda99ec4 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:16.890661 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-27edb2e2-7470-4b33-b1b8-b06f812f8122 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ecef7e619bb4a77b9cb9707671ac004'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:16.893511 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 898/1774] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 13 15:29:16 2022] POST /identity/v3/users => generated 295 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:29:16.898367 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a903f39f-1bf5-48dd-9df7-e98beda99ec4 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:16.901730 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-a903f39f-1bf5-48dd-9df7-e98beda99ec4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:16.930285 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a903f39f-1bf5-48dd-9df7-e98beda99ec4 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:16.934830 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 877/1775] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 13 15:29:16 2022] DELETE /identity/v3/users/9ecef7e619bb4a77b9cb9707671ac004 => generated 0 bytes in 861 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 15:29:16.939873 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d81121-6e81-49c6-ba99-712703b16e41 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:16.940172 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d81121-6e81-49c6-ba99-712703b16e41 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:16.940471 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d81121-6e81-49c6-ba99-712703b16e41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:17.013212 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-c2d81121-6e81-49c6-ba99-712703b16e41 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:29:17.016652 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-c2d81121-6e81-49c6-ba99-712703b16e41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:17.046172 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:29:17.158644 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6153647-7d49-464c-8102-fb32a3207b1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:17.164177 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6153647-7d49-464c-8102-fb32a3207b1f admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:17.165201 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6153647-7d49-464c-8102-fb32a3207b1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:17.166497 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6153647-7d49-464c-8102-fb32a3207b1f admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:17.168125 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6153647-7d49-464c-8102-fb32a3207b1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:17.178405 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6153647-7d49-464c-8102-fb32a3207b1f admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:17.179167 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 878/1776] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:29:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:29:17.180208 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d81121-6e81-49c6-ba99-712703b16e41 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:17.183991 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-c2d81121-6e81-49c6-ba99-712703b16e41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:17.202391 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:29:17.213119 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 899/1777] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:29:16 2022] GET /identity/v3/roles => generated 1420 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 15:29:17.217399 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6153647-7d49-464c-8102-fb32a3207b1f admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:17.227802 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d81121-6e81-49c6-ba99-712703b16e41 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:17.248321 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6153647-7d49-464c-8102-fb32a3207b1f admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:17.252167 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab2980b-0948-4ef0-8531-aa2d5e46b462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:17.252552 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab2980b-0948-4ef0-8531-aa2d5e46b462 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:17.252840 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab2980b-0948-4ef0-8531-aa2d5e46b462 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:17.253115 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab2980b-0948-4ef0-8531-aa2d5e46b462 admin admin] PATH_INFO: `/v3/projects/4d4ad8a10fe64d88af0d059ce5ae632c` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:17.254883 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab2980b-0948-4ef0-8531-aa2d5e46b462 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d4ad8a10fe64d88af0d059ce5ae632c)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:17.257305 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab2980b-0948-4ef0-8531-aa2d5e46b462 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:17.268378 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700eb8a9-25d3-48da-8edd-0aa85a35d63d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:17.269074 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700eb8a9-25d3-48da-8edd-0aa85a35d63d admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:17.269361 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700eb8a9-25d3-48da-8edd-0aa85a35d63d admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:17.276465 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700eb8a9-25d3-48da-8edd-0aa85a35d63d admin admin] PATH_INFO: `/v3/projects/0f6765ac4f7a4e22bdf187e6d724fda4/users/ef951fe9082b43b993dfa5d1e9dc08d7/roles/f34412ad29f1478cba775b033129f71f` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:17.348289 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700eb8a9-25d3-48da-8edd-0aa85a35d63d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f6765ac4f7a4e22bdf187e6d724fda4, user_id=ef951fe9082b43b993dfa5d1e9dc08d7, role_id=f34412ad29f1478cba775b033129f71f)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:17.364513 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700eb8a9-25d3-48da-8edd-0aa85a35d63d admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:17.411905 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 900/1778] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 13 15:29:17 2022] PUT /identity/v3/projects/0f6765ac4f7a4e22bdf187e6d724fda4/users/ef951fe9082b43b993dfa5d1e9dc08d7/roles/f34412ad29f1478cba775b033129f71f => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:29:17.411905 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700eb8a9-25d3-48da-8edd-0aa85a35d63d admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:17.411905 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-700eb8a9-25d3-48da-8edd-0aa85a35d63d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:17.526664 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-0ab2980b-0948-4ef0-8531-aa2d5e46b462 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d4ad8a10fe64d88af0d059ce5ae632c', 'request_id': 'req-0ab2980b-0948-4ef0-8531-aa2d5e46b462'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:17.559596 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-0ab2980b-0948-4ef0-8531-aa2d5e46b462 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d4ad8a10fe64d88af0d059ce5ae632c', 'request_id': 'req-0ab2980b-0948-4ef0-8531-aa2d5e46b462'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:17.570249 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-0ab2980b-0948-4ef0-8531-aa2d5e46b462 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d4ad8a10fe64d88af0d059ce5ae632c', 'request_id': 'req-0ab2980b-0948-4ef0-8531-aa2d5e46b462'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:17.576397 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700eb8a9-25d3-48da-8edd-0aa85a35d63d admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:17.593531 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-0ab2980b-0948-4ef0-8531-aa2d5e46b462 admin admin] The token cache is being invalidate because project 4d4ad8a10fe64d88af0d059ce5ae632c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 15:29:17.595712 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-0ab2980b-0948-4ef0-8531-aa2d5e46b462 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:17.595712 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-0ab2980b-0948-4ef0-8531-aa2d5e46b462 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:17.598897 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 879/1779] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 13 15:29:17 2022] DELETE /identity/v3/projects/4d4ad8a10fe64d88af0d059ce5ae632c => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:29:17.600005 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab2980b-0948-4ef0-8531-aa2d5e46b462 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:17.606582 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-0ab2980b-0948-4ef0-8531-aa2d5e46b462 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:17.706595 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527ab9b8-bd0e-4073-95d3-515888c4622f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41675154bbba47388040966f75d84c3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:17.710337 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527ab9b8-bd0e-4073-95d3-515888c4622f service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:17.713486 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527ab9b8-bd0e-4073-95d3-515888c4622f service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:17.713809 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527ab9b8-bd0e-4073-95d3-515888c4622f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:17.718214 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-527ab9b8-bd0e-4073-95d3-515888c4622f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:17.864749 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab2980b-0948-4ef0-8531-aa2d5e46b462 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:17.883805 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbb93b3-40e1-4894-8014-bf21d14e968f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:17.891067 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbb93b3-40e1-4894-8014-bf21d14e968f admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:17.891067 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbb93b3-40e1-4894-8014-bf21d14e968f admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:17.891067 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbb93b3-40e1-4894-8014-bf21d14e968f admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:17.891067 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbb93b3-40e1-4894-8014-bf21d14e968f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:17.891067 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbb93b3-40e1-4894-8014-bf21d14e968f admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:17.919234 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 880/1780] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:29:17 2022] GET /identity/v3/roles => generated 1420 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 15:29:17.919234 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbb93b3-40e1-4894-8014-bf21d14e968f admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:17.930475 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-9bbb93b3-40e1-4894-8014-bf21d14e968f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:17.967013 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbb93b3-40e1-4894-8014-bf21d14e968f admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:17.988046 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab56a44-3835-45d1-8474-bbcb4aa9b200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:17.988046 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab56a44-3835-45d1-8474-bbcb4aa9b200 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:17.988046 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab56a44-3835-45d1-8474-bbcb4aa9b200 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:17.988046 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab56a44-3835-45d1-8474-bbcb4aa9b200 admin admin] PATH_INFO: `/v3/users/f280998ca51648999931a84dcfa2f8c7` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:17.989444 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab56a44-3835-45d1-8474-bbcb4aa9b200 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f280998ca51648999931a84dcfa2f8c7)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:17.994466 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab56a44-3835-45d1-8474-bbcb4aa9b200 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:18.025820 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527ab9b8-bd0e-4073-95d3-515888c4622f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:18.031655 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527ab9b8-bd0e-4073-95d3-515888c4622f service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:18.062533 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 901/1781] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:29:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 661 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:29:18.063642 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527ab9b8-bd0e-4073-95d3-515888c4622f service neutron] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:18.087745 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:29:18.092156 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527ab9b8-bd0e-4073-95d3-515888c4622f service neutron] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:18.104632 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b075a3-d7d2-4dd2-8837-654ec9413c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:18.105726 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b075a3-d7d2-4dd2-8837-654ec9413c85 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:18.108350 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b075a3-d7d2-4dd2-8837-654ec9413c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:18.108747 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b075a3-d7d2-4dd2-8837-654ec9413c85 admin admin] PATH_INFO: `/v3/projects/0f6765ac4f7a4e22bdf187e6d724fda4/users/ef951fe9082b43b993dfa5d1e9dc08d7/roles/f34412ad29f1478cba775b033129f71f` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:18.114334 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b075a3-d7d2-4dd2-8837-654ec9413c85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f6765ac4f7a4e22bdf187e6d724fda4, user_id=ef951fe9082b43b993dfa5d1e9dc08d7, role_id=f34412ad29f1478cba775b033129f71f)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:18.120333 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b075a3-d7d2-4dd2-8837-654ec9413c85 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:18.135599 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-1ab56a44-3835-45d1-8474-bbcb4aa9b200 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f280998ca51648999931a84dcfa2f8c7'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:18.138208 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-1ab56a44-3835-45d1-8474-bbcb4aa9b200 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f280998ca51648999931a84dcfa2f8c7'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:18.139518 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-1ab56a44-3835-45d1-8474-bbcb4aa9b200 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f280998ca51648999931a84dcfa2f8c7'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:18.159129 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 902/1782] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 13 15:29:18 2022] PUT /identity/v3/projects/0f6765ac4f7a4e22bdf187e6d724fda4/users/ef951fe9082b43b993dfa5d1e9dc08d7/roles/f34412ad29f1478cba775b033129f71f => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:29:18.162929 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec305f8-ac71-4b8e-9c12-f2ec9d0995c5 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:18.163226 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec305f8-ac71-4b8e-9c12-f2ec9d0995c5 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:18.163506 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec305f8-ac71-4b8e-9c12-f2ec9d0995c5 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:18.165945 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-1ab56a44-3835-45d1-8474-bbcb4aa9b200 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f280998ca51648999931a84dcfa2f8c7'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:18.167090 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 903/1783] 10.222.0.27 () {54 vars in 921 bytes} [Tue Sep 13 15:29:18 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:29:18.168332 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6874923-5343-4957-acef-bdba333c566c None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:18.168613 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6874923-5343-4957-acef-bdba333c566c None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:18.168918 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6874923-5343-4957-acef-bdba333c566c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:18.213500 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-1ab56a44-3835-45d1-8474-bbcb4aa9b200 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f280998ca51648999931a84dcfa2f8c7'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:18.247030 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 881/1784] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 13 15:29:17 2022] DELETE /identity/v3/users/f280998ca51648999931a84dcfa2f8c7 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:29:18.268005 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e915a77-8ba0-4f2d-83ae-98b1d2217237 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:18.268294 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e915a77-8ba0-4f2d-83ae-98b1d2217237 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:18.268619 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e915a77-8ba0-4f2d-83ae-98b1d2217237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:18.308475 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-5e915a77-8ba0-4f2d-83ae-98b1d2217237 None None] MFA Rules not processed for user `62aad71c6c1a4469805762bba330bf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:29:18.310842 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-5e915a77-8ba0-4f2d-83ae-98b1d2217237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:18.320357 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-f6874923-5343-4957-acef-bdba333c566c None None] MFA Rules not processed for user `ef951fe9082b43b993dfa5d1e9dc08d7`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:29:18.321908 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-f6874923-5343-4957-acef-bdba333c566c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:18.410357 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:29:18.561555 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 882/1785] 10.222.0.27 () {58 vars in 1018 bytes} [Tue Sep 13 15:29:18 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 15:29:18.776613 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 904/1786] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:29:18 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 609 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:29:18.829025 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e915a77-8ba0-4f2d-83ae-98b1d2217237 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:18.830646 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-5e915a77-8ba0-4f2d-83ae-98b1d2217237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:19.016507 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e915a77-8ba0-4f2d-83ae-98b1d2217237 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:19.028819 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5aef7e-a48c-4d19-ad13-5697c88ae263 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97acd23097d54bf7805c3cef60626ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:19.029477 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5aef7e-a48c-4d19-ad13-5697c88ae263 service cinder] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:19.030879 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5aef7e-a48c-4d19-ad13-5697c88ae263 service cinder] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:19.033041 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5aef7e-a48c-4d19-ad13-5697c88ae263 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:19.039852 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-1b5aef7e-a48c-4d19-ad13-5697c88ae263 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:19.215122 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:29:19.224054 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6874923-5343-4957-acef-bdba333c566c None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:19.227127 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-f6874923-5343-4957-acef-bdba333c566c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:19.231972 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5aef7e-a48c-4d19-ad13-5697c88ae263 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:19.235472 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5aef7e-a48c-4d19-ad13-5697c88ae263 service cinder] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:19.260825 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 883/1787] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:29:18 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:29:19.323752 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6874923-5343-4957-acef-bdba333c566c None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:19.355473 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbb6187-1794-4ee8-85b9-b2cc46c00a0e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62aad71c6c1a4469805762bba330bf0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:19.356135 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbb6187-1794-4ee8-85b9-b2cc46c00a0e service nova] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:19.356419 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbb6187-1794-4ee8-85b9-b2cc46c00a0e service nova] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:19.364762 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbb6187-1794-4ee8-85b9-b2cc46c00a0e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:19.406516 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbb6187-1794-4ee8-85b9-b2cc46c00a0e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:19.409148 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbb6187-1794-4ee8-85b9-b2cc46c00a0e service nova] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:19.472031 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 905/1788] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:29:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:29:21.471325 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5aef7e-a48c-4d19-ad13-5697c88ae263 service cinder] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:21.476227 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-1b5aef7e-a48c-4d19-ad13-5697c88ae263 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:21.734099 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5aef7e-a48c-4d19-ad13-5697c88ae263 service cinder] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:21.758836 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdf1a14-65c5-4a1e-993f-17275ad3d5f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:21.759720 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdf1a14-65c5-4a1e-993f-17275ad3d5f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:21.760012 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdf1a14-65c5-4a1e-993f-17275ad3d5f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:21.760374 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdf1a14-65c5-4a1e-993f-17275ad3d5f2 admin admin] PATH_INFO: `/v3/projects/5b13b5b67a9a4346a61e09001d082d9b` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:21.763072 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdf1a14-65c5-4a1e-993f-17275ad3d5f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b13b5b67a9a4346a61e09001d082d9b)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:21.768115 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdf1a14-65c5-4a1e-993f-17275ad3d5f2 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:21.801179 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbb6187-1794-4ee8-85b9-b2cc46c00a0e service nova] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:21.808117 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-bdbb6187-1794-4ee8-85b9-b2cc46c00a0e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:21.847876 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbb6187-1794-4ee8-85b9-b2cc46c00a0e service nova] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:21.862505 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da26295-69c4-473d-bfd6-52a68fa2ebe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:21.865250 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da26295-69c4-473d-bfd6-52a68fa2ebe0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:21.866427 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da26295-69c4-473d-bfd6-52a68fa2ebe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:21.869216 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da26295-69c4-473d-bfd6-52a68fa2ebe0 admin admin] PATH_INFO: `/v3/projects/74295bd678b34058a9e31ccc740e879e` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:21.871615 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da26295-69c4-473d-bfd6-52a68fa2ebe0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=74295bd678b34058a9e31ccc740e879e)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:21.884089 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da26295-69c4-473d-bfd6-52a68fa2ebe0 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:21.939447 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-8bdf1a14-65c5-4a1e-993f-17275ad3d5f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b13b5b67a9a4346a61e09001d082d9b', 'request_id': 'req-8bdf1a14-65c5-4a1e-993f-17275ad3d5f2'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:21.967963 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-8bdf1a14-65c5-4a1e-993f-17275ad3d5f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b13b5b67a9a4346a61e09001d082d9b', 'request_id': 'req-8bdf1a14-65c5-4a1e-993f-17275ad3d5f2'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:21.995924 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-8bdf1a14-65c5-4a1e-993f-17275ad3d5f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b13b5b67a9a4346a61e09001d082d9b', 'request_id': 'req-8bdf1a14-65c5-4a1e-993f-17275ad3d5f2'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:22.047997 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-8da26295-69c4-473d-bfd6-52a68fa2ebe0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74295bd678b34058a9e31ccc740e879e', 'request_id': 'req-8da26295-69c4-473d-bfd6-52a68fa2ebe0'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:22.060214 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-8da26295-69c4-473d-bfd6-52a68fa2ebe0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74295bd678b34058a9e31ccc740e879e', 'request_id': 'req-8da26295-69c4-473d-bfd6-52a68fa2ebe0'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:22.060736 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-8bdf1a14-65c5-4a1e-993f-17275ad3d5f2 admin admin] The token cache is being invalidate because project 5b13b5b67a9a4346a61e09001d082d9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 15:29:22.062620 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-8bdf1a14-65c5-4a1e-993f-17275ad3d5f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:22.074849 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-8da26295-69c4-473d-bfd6-52a68fa2ebe0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74295bd678b34058a9e31ccc740e879e', 'request_id': 'req-8da26295-69c4-473d-bfd6-52a68fa2ebe0'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:22.079616 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-8bdf1a14-65c5-4a1e-993f-17275ad3d5f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:22.089056 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 884/1789] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 13 15:29:21 2022] DELETE /identity/v3/projects/5b13b5b67a9a4346a61e09001d082d9b => generated 0 bytes in 616 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:29:22.090883 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdf1a14-65c5-4a1e-993f-17275ad3d5f2 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:22.094884 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-8bdf1a14-65c5-4a1e-993f-17275ad3d5f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:22.100698 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-8da26295-69c4-473d-bfd6-52a68fa2ebe0 admin admin] The token cache is being invalidate because project 74295bd678b34058a9e31ccc740e879e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 15:29:22.102261 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-8da26295-69c4-473d-bfd6-52a68fa2ebe0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:22.103669 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-8da26295-69c4-473d-bfd6-52a68fa2ebe0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:22.106100 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 906/1790] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 13 15:29:21 2022] DELETE /identity/v3/projects/74295bd678b34058a9e31ccc740e879e => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:29:22.112578 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e208157-9e4f-40d3-9915-6fdbab50daab None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:22.113731 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e208157-9e4f-40d3-9915-6fdbab50daab None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:22.114329 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e208157-9e4f-40d3-9915-6fdbab50daab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:22.163997 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-1e208157-9e4f-40d3-9915-6fdbab50daab None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:29:22.168329 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-1e208157-9e4f-40d3-9915-6fdbab50daab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:22.282102 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdf1a14-65c5-4a1e-993f-17275ad3d5f2 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:22.307994 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 907/1791] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:29:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:29:22.315604 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3d3199-c601-4df2-ad2c-f9e63323b259 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:22.316323 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3d3199-c601-4df2-ad2c-f9e63323b259 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:22.317341 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3d3199-c601-4df2-ad2c-f9e63323b259 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:22.357977 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-aa3d3199-c601-4df2-ad2c-f9e63323b259 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:29:22.359650 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-aa3d3199-c601-4df2-ad2c-f9e63323b259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:22.362202 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:29:22.382159 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 908/1792] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:29:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:29:22.386011 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3d3199-c601-4df2-ad2c-f9e63323b259 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:22.416063 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3d3199-c601-4df2-ad2c-f9e63323b259 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:22.435764 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb46f8aa-5299-4605-835f-1457ea67ae97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:22.437005 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb46f8aa-5299-4605-835f-1457ea67ae97 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:22.437575 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb46f8aa-5299-4605-835f-1457ea67ae97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:22.438205 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb46f8aa-5299-4605-835f-1457ea67ae97 admin admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:22.438750 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f0679f-a2de-4e27-abdf-d2554363a29f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:22.439261 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb46f8aa-5299-4605-835f-1457ea67ae97 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:29:22.439454 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f0679f-a2de-4e27-abdf-d2554363a29f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:22.439743 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f0679f-a2de-4e27-abdf-d2554363a29f admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:22.439854 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb46f8aa-5299-4605-835f-1457ea67ae97 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:22.440082 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f0679f-a2de-4e27-abdf-d2554363a29f admin admin] PATH_INFO: `/v3/users/cc0ad8e8dc5f46c79fa526501e1c2366` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:22.444099 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb46f8aa-5299-4605-835f-1457ea67ae97 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:22.446487 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f0679f-a2de-4e27-abdf-d2554363a29f admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc0ad8e8dc5f46c79fa526501e1c2366)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:22.453069 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f0679f-a2de-4e27-abdf-d2554363a29f admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:22.485540 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 909/1793] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Sep 13 15:29:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 15:29:22.498585 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb46f8aa-5299-4605-835f-1457ea67ae97 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:22.518815 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb46f8aa-5299-4605-835f-1457ea67ae97 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:22.522511 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:29:22.531109 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403ac0b3-020e-4664-840e-185c4b9fe635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:22.532776 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403ac0b3-020e-4664-840e-185c4b9fe635 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:22.533474 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403ac0b3-020e-4664-840e-185c4b9fe635 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:22.534468 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403ac0b3-020e-4664-840e-185c4b9fe635 admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:22.548381 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403ac0b3-020e-4664-840e-185c4b9fe635 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:22.579638 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-d0f0679f-a2de-4e27-abdf-d2554363a29f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc0ad8e8dc5f46c79fa526501e1c2366'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:22.580401 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-d0f0679f-a2de-4e27-abdf-d2554363a29f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc0ad8e8dc5f46c79fa526501e1c2366'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:22.581902 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-d0f0679f-a2de-4e27-abdf-d2554363a29f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc0ad8e8dc5f46c79fa526501e1c2366'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:22.604220 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403ac0b3-020e-4664-840e-185c4b9fe635 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:22.623670 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-d0f0679f-a2de-4e27-abdf-d2554363a29f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc0ad8e8dc5f46c79fa526501e1c2366'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:22.679944 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-d0f0679f-a2de-4e27-abdf-d2554363a29f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc0ad8e8dc5f46c79fa526501e1c2366'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:22.700977 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 910/1794] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 13 15:29:22 2022] POST /identity/v3/projects => generated 379 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:29:22.703208 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403ac0b3-020e-4664-840e-185c4b9fe635 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:22.707194 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-403ac0b3-020e-4664-840e-185c4b9fe635 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:22.715423 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 885/1795] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 13 15:29:22 2022] DELETE /identity/v3/users/cc0ad8e8dc5f46c79fa526501e1c2366 => generated 0 bytes in 625 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:29:22.919554 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403ac0b3-020e-4664-840e-185c4b9fe635 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:22.961973 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f0679f-a2de-4e27-abdf-d2554363a29f admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:22.963743 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-d0f0679f-a2de-4e27-abdf-d2554363a29f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:23.107401 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503c9f51-1b8d-49f2-a539-121fa3c8b489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:23.108074 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503c9f51-1b8d-49f2-a539-121fa3c8b489 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:23.108368 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503c9f51-1b8d-49f2-a539-121fa3c8b489 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:23.108646 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503c9f51-1b8d-49f2-a539-121fa3c8b489 admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:23.109330 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503c9f51-1b8d-49f2-a539-121fa3c8b489 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:23.125628 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503c9f51-1b8d-49f2-a539-121fa3c8b489 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:23.152655 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f0679f-a2de-4e27-abdf-d2554363a29f admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:23.160742 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4a19ea-e0a4-4bbd-a5e9-d1f0c4399a9c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97acd23097d54bf7805c3cef60626ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:23.161385 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4a19ea-e0a4-4bbd-a5e9-d1f0c4399a9c service cinder] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:23.161673 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4a19ea-e0a4-4bbd-a5e9-d1f0c4399a9c service cinder] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:23.162039 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4a19ea-e0a4-4bbd-a5e9-d1f0c4399a9c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:23.168648 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-9b4a19ea-e0a4-4bbd-a5e9-d1f0c4399a9c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:23.216175 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 911/1796] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 13 15:29:22 2022] POST /identity/v3/users => generated 290 bytes in 514 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:29:23.218615 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503c9f51-1b8d-49f2-a539-121fa3c8b489 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:23.256126 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503c9f51-1b8d-49f2-a539-121fa3c8b489 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:23.283095 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559bfb72-f076-490c-8597-6d8f59c84588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:23.283735 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559bfb72-f076-490c-8597-6d8f59c84588 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:23.284018 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559bfb72-f076-490c-8597-6d8f59c84588 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:23.284284 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559bfb72-f076-490c-8597-6d8f59c84588 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:23.284945 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559bfb72-f076-490c-8597-6d8f59c84588 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:23.287174 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559bfb72-f076-490c-8597-6d8f59c84588 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:23.303638 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4a19ea-e0a4-4bbd-a5e9-d1f0c4399a9c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:23.306423 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4a19ea-e0a4-4bbd-a5e9-d1f0c4399a9c service cinder] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:23.313753 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:29:23.326717 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 912/1797] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:29:23 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 15:29:23.342746 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559bfb72-f076-490c-8597-6d8f59c84588 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:23.344841 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 886/1798] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:29:22 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:29:23.381296 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559bfb72-f076-490c-8597-6d8f59c84588 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:23.391941 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7714b136-3a3e-4d25-9e26-12942fdce61b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:23.392618 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7714b136-3a3e-4d25-9e26-12942fdce61b admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:23.392928 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7714b136-3a3e-4d25-9e26-12942fdce61b admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:23.393202 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7714b136-3a3e-4d25-9e26-12942fdce61b admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:23.393842 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7714b136-3a3e-4d25-9e26-12942fdce61b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:23.396250 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7714b136-3a3e-4d25-9e26-12942fdce61b admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:23.431141 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 913/1799] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:29:23 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 15:29:23.433056 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4a19ea-e0a4-4bbd-a5e9-d1f0c4399a9c service cinder] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:23.466691 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4a19ea-e0a4-4bbd-a5e9-d1f0c4399a9c service cinder] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:23.494277 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af2a822-89cd-4d32-af51-ac7752b5ad74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:23.498734 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af2a822-89cd-4d32-af51-ac7752b5ad74 admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:23.500178 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af2a822-89cd-4d32-af51-ac7752b5ad74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:23.502012 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af2a822-89cd-4d32-af51-ac7752b5ad74 admin admin] PATH_INFO: `/v3/projects/129ad73105e3426eb17071d3beaefdf3/users/7150bf60381f4a69bc61a6b7ea707a22/roles/3fae3d3a28e147d3b2bede2378ff79ae` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:23.584163 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af2a822-89cd-4d32-af51-ac7752b5ad74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=129ad73105e3426eb17071d3beaefdf3, user_id=7150bf60381f4a69bc61a6b7ea707a22, role_id=3fae3d3a28e147d3b2bede2378ff79ae)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:23.594524 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af2a822-89cd-4d32-af51-ac7752b5ad74 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:23.672299 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d36e0b-de48-4548-a603-ff3b081fee1b None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:23.672591 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d36e0b-de48-4548-a603-ff3b081fee1b None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:23.672871 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d36e0b-de48-4548-a603-ff3b081fee1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:23.673642 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 887/1800] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 13 15:29:23 2022] PUT /identity/v3/projects/129ad73105e3426eb17071d3beaefdf3/users/7150bf60381f4a69bc61a6b7ea707a22/roles/3fae3d3a28e147d3b2bede2378ff79ae => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:29:23.782733 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-a7d36e0b-de48-4548-a603-ff3b081fee1b None None] MFA Rules not processed for user `7150bf60381f4a69bc61a6b7ea707a22`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:29:23.784000 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-a7d36e0b-de48-4548-a603-ff3b081fee1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:23.985278 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:29:24.093571 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 914/1801] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:29:23 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 422 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 15:29:24.100712 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af2a822-89cd-4d32-af51-ac7752b5ad74 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:24.443376 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af2a822-89cd-4d32-af51-ac7752b5ad74 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:24.455687 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6361b17a-dd50-4570-91d2-0f923b89b62d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:24.456822 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6361b17a-dd50-4570-91d2-0f923b89b62d admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:24.457985 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6361b17a-dd50-4570-91d2-0f923b89b62d admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:24.458382 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6361b17a-dd50-4570-91d2-0f923b89b62d admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:24.459324 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6361b17a-dd50-4570-91d2-0f923b89b62d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:24.465597 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6361b17a-dd50-4570-91d2-0f923b89b62d admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:24.538048 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d36e0b-de48-4548-a603-ff3b081fee1b None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:24.548795 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 888/1802] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 13 15:29:24 2022] POST /identity/v3/projects => generated 381 bytes in 449 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:29:24.570073 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d36e0b-de48-4548-a603-ff3b081fee1b None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:24.780083 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8753f1a4-45e5-44a2-8aac-8f97dca6504f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:24.781189 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8753f1a4-45e5-44a2-8aac-8f97dca6504f admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:24.781824 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8753f1a4-45e5-44a2-8aac-8f97dca6504f admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:24.782627 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8753f1a4-45e5-44a2-8aac-8f97dca6504f admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:24.785026 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8753f1a4-45e5-44a2-8aac-8f97dca6504f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:24.789750 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8753f1a4-45e5-44a2-8aac-8f97dca6504f admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:24.856311 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6361b17a-dd50-4570-91d2-0f923b89b62d admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:24.871236 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 915/1803] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 13 15:29:24 2022] POST /identity/v3/users => generated 297 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:29:24.899540 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6361b17a-dd50-4570-91d2-0f923b89b62d admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:24.910214 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d99760-4489-457a-b820-01535ba2fbe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:24.912578 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d99760-4489-457a-b820-01535ba2fbe3 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:24.913501 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d99760-4489-457a-b820-01535ba2fbe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:24.914893 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d99760-4489-457a-b820-01535ba2fbe3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:24.917514 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d99760-4489-457a-b820-01535ba2fbe3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:24.920259 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d99760-4489-457a-b820-01535ba2fbe3 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:24.968359 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8753f1a4-45e5-44a2-8aac-8f97dca6504f admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:24.970420 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-8753f1a4-45e5-44a2-8aac-8f97dca6504f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:25.000454 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 889/1804] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:29:24 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 15:29:25.003044 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d99760-4489-457a-b820-01535ba2fbe3 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:25.016045 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8753f1a4-45e5-44a2-8aac-8f97dca6504f admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:25.036876 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e8fdb4-7955-4d1c-be3a-4f2117cfc26e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:25.038392 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e8fdb4-7955-4d1c-be3a-4f2117cfc26e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:25.038681 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e8fdb4-7955-4d1c-be3a-4f2117cfc26e admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:25.040342 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e8fdb4-7955-4d1c-be3a-4f2117cfc26e admin admin] PATH_INFO: `/v3/projects/4102388053024be3832a7fc7184e1ae8` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:25.042381 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d99760-4489-457a-b820-01535ba2fbe3 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:25.044185 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e8fdb4-7955-4d1c-be3a-4f2117cfc26e admin admin] RBAC: Authorizing `identity:delete_project(project_id=4102388053024be3832a7fc7184e1ae8)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:25.049338 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e8fdb4-7955-4d1c-be3a-4f2117cfc26e admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:25.062272 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49997725-71ab-46da-a6aa-cf2f4bf47248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:25.063155 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49997725-71ab-46da-a6aa-cf2f4bf47248 admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:25.064066 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49997725-71ab-46da-a6aa-cf2f4bf47248 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:25.065234 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49997725-71ab-46da-a6aa-cf2f4bf47248 admin admin] PATH_INFO: `/v3/projects/69f958336cd24204b7e5e3e9d9d9b90c/users/97cc06ef73e44881ab57a5fd4836dc08/roles/f34412ad29f1478cba775b033129f71f` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:25.116460 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49997725-71ab-46da-a6aa-cf2f4bf47248 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69f958336cd24204b7e5e3e9d9d9b90c, user_id=97cc06ef73e44881ab57a5fd4836dc08, role_id=f34412ad29f1478cba775b033129f71f)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:25.126673 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49997725-71ab-46da-a6aa-cf2f4bf47248 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:25.162309 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 890/1805] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 13 15:29:25 2022] PUT /identity/v3/projects/69f958336cd24204b7e5e3e9d9d9b90c/users/97cc06ef73e44881ab57a5fd4836dc08/roles/f34412ad29f1478cba775b033129f71f => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:29:25.168016 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49997725-71ab-46da-a6aa-cf2f4bf47248 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:25.214723 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-14e8fdb4-7955-4d1c-be3a-4f2117cfc26e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4102388053024be3832a7fc7184e1ae8', 'request_id': 'req-14e8fdb4-7955-4d1c-be3a-4f2117cfc26e'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:25.230244 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-14e8fdb4-7955-4d1c-be3a-4f2117cfc26e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4102388053024be3832a7fc7184e1ae8', 'request_id': 'req-14e8fdb4-7955-4d1c-be3a-4f2117cfc26e'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:25.263260 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-14e8fdb4-7955-4d1c-be3a-4f2117cfc26e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4102388053024be3832a7fc7184e1ae8', 'request_id': 'req-14e8fdb4-7955-4d1c-be3a-4f2117cfc26e'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:25.279742 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-14e8fdb4-7955-4d1c-be3a-4f2117cfc26e admin admin] The token cache is being invalidate because project 4102388053024be3832a7fc7184e1ae8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 15:29:25.280045 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-14e8fdb4-7955-4d1c-be3a-4f2117cfc26e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:25.283879 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-14e8fdb4-7955-4d1c-be3a-4f2117cfc26e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:25.291657 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 916/1806] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 13 15:29:24 2022] DELETE /identity/v3/projects/4102388053024be3832a7fc7184e1ae8 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:29:25.294036 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3d4097-85ca-45ed-982c-d1906d147336 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:25.294327 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3d4097-85ca-45ed-982c-d1906d147336 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:25.294604 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3d4097-85ca-45ed-982c-d1906d147336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:25.351208 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49997725-71ab-46da-a6aa-cf2f4bf47248 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:25.358542 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-bb3d4097-85ca-45ed-982c-d1906d147336 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:29:25.359826 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-bb3d4097-85ca-45ed-982c-d1906d147336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:25.531239 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:29:25.565565 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:29:25.603232 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 917/1807] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:29:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:29:25.611742 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab518f15-ace9-47b6-9a1b-bbb79ed9b940 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:25.612525 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab518f15-ace9-47b6-9a1b-bbb79ed9b940 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:25.613498 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab518f15-ace9-47b6-9a1b-bbb79ed9b940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:25.642971 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1956542-7ebf-4ee0-9882-4cec964b21a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:25.643912 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1956542-7ebf-4ee0-9882-4cec964b21a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:25.646938 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1956542-7ebf-4ee0-9882-4cec964b21a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:25.647370 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1956542-7ebf-4ee0-9882-4cec964b21a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:25.648196 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1956542-7ebf-4ee0-9882-4cec964b21a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:25.653547 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1956542-7ebf-4ee0-9882-4cec964b21a1 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:25.675517 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-ab518f15-ace9-47b6-9a1b-bbb79ed9b940 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:29:25.681183 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-ab518f15-ace9-47b6-9a1b-bbb79ed9b940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:25.686775 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 891/1808] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:29:25 2022] GET /identity/v3/roles => generated 1420 bytes in 520 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 15:29:25.689040 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1956542-7ebf-4ee0-9882-4cec964b21a1 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:25.701074 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-d1956542-7ebf-4ee0-9882-4cec964b21a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:25.734228 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 918/1809] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:29:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:29:25.741492 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1956542-7ebf-4ee0-9882-4cec964b21a1 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:25.748261 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd204d1c-7884-44ea-b00a-bad122eefea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:25.748976 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd204d1c-7884-44ea-b00a-bad122eefea7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:25.749331 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd204d1c-7884-44ea-b00a-bad122eefea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:25.749616 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd204d1c-7884-44ea-b00a-bad122eefea7 admin admin] PATH_INFO: `/v3/projects/69f958336cd24204b7e5e3e9d9d9b90c/users/97cc06ef73e44881ab57a5fd4836dc08/roles/f34412ad29f1478cba775b033129f71f` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:25.752849 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd204d1c-7884-44ea-b00a-bad122eefea7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69f958336cd24204b7e5e3e9d9d9b90c, user_id=97cc06ef73e44881ab57a5fd4836dc08, role_id=f34412ad29f1478cba775b033129f71f)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:25.758339 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab518f15-ace9-47b6-9a1b-bbb79ed9b940 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:25.772509 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd204d1c-7884-44ea-b00a-bad122eefea7 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:25.787018 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab518f15-ace9-47b6-9a1b-bbb79ed9b940 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:25.810169 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9373e19c-a362-4cb7-a46b-a840df819336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:25.814591 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9373e19c-a362-4cb7-a46b-a840df819336 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:25.814591 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9373e19c-a362-4cb7-a46b-a840df819336 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:25.832669 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9373e19c-a362-4cb7-a46b-a840df819336 admin admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:25.835972 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9373e19c-a362-4cb7-a46b-a840df819336 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:29:25.836269 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9373e19c-a362-4cb7-a46b-a840df819336 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:25.841344 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 892/1810] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 13 15:29:25 2022] PUT /identity/v3/projects/69f958336cd24204b7e5e3e9d9d9b90c/users/97cc06ef73e44881ab57a5fd4836dc08/roles/f34412ad29f1478cba775b033129f71f => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:29:25.848820 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9373e19c-a362-4cb7-a46b-a840df819336 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:25.859996 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6487fae-8ac4-463b-89ab-c8802fa2748a None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:25.860685 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6487fae-8ac4-463b-89ab-c8802fa2748a None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:25.860685 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6487fae-8ac4-463b-89ab-c8802fa2748a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:25.889921 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 919/1811] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Sep 13 15:29:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 15:29:25.892787 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9373e19c-a362-4cb7-a46b-a840df819336 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:25.938856 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9373e19c-a362-4cb7-a46b-a840df819336 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:25.949762 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-d6487fae-8ac4-463b-89ab-c8802fa2748a None None] MFA Rules not processed for user `97cc06ef73e44881ab57a5fd4836dc08`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:29:25.955562 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-d6487fae-8ac4-463b-89ab-c8802fa2748a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:26.153203 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6aef6e-2a7b-4cae-838b-55a8b104027b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:26.155576 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6aef6e-2a7b-4cae-838b-55a8b104027b admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:26.155898 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6aef6e-2a7b-4cae-838b-55a8b104027b admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:26.156221 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6aef6e-2a7b-4cae-838b-55a8b104027b admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:26.157660 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6aef6e-2a7b-4cae-838b-55a8b104027b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:26.169011 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6aef6e-2a7b-4cae-838b-55a8b104027b admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:26.171864 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 893/1812] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:29:25 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:29:26.213500 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6487fae-8ac4-463b-89ab-c8802fa2748a None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:26.215120 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-d6487fae-8ac4-463b-89ab-c8802fa2748a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:26.278598 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 920/1813] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 13 15:29:25 2022] POST /identity/v3/projects => generated 381 bytes in 387 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:29:26.282310 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6aef6e-2a7b-4cae-838b-55a8b104027b admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:26.311019 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6487fae-8ac4-463b-89ab-c8802fa2748a None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:26.435324 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a83afe5-02ea-4268-9594-4cefe4c3406b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97acd23097d54bf7805c3cef60626ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:26.435976 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a83afe5-02ea-4268-9594-4cefe4c3406b service cinder] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:26.436263 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a83afe5-02ea-4268-9594-4cefe4c3406b service cinder] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:26.437103 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a83afe5-02ea-4268-9594-4cefe4c3406b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:26.458209 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:29:26.469284 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6aef6e-2a7b-4cae-838b-55a8b104027b admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:26.483604 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262e554e-711c-47db-b173-fdff6dcc5169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:26.484342 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262e554e-711c-47db-b173-fdff6dcc5169 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:26.484631 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262e554e-711c-47db-b173-fdff6dcc5169 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:26.484952 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262e554e-711c-47db-b173-fdff6dcc5169 admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:26.486083 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262e554e-711c-47db-b173-fdff6dcc5169 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:26.488656 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262e554e-711c-47db-b173-fdff6dcc5169 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:26.541552 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 921/1814] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 13 15:29:26 2022] POST /identity/v3/users => generated 291 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:29:26.543172 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262e554e-711c-47db-b173-fdff6dcc5169 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:26.562264 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262e554e-711c-47db-b173-fdff6dcc5169 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:26.580789 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17547c59-2fe4-450b-abf7-345b0ca67a4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:26.583994 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17547c59-2fe4-450b-abf7-345b0ca67a4e admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:26.584342 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17547c59-2fe4-450b-abf7-345b0ca67a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:26.584940 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17547c59-2fe4-450b-abf7-345b0ca67a4e admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:26.586113 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17547c59-2fe4-450b-abf7-345b0ca67a4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:26.588073 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17547c59-2fe4-450b-abf7-345b0ca67a4e admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:26.589144 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a83afe5-02ea-4268-9594-4cefe4c3406b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:26.592601 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a83afe5-02ea-4268-9594-4cefe4c3406b service cinder] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:26.625659 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 922/1815] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:29:26 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 15:29:26.628011 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17547c59-2fe4-450b-abf7-345b0ca67a4e admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:26.629126 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 894/1816] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:29:26 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:29:26.642419 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17547c59-2fe4-450b-abf7-345b0ca67a4e admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:26.649445 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f868c2f-e4df-4faa-8aea-8bd26f4dbeab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:26.650686 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f868c2f-e4df-4faa-8aea-8bd26f4dbeab admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:26.650686 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f868c2f-e4df-4faa-8aea-8bd26f4dbeab admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:26.650686 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f868c2f-e4df-4faa-8aea-8bd26f4dbeab admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:26.651443 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f868c2f-e4df-4faa-8aea-8bd26f4dbeab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:26.653375 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f868c2f-e4df-4faa-8aea-8bd26f4dbeab admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:26.678496 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a83afe5-02ea-4268-9594-4cefe4c3406b service cinder] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:26.680606 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 923/1817] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:29:26 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 15:29:26.715011 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a83afe5-02ea-4268-9594-4cefe4c3406b service cinder] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:26.723854 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baffdba-7e17-4e56-8d75-c4ff336aab1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:26.725449 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baffdba-7e17-4e56-8d75-c4ff336aab1b admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:26.725769 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baffdba-7e17-4e56-8d75-c4ff336aab1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:26.726229 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baffdba-7e17-4e56-8d75-c4ff336aab1b admin admin] PATH_INFO: `/v3/projects/1849ab8282cc49008feb89df602bd08c/users/797f3eb3b64c4cccae65ac0e3cde922a/roles/3fae3d3a28e147d3b2bede2378ff79ae` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:26.773929 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baffdba-7e17-4e56-8d75-c4ff336aab1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1849ab8282cc49008feb89df602bd08c, user_id=797f3eb3b64c4cccae65ac0e3cde922a, role_id=3fae3d3a28e147d3b2bede2378ff79ae)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:26.777104 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baffdba-7e17-4e56-8d75-c4ff336aab1b admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:26.816704 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 895/1818] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 13 15:29:26 2022] PUT /identity/v3/projects/1849ab8282cc49008feb89df602bd08c/users/797f3eb3b64c4cccae65ac0e3cde922a/roles/3fae3d3a28e147d3b2bede2378ff79ae => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:29:26.821080 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e156edbc-609c-477f-a07b-a094c627fbca None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:26.821534 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e156edbc-609c-477f-a07b-a094c627fbca None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:26.821866 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e156edbc-609c-477f-a07b-a094c627fbca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:26.852665 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baffdba-7e17-4e56-8d75-c4ff336aab1b admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:26.935380 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-e156edbc-609c-477f-a07b-a094c627fbca None None] MFA Rules not processed for user `797f3eb3b64c4cccae65ac0e3cde922a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:29:26.941067 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-e156edbc-609c-477f-a07b-a094c627fbca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:26.989777 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:29:26.996182 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baffdba-7e17-4e56-8d75-c4ff336aab1b admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:27.001655 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514a2747-1574-45ee-8c96-95f0265f6334 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97acd23097d54bf7805c3cef60626ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:27.002551 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514a2747-1574-45ee-8c96-95f0265f6334 service cinder] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:27.003072 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514a2747-1574-45ee-8c96-95f0265f6334 service cinder] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:27.003481 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514a2747-1574-45ee-8c96-95f0265f6334 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:27.006071 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-514a2747-1574-45ee-8c96-95f0265f6334 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:27.048557 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 924/1819] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:29:26 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:29:27.053363 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e156edbc-609c-477f-a07b-a094c627fbca None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:27.073924 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514a2747-1574-45ee-8c96-95f0265f6334 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:27.075350 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514a2747-1574-45ee-8c96-95f0265f6334 service cinder] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:27.085240 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 896/1820] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:29:26 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 15:29:27.112169 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cec25e-12db-4aaf-a1f6-dfba6d558d74 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:27.112169 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cec25e-12db-4aaf-a1f6-dfba6d558d74 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:27.113586 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cec25e-12db-4aaf-a1f6-dfba6d558d74 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:27.114587 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 897/1821] 10.222.0.27 () {54 vars in 921 bytes} [Tue Sep 13 15:29:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:29:27.121625 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e156edbc-609c-477f-a07b-a094c627fbca None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:27.126729 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef33f242-9d6f-45ac-8ee0-ee3c77799a47 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:27.126729 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef33f242-9d6f-45ac-8ee0-ee3c77799a47 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:27.126729 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef33f242-9d6f-45ac-8ee0-ee3c77799a47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:27.133346 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1131de0-a736-47f6-a80f-58ca5af4a6ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:27.133857 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1131de0-a736-47f6-a80f-58ca5af4a6ea admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:27.134139 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1131de0-a736-47f6-a80f-58ca5af4a6ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:27.134409 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1131de0-a736-47f6-a80f-58ca5af4a6ea admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:27.135046 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1131de0-a736-47f6-a80f-58ca5af4a6ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:27.136948 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1131de0-a736-47f6-a80f-58ca5af4a6ea admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:27.152847 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-ef33f242-9d6f-45ac-8ee0-ee3c77799a47 None None] MFA Rules not processed for user `62aad71c6c1a4469805762bba330bf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:29:27.154416 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-ef33f242-9d6f-45ac-8ee0-ee3c77799a47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:27.180259 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 925/1822] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 13 15:29:27 2022] POST /identity/v3/projects => generated 379 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:29:27.180259 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1131de0-a736-47f6-a80f-58ca5af4a6ea admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:27.224103 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:29:27.322194 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 898/1823] 10.222.0.27 () {58 vars in 1018 bytes} [Tue Sep 13 15:29:27 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 15:29:27.332773 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1131de0-a736-47f6-a80f-58ca5af4a6ea admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:27.334060 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628ed64e-69fe-4932-bf4f-74ffe51b5d4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:27.334896 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628ed64e-69fe-4932-bf4f-74ffe51b5d4b admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:27.335282 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628ed64e-69fe-4932-bf4f-74ffe51b5d4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:27.335776 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628ed64e-69fe-4932-bf4f-74ffe51b5d4b admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:27.336532 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628ed64e-69fe-4932-bf4f-74ffe51b5d4b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:27.339015 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628ed64e-69fe-4932-bf4f-74ffe51b5d4b admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:27.350390 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef33f242-9d6f-45ac-8ee0-ee3c77799a47 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:27.355420 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-ef33f242-9d6f-45ac-8ee0-ee3c77799a47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:27.390285 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef33f242-9d6f-45ac-8ee0-ee3c77799a47 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:27.423043 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 926/1824] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 13 15:29:27 2022] POST /identity/v3/users => generated 296 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:29:27.425261 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628ed64e-69fe-4932-bf4f-74ffe51b5d4b admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:27.458935 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628ed64e-69fe-4932-bf4f-74ffe51b5d4b admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:27.472022 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efee2043-94b9-4bc9-a66c-85419ef199e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:27.473530 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efee2043-94b9-4bc9-a66c-85419ef199e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:27.473530 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efee2043-94b9-4bc9-a66c-85419ef199e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:27.473842 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efee2043-94b9-4bc9-a66c-85419ef199e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:27.474629 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efee2043-94b9-4bc9-a66c-85419ef199e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:27.477538 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efee2043-94b9-4bc9-a66c-85419ef199e6 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:27.514772 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 927/1825] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:29:27 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 15:29:27.517249 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efee2043-94b9-4bc9-a66c-85419ef199e6 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:27.533584 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159ced68-2e42-4cca-83a6-25846f7c1e42 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62aad71c6c1a4469805762bba330bf0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:27.534639 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159ced68-2e42-4cca-83a6-25846f7c1e42 service nova] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:27.535099 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159ced68-2e42-4cca-83a6-25846f7c1e42 service nova] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:27.535586 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159ced68-2e42-4cca-83a6-25846f7c1e42 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:27.536687 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efee2043-94b9-4bc9-a66c-85419ef199e6 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:27.551799 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e48998-537a-4cc6-920f-f69f15bcc969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:27.552364 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e48998-537a-4cc6-920f-f69f15bcc969 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:27.552631 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159ced68-2e42-4cca-83a6-25846f7c1e42 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:27.553391 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e48998-537a-4cc6-920f-f69f15bcc969 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:27.553656 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e48998-537a-4cc6-920f-f69f15bcc969 admin admin] PATH_INFO: `/v3/projects/fe0ed95091384eb18c1ab107f81a7599/users/7d29f6bc41354ab180c25c793cdf035f/roles/f34412ad29f1478cba775b033129f71f` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:27.555542 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159ced68-2e42-4cca-83a6-25846f7c1e42 service nova] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:27.569760 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 899/1826] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:29:27 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 15:29:27.584206 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e48998-537a-4cc6-920f-f69f15bcc969 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe0ed95091384eb18c1ab107f81a7599, user_id=7d29f6bc41354ab180c25c793cdf035f, role_id=f34412ad29f1478cba775b033129f71f)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:27.586739 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e48998-537a-4cc6-920f-f69f15bcc969 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:27.630299 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 928/1827] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 13 15:29:27 2022] PUT /identity/v3/projects/fe0ed95091384eb18c1ab107f81a7599/users/7d29f6bc41354ab180c25c793cdf035f/roles/f34412ad29f1478cba775b033129f71f => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 15:29:27.631607 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159ced68-2e42-4cca-83a6-25846f7c1e42 service nova] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:27.650152 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159ced68-2e42-4cca-83a6-25846f7c1e42 service nova] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:27.693312 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e48998-537a-4cc6-920f-f69f15bcc969 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:27.698907 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:29:27.792748 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4568c16-5a5c-4205-81f0-8b95e46a6f23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:27.793499 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4568c16-5a5c-4205-81f0-8b95e46a6f23 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:27.793828 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4568c16-5a5c-4205-81f0-8b95e46a6f23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:27.794159 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4568c16-5a5c-4205-81f0-8b95e46a6f23 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:27.794819 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4568c16-5a5c-4205-81f0-8b95e46a6f23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:27.797279 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4568c16-5a5c-4205-81f0-8b95e46a6f23 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:27.810293 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e48998-537a-4cc6-920f-f69f15bcc969 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:27.818557 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 900/1828] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:29:27 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 15:29:27.819656 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4568c16-5a5c-4205-81f0-8b95e46a6f23 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:27.831051 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7350ef2b-65da-4991-be4b-5cb112e6dc08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:27.831720 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7350ef2b-65da-4991-be4b-5cb112e6dc08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:27.832338 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7350ef2b-65da-4991-be4b-5cb112e6dc08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:27.833011 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7350ef2b-65da-4991-be4b-5cb112e6dc08 admin admin] PATH_INFO: `/v3/users/7150bf60381f4a69bc61a6b7ea707a22` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:27.837949 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7350ef2b-65da-4991-be4b-5cb112e6dc08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7150bf60381f4a69bc61a6b7ea707a22)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:27.840282 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7350ef2b-65da-4991-be4b-5cb112e6dc08 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:27.843518 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4568c16-5a5c-4205-81f0-8b95e46a6f23 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:27.854675 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8612af-ea34-4ba8-bb7c-bfa0f4d2f90b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:27.855739 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8612af-ea34-4ba8-bb7c-bfa0f4d2f90b admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:27.856034 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8612af-ea34-4ba8-bb7c-bfa0f4d2f90b admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:27.856698 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8612af-ea34-4ba8-bb7c-bfa0f4d2f90b admin admin] PATH_INFO: `/v3/projects/fe0ed95091384eb18c1ab107f81a7599/users/7d29f6bc41354ab180c25c793cdf035f/roles/f34412ad29f1478cba775b033129f71f` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:27.860386 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8612af-ea34-4ba8-bb7c-bfa0f4d2f90b admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe0ed95091384eb18c1ab107f81a7599, user_id=7d29f6bc41354ab180c25c793cdf035f, role_id=f34412ad29f1478cba775b033129f71f)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:27.864163 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8612af-ea34-4ba8-bb7c-bfa0f4d2f90b admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:27.889688 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 901/1829] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 13 15:29:27 2022] PUT /identity/v3/projects/fe0ed95091384eb18c1ab107f81a7599/users/7d29f6bc41354ab180c25c793cdf035f/roles/f34412ad29f1478cba775b033129f71f => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:29:27.905778 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9ec7c3-b92c-4179-b14e-6ec0342e6594 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:27.906089 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9ec7c3-b92c-4179-b14e-6ec0342e6594 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:27.907724 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9ec7c3-b92c-4179-b14e-6ec0342e6594 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:27.938066 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-7350ef2b-65da-4991-be4b-5cb112e6dc08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7150bf60381f4a69bc61a6b7ea707a22'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:27.948551 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-7350ef2b-65da-4991-be4b-5cb112e6dc08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7150bf60381f4a69bc61a6b7ea707a22'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:27.948551 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-7350ef2b-65da-4991-be4b-5cb112e6dc08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7150bf60381f4a69bc61a6b7ea707a22'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:27.962489 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-7350ef2b-65da-4991-be4b-5cb112e6dc08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7150bf60381f4a69bc61a6b7ea707a22'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:28.000001 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-7350ef2b-65da-4991-be4b-5cb112e6dc08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7150bf60381f4a69bc61a6b7ea707a22'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:28.010926 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-ed9ec7c3-b92c-4179-b14e-6ec0342e6594 None None] MFA Rules not processed for user `7d29f6bc41354ab180c25c793cdf035f`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:29:28.012384 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-ed9ec7c3-b92c-4179-b14e-6ec0342e6594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:28.046839 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 929/1830] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 13 15:29:27 2022] DELETE /identity/v3/users/7150bf60381f4a69bc61a6b7ea707a22 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 15:29:28.051858 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd53aeca-3ac6-4379-b133-f7e2a1c41de1 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:28.052627 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd53aeca-3ac6-4379-b133-f7e2a1c41de1 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:28.052760 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd53aeca-3ac6-4379-b133-f7e2a1c41de1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:28.079759 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:29:28.093862 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-dd53aeca-3ac6-4379-b133-f7e2a1c41de1 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:29:28.098347 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-dd53aeca-3ac6-4379-b133-f7e2a1c41de1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:28.149363 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 902/1831] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:29:27 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:29:28.166426 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9ec7c3-b92c-4179-b14e-6ec0342e6594 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:28.168079 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-ed9ec7c3-b92c-4179-b14e-6ec0342e6594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:28.243974 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 930/1832] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:29:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:29:28.272084 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd53aeca-3ac6-4379-b133-f7e2a1c41de1 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:28.273826 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-dd53aeca-3ac6-4379-b133-f7e2a1c41de1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:28.286020 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9ec7c3-b92c-4179-b14e-6ec0342e6594 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:28.307166 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:29:28.366576 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd53aeca-3ac6-4379-b133-f7e2a1c41de1 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:28.380670 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0828e392-880f-49fc-afaa-c14fa26a5549 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41675154bbba47388040966f75d84c3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:28.381314 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0828e392-880f-49fc-afaa-c14fa26a5549 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:28.381596 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0828e392-880f-49fc-afaa-c14fa26a5549 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:28.381910 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0828e392-880f-49fc-afaa-c14fa26a5549 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:28.401384 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4bfc22-fbc3-4907-8cd8-aa69b7baa519 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97acd23097d54bf7805c3cef60626ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:28.402260 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4bfc22-fbc3-4907-8cd8-aa69b7baa519 service cinder] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:28.402684 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4bfc22-fbc3-4907-8cd8-aa69b7baa519 service cinder] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:28.402952 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4bfc22-fbc3-4907-8cd8-aa69b7baa519 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:28.403596 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0828e392-880f-49fc-afaa-c14fa26a5549 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:28.405181 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0828e392-880f-49fc-afaa-c14fa26a5549 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:28.416697 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 931/1833] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:29:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:29:28.479228 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4bfc22-fbc3-4907-8cd8-aa69b7baa519 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:28.480781 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4bfc22-fbc3-4907-8cd8-aa69b7baa519 service cinder] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:28.493192 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 903/1834] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:29:28 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:29:28.696468 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0828e392-880f-49fc-afaa-c14fa26a5549 service neutron] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:28.697971 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-0828e392-880f-49fc-afaa-c14fa26a5549 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:28.710347 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0828e392-880f-49fc-afaa-c14fa26a5549 service neutron] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:28.714398 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85615233-6782-4f32-a3e4-e7411229e914 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97acd23097d54bf7805c3cef60626ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:28.715082 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85615233-6782-4f32-a3e4-e7411229e914 service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:28.715531 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85615233-6782-4f32-a3e4-e7411229e914 service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:28.715739 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85615233-6782-4f32-a3e4-e7411229e914 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:28.717452 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-85615233-6782-4f32-a3e4-e7411229e914 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:28.784782 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85615233-6782-4f32-a3e4-e7411229e914 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:28.786937 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85615233-6782-4f32-a3e4-e7411229e914 service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:28.796448 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 932/1835] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:29:28 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:29:28.872905 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4bfc22-fbc3-4907-8cd8-aa69b7baa519 service cinder] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:28.874486 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-ca4bfc22-fbc3-4907-8cd8-aa69b7baa519 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:28.890807 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4bfc22-fbc3-4907-8cd8-aa69b7baa519 service cinder] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:28.896484 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ddd27e-318a-4de1-965c-500328e78d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:28.897115 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ddd27e-318a-4de1-965c-500328e78d6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:28.897396 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ddd27e-318a-4de1-965c-500328e78d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:28.897674 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ddd27e-318a-4de1-965c-500328e78d6d admin admin] PATH_INFO: `/v3/projects/129ad73105e3426eb17071d3beaefdf3` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:28.898929 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ddd27e-318a-4de1-965c-500328e78d6d admin admin] RBAC: Authorizing `identity:delete_project(project_id=129ad73105e3426eb17071d3beaefdf3)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:28.900868 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ddd27e-318a-4de1-965c-500328e78d6d admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:28.928659 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:29:28.957834 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-94ddd27e-318a-4de1-965c-500328e78d6d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '129ad73105e3426eb17071d3beaefdf3', 'request_id': 'req-94ddd27e-318a-4de1-965c-500328e78d6d'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:28.964773 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-94ddd27e-318a-4de1-965c-500328e78d6d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '129ad73105e3426eb17071d3beaefdf3', 'request_id': 'req-94ddd27e-318a-4de1-965c-500328e78d6d'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:28.971517 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-94ddd27e-318a-4de1-965c-500328e78d6d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '129ad73105e3426eb17071d3beaefdf3', 'request_id': 'req-94ddd27e-318a-4de1-965c-500328e78d6d'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:28.985385 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-94ddd27e-318a-4de1-965c-500328e78d6d admin admin] The token cache is being invalidate because project 129ad73105e3426eb17071d3beaefdf3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 15:29:28.985680 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-94ddd27e-318a-4de1-965c-500328e78d6d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:28.986335 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-94ddd27e-318a-4de1-965c-500328e78d6d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:28.987842 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 904/1836] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 13 15:29:28 2022] DELETE /identity/v3/projects/129ad73105e3426eb17071d3beaefdf3 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:29:28.991782 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85615233-6782-4f32-a3e4-e7411229e914 service cinder] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:29.003180 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85615233-6782-4f32-a3e4-e7411229e914 service cinder] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:29.064468 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e0cfcb-42ac-4e49-b1bf-a7fd5d77b675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:29.065128 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e0cfcb-42ac-4e49-b1bf-a7fd5d77b675 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:29.065413 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e0cfcb-42ac-4e49-b1bf-a7fd5d77b675 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:29.065691 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e0cfcb-42ac-4e49-b1bf-a7fd5d77b675 admin admin] PATH_INFO: `/v3/users/97cc06ef73e44881ab57a5fd4836dc08` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:29.068669 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e0cfcb-42ac-4e49-b1bf-a7fd5d77b675 admin admin] RBAC: Authorizing `identity:delete_user(user_id=97cc06ef73e44881ab57a5fd4836dc08)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:29.071023 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e0cfcb-42ac-4e49-b1bf-a7fd5d77b675 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:29.145797 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-20e0cfcb-42ac-4e49-b1bf-a7fd5d77b675 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97cc06ef73e44881ab57a5fd4836dc08'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:29.147019 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-20e0cfcb-42ac-4e49-b1bf-a7fd5d77b675 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97cc06ef73e44881ab57a5fd4836dc08'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:29.150049 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-20e0cfcb-42ac-4e49-b1bf-a7fd5d77b675 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97cc06ef73e44881ab57a5fd4836dc08'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:29.159904 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-20e0cfcb-42ac-4e49-b1bf-a7fd5d77b675 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97cc06ef73e44881ab57a5fd4836dc08'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:29.181235 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:29:29.197126 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-20e0cfcb-42ac-4e49-b1bf-a7fd5d77b675 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97cc06ef73e44881ab57a5fd4836dc08'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:29.220274 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 933/1837] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 13 15:29:28 2022] DELETE /identity/v3/users/97cc06ef73e44881ab57a5fd4836dc08 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:29:29.889843 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ddd27e-318a-4de1-965c-500328e78d6d admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:29.891793 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-94ddd27e-318a-4de1-965c-500328e78d6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:29.927267 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ddd27e-318a-4de1-965c-500328e78d6d admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:30.018737 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793dbbf3-7400-4e6b-a605-26b43d0bcbb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:30.019685 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793dbbf3-7400-4e6b-a605-26b43d0bcbb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:30.020142 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793dbbf3-7400-4e6b-a605-26b43d0bcbb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:30.020445 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793dbbf3-7400-4e6b-a605-26b43d0bcbb7 admin admin] PATH_INFO: `/v3/projects/69f958336cd24204b7e5e3e9d9d9b90c` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:30.021742 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793dbbf3-7400-4e6b-a605-26b43d0bcbb7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=69f958336cd24204b7e5e3e9d9d9b90c)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:30.023895 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793dbbf3-7400-4e6b-a605-26b43d0bcbb7 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:30.110638 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-793dbbf3-7400-4e6b-a605-26b43d0bcbb7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69f958336cd24204b7e5e3e9d9d9b90c', 'request_id': 'req-793dbbf3-7400-4e6b-a605-26b43d0bcbb7'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:30.135004 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-793dbbf3-7400-4e6b-a605-26b43d0bcbb7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69f958336cd24204b7e5e3e9d9d9b90c', 'request_id': 'req-793dbbf3-7400-4e6b-a605-26b43d0bcbb7'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:30.135004 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-793dbbf3-7400-4e6b-a605-26b43d0bcbb7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69f958336cd24204b7e5e3e9d9d9b90c', 'request_id': 'req-793dbbf3-7400-4e6b-a605-26b43d0bcbb7'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:30.149454 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-793dbbf3-7400-4e6b-a605-26b43d0bcbb7 admin admin] The token cache is being invalidate because project 69f958336cd24204b7e5e3e9d9d9b90c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 15:29:30.149880 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-793dbbf3-7400-4e6b-a605-26b43d0bcbb7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:30.150536 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-793dbbf3-7400-4e6b-a605-26b43d0bcbb7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:30.152135 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 905/1838] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 13 15:29:29 2022] DELETE /identity/v3/projects/69f958336cd24204b7e5e3e9d9d9b90c => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:29:30.157203 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfa6755-2e7a-499e-a01f-423e68d64ed7 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:30.157674 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfa6755-2e7a-499e-a01f-423e68d64ed7 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:30.157802 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfa6755-2e7a-499e-a01f-423e68d64ed7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:30.182721 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-dcfa6755-2e7a-499e-a01f-423e68d64ed7 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:29:30.184356 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-dcfa6755-2e7a-499e-a01f-423e68d64ed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:30.272999 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 934/1839] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:29:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 15:29:30.275028 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447d73d9-aabe-4500-8ad0-2964d0893d27 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:30.275325 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447d73d9-aabe-4500-8ad0-2964d0893d27 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:30.275639 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447d73d9-aabe-4500-8ad0-2964d0893d27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:30.302906 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-447d73d9-aabe-4500-8ad0-2964d0893d27 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:29:30.304355 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-447d73d9-aabe-4500-8ad0-2964d0893d27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:30.316903 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 906/1840] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:29:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 15:29:30.323128 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfa6755-2e7a-499e-a01f-423e68d64ed7 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:30.338038 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfa6755-2e7a-499e-a01f-423e68d64ed7 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:30.343573 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65946f0-56f9-444a-a17d-5f843f88f3c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:30.344279 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65946f0-56f9-444a-a17d-5f843f88f3c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:30.344639 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65946f0-56f9-444a-a17d-5f843f88f3c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:30.345022 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65946f0-56f9-444a-a17d-5f843f88f3c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:30.346062 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65946f0-56f9-444a-a17d-5f843f88f3c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:29:30.346612 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65946f0-56f9-444a-a17d-5f843f88f3c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:30.351946 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65946f0-56f9-444a-a17d-5f843f88f3c4 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:30.366671 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 935/1841] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Sep 13 15:29:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:29:30.370915 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447d73d9-aabe-4500-8ad0-2964d0893d27 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:30.394070 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447d73d9-aabe-4500-8ad0-2964d0893d27 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:30.439374 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e265b8d0-4c0a-4814-9981-1f334fbd1a73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:30.440076 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e265b8d0-4c0a-4814-9981-1f334fbd1a73 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:30.440343 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e265b8d0-4c0a-4814-9981-1f334fbd1a73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:30.440622 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e265b8d0-4c0a-4814-9981-1f334fbd1a73 admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:30.442097 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e265b8d0-4c0a-4814-9981-1f334fbd1a73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:30.446934 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e265b8d0-4c0a-4814-9981-1f334fbd1a73 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:30.509801 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 907/1842] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 13 15:29:30 2022] POST /identity/v3/projects => generated 375 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:29:30.511683 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65946f0-56f9-444a-a17d-5f843f88f3c4 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:30.530610 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65946f0-56f9-444a-a17d-5f843f88f3c4 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:30.579709 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e265b8d0-4c0a-4814-9981-1f334fbd1a73 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:30.593802 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-e265b8d0-4c0a-4814-9981-1f334fbd1a73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:30.616020 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:29:30.707089 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1859ec84-320c-48fa-807d-552da998e7be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:30.711585 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1859ec84-320c-48fa-807d-552da998e7be admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:30.712108 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1859ec84-320c-48fa-807d-552da998e7be admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:30.722223 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1859ec84-320c-48fa-807d-552da998e7be admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:30.724930 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1859ec84-320c-48fa-807d-552da998e7be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:30.732604 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1859ec84-320c-48fa-807d-552da998e7be admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:30.763467 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e265b8d0-4c0a-4814-9981-1f334fbd1a73 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:30.773778 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c8d9ce-e1cc-4636-98b7-1de93c5383d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:30.774380 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c8d9ce-e1cc-4636-98b7-1de93c5383d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:30.774711 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c8d9ce-e1cc-4636-98b7-1de93c5383d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:30.774996 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c8d9ce-e1cc-4636-98b7-1de93c5383d1 admin admin] PATH_INFO: `/v3/users/cbc5387f448d417c859ca72a6150d745` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:30.782504 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c8d9ce-e1cc-4636-98b7-1de93c5383d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cbc5387f448d417c859ca72a6150d745)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:30.788981 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c8d9ce-e1cc-4636-98b7-1de93c5383d1 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:30.796138 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 936/1843] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 13 15:29:30 2022] POST /identity/v3/users => generated 288 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 15:29:30.801300 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1859ec84-320c-48fa-807d-552da998e7be admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:30.835869 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1859ec84-320c-48fa-807d-552da998e7be admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:30.872434 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d3a38f-a521-48d6-930c-a795193b7e72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:30.873088 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d3a38f-a521-48d6-930c-a795193b7e72 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:30.873375 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d3a38f-a521-48d6-930c-a795193b7e72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:30.873660 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d3a38f-a521-48d6-930c-a795193b7e72 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:30.874377 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d3a38f-a521-48d6-930c-a795193b7e72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:30.889678 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d3a38f-a521-48d6-930c-a795193b7e72 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:30.913111 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-e3c8d9ce-e1cc-4636-98b7-1de93c5383d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cbc5387f448d417c859ca72a6150d745'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:30.915076 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-e3c8d9ce-e1cc-4636-98b7-1de93c5383d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cbc5387f448d417c859ca72a6150d745'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:30.915899 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-e3c8d9ce-e1cc-4636-98b7-1de93c5383d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cbc5387f448d417c859ca72a6150d745'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:30.930334 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-e3c8d9ce-e1cc-4636-98b7-1de93c5383d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cbc5387f448d417c859ca72a6150d745'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:30.958090 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 937/1844] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:29:30 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 15:29:30.958680 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-e3c8d9ce-e1cc-4636-98b7-1de93c5383d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cbc5387f448d417c859ca72a6150d745'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:30.959081 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d3a38f-a521-48d6-930c-a795193b7e72 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:30.970717 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-c3d3a38f-a521-48d6-930c-a795193b7e72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:30.978886 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 908/1845] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 13 15:29:30 2022] DELETE /identity/v3/users/cbc5387f448d417c859ca72a6150d745 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:29:30.983112 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166a0da4-2b09-44b7-8d08-8aacabf5145c None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:30.983664 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166a0da4-2b09-44b7-8d08-8aacabf5145c None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:30.984225 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166a0da4-2b09-44b7-8d08-8aacabf5145c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:31.014855 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d3a38f-a521-48d6-930c-a795193b7e72 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:31.021628 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-166a0da4-2b09-44b7-8d08-8aacabf5145c None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:29:31.024918 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-166a0da4-2b09-44b7-8d08-8aacabf5145c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:31.127136 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:29:31.158215 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de23912c-7d4b-46ff-80b8-2f5489eea2e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:31.158908 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de23912c-7d4b-46ff-80b8-2f5489eea2e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:31.159150 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de23912c-7d4b-46ff-80b8-2f5489eea2e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:31.159431 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de23912c-7d4b-46ff-80b8-2f5489eea2e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:31.160357 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de23912c-7d4b-46ff-80b8-2f5489eea2e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:31.162038 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de23912c-7d4b-46ff-80b8-2f5489eea2e3 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:31.181037 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 938/1846] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:29:30 2022] GET /identity/v3/roles => generated 1420 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 15:29:31.185312 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de23912c-7d4b-46ff-80b8-2f5489eea2e3 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:31.194196 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 909/1847] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:29:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 15:29:31.203729 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de23912c-7d4b-46ff-80b8-2f5489eea2e3 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:31.210427 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8b8880-6ebc-4ad7-90c4-748f0fdadd77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:31.211112 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8b8880-6ebc-4ad7-90c4-748f0fdadd77 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:31.211398 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8b8880-6ebc-4ad7-90c4-748f0fdadd77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:31.211680 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8b8880-6ebc-4ad7-90c4-748f0fdadd77 admin admin] PATH_INFO: `/v3/projects/12443f4189db4e5db6614ba93d59770b/users/208cc5c06e7b43ca955a3234eaca0151/roles/3fae3d3a28e147d3b2bede2378ff79ae` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:31.231316 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8b8880-6ebc-4ad7-90c4-748f0fdadd77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12443f4189db4e5db6614ba93d59770b, user_id=208cc5c06e7b43ca955a3234eaca0151, role_id=3fae3d3a28e147d3b2bede2378ff79ae)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:31.232631 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166a0da4-2b09-44b7-8d08-8aacabf5145c None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:31.234228 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-166a0da4-2b09-44b7-8d08-8aacabf5145c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:31.234870 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8b8880-6ebc-4ad7-90c4-748f0fdadd77 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:31.259931 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 939/1848] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 13 15:29:31 2022] PUT /identity/v3/projects/12443f4189db4e5db6614ba93d59770b/users/208cc5c06e7b43ca955a3234eaca0151/roles/3fae3d3a28e147d3b2bede2378ff79ae => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 15:29:31.270282 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0391f93-56b9-4724-8b79-263a3ec7c522 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:31.270738 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0391f93-56b9-4724-8b79-263a3ec7c522 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:31.271293 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0391f93-56b9-4724-8b79-263a3ec7c522 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:31.305861 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-e0391f93-56b9-4724-8b79-263a3ec7c522 None None] MFA Rules not processed for user `208cc5c06e7b43ca955a3234eaca0151`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:29:31.307737 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-e0391f93-56b9-4724-8b79-263a3ec7c522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:31.314212 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:29:31.382593 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166a0da4-2b09-44b7-8d08-8aacabf5145c None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:31.496511 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 940/1849] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:29:31 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 15:29:31.511931 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0391f93-56b9-4724-8b79-263a3ec7c522 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:31.514354 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-e0391f93-56b9-4724-8b79-263a3ec7c522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:31.547531 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f87dba-0a64-419f-ac98-aac892aa60d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41675154bbba47388040966f75d84c3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:31.548322 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f87dba-0a64-419f-ac98-aac892aa60d4 service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:31.548689 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f87dba-0a64-419f-ac98-aac892aa60d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:31.549063 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f87dba-0a64-419f-ac98-aac892aa60d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:31.654207 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0391f93-56b9-4724-8b79-263a3ec7c522 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:31.658341 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d5321c-4d18-4019-805c-39ee8ba74c6c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97acd23097d54bf7805c3cef60626ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:31.659249 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d5321c-4d18-4019-805c-39ee8ba74c6c service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:31.659677 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d5321c-4d18-4019-805c-39ee8ba74c6c service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:31.660621 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d5321c-4d18-4019-805c-39ee8ba74c6c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:31.668792 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f87dba-0a64-419f-ac98-aac892aa60d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:31.670193 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f87dba-0a64-419f-ac98-aac892aa60d4 service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:31.671215 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d5321c-4d18-4019-805c-39ee8ba74c6c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:31.672881 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d5321c-4d18-4019-805c-39ee8ba74c6c service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:31.683275 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 941/1850] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:29:31 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 15:29:31.686861 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 910/1851] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:29:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 15:29:32.090399 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d5321c-4d18-4019-805c-39ee8ba74c6c service cinder] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:32.094280 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-c3d5321c-4d18-4019-805c-39ee8ba74c6c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:32.128554 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d5321c-4d18-4019-805c-39ee8ba74c6c service cinder] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:32.137959 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec2fdb7-2012-4993-94c3-7097d1fd232f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:32.142064 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec2fdb7-2012-4993-94c3-7097d1fd232f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:32.142353 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec2fdb7-2012-4993-94c3-7097d1fd232f admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:32.142636 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec2fdb7-2012-4993-94c3-7097d1fd232f admin admin] PATH_INFO: `/v3/projects/7893015d35fb45cebba6e5e74d29b406` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:32.143944 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec2fdb7-2012-4993-94c3-7097d1fd232f admin admin] RBAC: Authorizing `identity:delete_project(project_id=7893015d35fb45cebba6e5e74d29b406)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:32.146935 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec2fdb7-2012-4993-94c3-7097d1fd232f admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:32.222358 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f87dba-0a64-419f-ac98-aac892aa60d4 service neutron] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:32.224304 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-22f87dba-0a64-419f-ac98-aac892aa60d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:32.258739 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f87dba-0a64-419f-ac98-aac892aa60d4 service neutron] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:32.265078 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:29:32.267507 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-cec2fdb7-2012-4993-94c3-7097d1fd232f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7893015d35fb45cebba6e5e74d29b406', 'request_id': 'req-cec2fdb7-2012-4993-94c3-7097d1fd232f'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:32.279391 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-cec2fdb7-2012-4993-94c3-7097d1fd232f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7893015d35fb45cebba6e5e74d29b406', 'request_id': 'req-cec2fdb7-2012-4993-94c3-7097d1fd232f'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:32.295350 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-cec2fdb7-2012-4993-94c3-7097d1fd232f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7893015d35fb45cebba6e5e74d29b406', 'request_id': 'req-cec2fdb7-2012-4993-94c3-7097d1fd232f'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:32.318233 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-cec2fdb7-2012-4993-94c3-7097d1fd232f admin admin] The token cache is being invalidate because project 7893015d35fb45cebba6e5e74d29b406 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 15:29:32.318233 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-cec2fdb7-2012-4993-94c3-7097d1fd232f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:32.318452 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-cec2fdb7-2012-4993-94c3-7097d1fd232f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:32.320307 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 942/1852] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 13 15:29:32 2022] DELETE /identity/v3/projects/7893015d35fb45cebba6e5e74d29b406 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:29:32.323972 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec2fdb7-2012-4993-94c3-7097d1fd232f admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:32.325539 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-cec2fdb7-2012-4993-94c3-7097d1fd232f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:32.344895 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be90a46a-37d6-442d-add4-36ff6abec63b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:32.345892 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be90a46a-37d6-442d-add4-36ff6abec63b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:32.346380 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be90a46a-37d6-442d-add4-36ff6abec63b admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:32.346636 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be90a46a-37d6-442d-add4-36ff6abec63b admin admin] PATH_INFO: `/v3/users/e8e2555a91654fa2b6c23a9252531834` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:32.348451 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be90a46a-37d6-442d-add4-36ff6abec63b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8e2555a91654fa2b6c23a9252531834)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:32.350731 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be90a46a-37d6-442d-add4-36ff6abec63b admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:32.413118 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:29:32.420015 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-be90a46a-37d6-442d-add4-36ff6abec63b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8e2555a91654fa2b6c23a9252531834'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:32.421286 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-be90a46a-37d6-442d-add4-36ff6abec63b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8e2555a91654fa2b6c23a9252531834'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:32.422450 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-be90a46a-37d6-442d-add4-36ff6abec63b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8e2555a91654fa2b6c23a9252531834'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:32.422794 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec2fdb7-2012-4993-94c3-7097d1fd232f admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:32.427750 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6465ca-a552-4444-8ed8-2da6df7ceadc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:32.428490 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6465ca-a552-4444-8ed8-2da6df7ceadc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:32.428841 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6465ca-a552-4444-8ed8-2da6df7ceadc admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:32.429189 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6465ca-a552-4444-8ed8-2da6df7ceadc admin admin] PATH_INFO: `/v3/users/4c9cc065561e4c03a609e15594ca5cf6` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:32.430427 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6465ca-a552-4444-8ed8-2da6df7ceadc admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c9cc065561e4c03a609e15594ca5cf6)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:32.433499 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6465ca-a552-4444-8ed8-2da6df7ceadc admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:32.434235 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-be90a46a-37d6-442d-add4-36ff6abec63b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8e2555a91654fa2b6c23a9252531834'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:32.454393 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-be90a46a-37d6-442d-add4-36ff6abec63b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8e2555a91654fa2b6c23a9252531834'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:32.472808 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 911/1853] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 13 15:29:32 2022] DELETE /identity/v3/users/e8e2555a91654fa2b6c23a9252531834 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:29:32.477820 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccb12aa-38f4-4344-a105-b96192c0b666 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:32.478115 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccb12aa-38f4-4344-a105-b96192c0b666 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:32.478430 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccb12aa-38f4-4344-a105-b96192c0b666 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:32.498205 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-6f6465ca-a552-4444-8ed8-2da6df7ceadc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c9cc065561e4c03a609e15594ca5cf6'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:32.499980 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-6f6465ca-a552-4444-8ed8-2da6df7ceadc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c9cc065561e4c03a609e15594ca5cf6'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:32.501004 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-6f6465ca-a552-4444-8ed8-2da6df7ceadc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c9cc065561e4c03a609e15594ca5cf6'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:32.501530 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-0ccb12aa-38f4-4344-a105-b96192c0b666 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:29:32.502960 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-0ccb12aa-38f4-4344-a105-b96192c0b666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:32.512805 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-6f6465ca-a552-4444-8ed8-2da6df7ceadc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c9cc065561e4c03a609e15594ca5cf6'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:32.528263 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-6f6465ca-a552-4444-8ed8-2da6df7ceadc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c9cc065561e4c03a609e15594ca5cf6'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:32.546571 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 943/1854] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 13 15:29:32 2022] DELETE /identity/v3/users/4c9cc065561e4c03a609e15594ca5cf6 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 15:29:32.593614 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 912/1855] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:29:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:29:32.610883 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6465ca-a552-4444-8ed8-2da6df7ceadc admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:32.613978 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-6f6465ca-a552-4444-8ed8-2da6df7ceadc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:32.683029 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6465ca-a552-4444-8ed8-2da6df7ceadc admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:32.690124 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb90daf-3bd9-4488-803c-896cf5663f5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41675154bbba47388040966f75d84c3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:32.692065 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb90daf-3bd9-4488-803c-896cf5663f5b service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:32.692065 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb90daf-3bd9-4488-803c-896cf5663f5b service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:32.692240 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb90daf-3bd9-4488-803c-896cf5663f5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:32.702672 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:29:32.774408 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb90daf-3bd9-4488-803c-896cf5663f5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:32.775779 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb90daf-3bd9-4488-803c-896cf5663f5b service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:32.790690 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 944/1856] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:29:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:29:32.963320 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccb12aa-38f4-4344-a105-b96192c0b666 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:32.965643 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-0ccb12aa-38f4-4344-a105-b96192c0b666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:32.993478 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccb12aa-38f4-4344-a105-b96192c0b666 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:33.009725 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4c224a-1ec2-4531-b2db-993bbae0dd5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:33.010162 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4c224a-1ec2-4531-b2db-993bbae0dd5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:33.010895 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4c224a-1ec2-4531-b2db-993bbae0dd5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:33.010895 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4c224a-1ec2-4531-b2db-993bbae0dd5b admin admin] PATH_INFO: `/v3/projects/3e21c867c8d74ef4990605705dc8db82` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:33.018928 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4c224a-1ec2-4531-b2db-993bbae0dd5b admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e21c867c8d74ef4990605705dc8db82)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:33.022337 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4c224a-1ec2-4531-b2db-993bbae0dd5b admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:33.147783 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-ff4c224a-1ec2-4531-b2db-993bbae0dd5b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e21c867c8d74ef4990605705dc8db82', 'request_id': 'req-ff4c224a-1ec2-4531-b2db-993bbae0dd5b'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:33.162228 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-ff4c224a-1ec2-4531-b2db-993bbae0dd5b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e21c867c8d74ef4990605705dc8db82', 'request_id': 'req-ff4c224a-1ec2-4531-b2db-993bbae0dd5b'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:33.179001 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-ff4c224a-1ec2-4531-b2db-993bbae0dd5b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e21c867c8d74ef4990605705dc8db82', 'request_id': 'req-ff4c224a-1ec2-4531-b2db-993bbae0dd5b'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:33.211339 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-ff4c224a-1ec2-4531-b2db-993bbae0dd5b admin admin] The token cache is being invalidate because project 3e21c867c8d74ef4990605705dc8db82 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 15:29:33.211339 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-ff4c224a-1ec2-4531-b2db-993bbae0dd5b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:33.212111 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-ff4c224a-1ec2-4531-b2db-993bbae0dd5b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:33.214774 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 913/1857] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 13 15:29:32 2022] DELETE /identity/v3/projects/3e21c867c8d74ef4990605705dc8db82 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:29:33.219914 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7711f05-251f-49f6-9075-7646b4cb14a3 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:33.220280 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7711f05-251f-49f6-9075-7646b4cb14a3 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:33.221081 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7711f05-251f-49f6-9075-7646b4cb14a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:33.257960 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-c7711f05-251f-49f6-9075-7646b4cb14a3 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:29:33.259446 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-c7711f05-251f-49f6-9075-7646b4cb14a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:33.447155 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 945/1858] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:29:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:29:33.458189 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea333ff-b168-433d-ad81-de77df837e37 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:33.458687 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea333ff-b168-433d-ad81-de77df837e37 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:33.458955 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea333ff-b168-433d-ad81-de77df837e37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:33.503024 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-2ea333ff-b168-433d-ad81-de77df837e37 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:29:33.504989 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-2ea333ff-b168-433d-ad81-de77df837e37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:33.531318 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 914/1859] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:29:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:29:33.536464 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7711f05-251f-49f6-9075-7646b4cb14a3 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:33.555182 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7711f05-251f-49f6-9075-7646b4cb14a3 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:33.556868 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea333ff-b168-433d-ad81-de77df837e37 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:33.558050 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-2ea333ff-b168-433d-ad81-de77df837e37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:33.575680 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4dbae8-f53a-4822-b45a-69a13ef79b2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:33.576764 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4dbae8-f53a-4822-b45a-69a13ef79b2c admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:33.577446 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4dbae8-f53a-4822-b45a-69a13ef79b2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:33.578733 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4dbae8-f53a-4822-b45a-69a13ef79b2c admin admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:33.581001 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4dbae8-f53a-4822-b45a-69a13ef79b2c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:29:33.581318 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4dbae8-f53a-4822-b45a-69a13ef79b2c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:33.587226 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4dbae8-f53a-4822-b45a-69a13ef79b2c admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:33.592025 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea333ff-b168-433d-ad81-de77df837e37 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:33.605321 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edd8c73-b919-47e5-b2ab-259f598453fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:33.606354 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edd8c73-b919-47e5-b2ab-259f598453fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:33.606354 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edd8c73-b919-47e5-b2ab-259f598453fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:33.606562 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edd8c73-b919-47e5-b2ab-259f598453fc admin admin] PATH_INFO: `/v3/projects/7eb0299975764046ba7aaab1aee5f760` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:33.608435 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edd8c73-b919-47e5-b2ab-259f598453fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=7eb0299975764046ba7aaab1aee5f760)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:33.616611 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 946/1860] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Sep 13 15:29:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:29:33.616611 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d5c555-291c-4a59-ba1e-1992eb034c76 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:33.616611 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d5c555-291c-4a59-ba1e-1992eb034c76 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:33.616611 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d5c555-291c-4a59-ba1e-1992eb034c76 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:33.616941 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edd8c73-b919-47e5-b2ab-259f598453fc admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:33.617038 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 947/1861] 10.222.0.27 () {54 vars in 921 bytes} [Tue Sep 13 15:29:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:29:33.619122 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d5c555-291c-4a59-ba1e-1992eb034c76 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:33.635720 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d5c555-291c-4a59-ba1e-1992eb034c76 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:33.642807 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cf989f-7ec9-4caf-84b9-5999d62911de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:33.643440 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cf989f-7ec9-4caf-84b9-5999d62911de admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:33.643719 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cf989f-7ec9-4caf-84b9-5999d62911de admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:33.644182 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cf989f-7ec9-4caf-84b9-5999d62911de admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:33.645455 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cf989f-7ec9-4caf-84b9-5999d62911de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:33.648421 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cf989f-7ec9-4caf-84b9-5999d62911de admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:33.706349 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:29:33.732968 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 948/1862] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 13 15:29:33 2022] POST /identity/v3/projects => generated 373 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:29:33.734937 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974a181a-4d74-4923-83e2-d73c2eedd3a8 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:33.735377 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974a181a-4d74-4923-83e2-d73c2eedd3a8 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:33.735807 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974a181a-4d74-4923-83e2-d73c2eedd3a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:33.745516 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-0edd8c73-b919-47e5-b2ab-259f598453fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7eb0299975764046ba7aaab1aee5f760', 'request_id': 'req-0edd8c73-b919-47e5-b2ab-259f598453fc'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:33.759061 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-0edd8c73-b919-47e5-b2ab-259f598453fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7eb0299975764046ba7aaab1aee5f760', 'request_id': 'req-0edd8c73-b919-47e5-b2ab-259f598453fc'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:33.766952 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-974a181a-4d74-4923-83e2-d73c2eedd3a8 None None] MFA Rules not processed for user `62aad71c6c1a4469805762bba330bf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:29:33.768393 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-974a181a-4d74-4923-83e2-d73c2eedd3a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:33.769487 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-0edd8c73-b919-47e5-b2ab-259f598453fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7eb0299975764046ba7aaab1aee5f760', 'request_id': 'req-0edd8c73-b919-47e5-b2ab-259f598453fc'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:33.788874 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-0edd8c73-b919-47e5-b2ab-259f598453fc admin admin] The token cache is being invalidate because project 7eb0299975764046ba7aaab1aee5f760 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 15:29:33.789514 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-0edd8c73-b919-47e5-b2ab-259f598453fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:33.790323 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-0edd8c73-b919-47e5-b2ab-259f598453fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:33.796112 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 915/1863] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 13 15:29:33 2022] DELETE /identity/v3/projects/7eb0299975764046ba7aaab1aee5f760 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 15:29:33.797440 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edd8c73-b919-47e5-b2ab-259f598453fc admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:33.799258 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-0edd8c73-b919-47e5-b2ab-259f598453fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:33.878337 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 949/1864] 10.222.0.27 () {58 vars in 1018 bytes} [Tue Sep 13 15:29:33 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:29:33.880703 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974a181a-4d74-4923-83e2-d73c2eedd3a8 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:33.888823 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edd8c73-b919-47e5-b2ab-259f598453fc admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:33.889628 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-974a181a-4d74-4923-83e2-d73c2eedd3a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:33.897494 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:29:33.995666 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00605d80-9c80-46c0-9308-3d9e7a700cff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:33.996846 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00605d80-9c80-46c0-9308-3d9e7a700cff admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:33.996846 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00605d80-9c80-46c0-9308-3d9e7a700cff admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:33.997975 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00605d80-9c80-46c0-9308-3d9e7a700cff admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:33.999126 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00605d80-9c80-46c0-9308-3d9e7a700cff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:34.001916 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974a181a-4d74-4923-83e2-d73c2eedd3a8 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:34.010001 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00605d80-9c80-46c0-9308-3d9e7a700cff admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:34.013686 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7bb73b-9ba4-49c8-b262-b332e5590e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:34.014371 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7bb73b-9ba4-49c8-b262-b332e5590e95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:34.014656 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7bb73b-9ba4-49c8-b262-b332e5590e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:34.014918 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7bb73b-9ba4-49c8-b262-b332e5590e95 admin admin] PATH_INFO: `/v3/users/18e4b76c30fc45c299dd0bd48c345d61` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:34.016755 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7bb73b-9ba4-49c8-b262-b332e5590e95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=18e4b76c30fc45c299dd0bd48c345d61)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:34.021307 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7bb73b-9ba4-49c8-b262-b332e5590e95 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:34.082677 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 916/1865] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 13 15:29:33 2022] POST /identity/v3/users => generated 287 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:29:34.082677 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00605d80-9c80-46c0-9308-3d9e7a700cff admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:34.087564 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-00605d80-9c80-46c0-9308-3d9e7a700cff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:34.120458 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00605d80-9c80-46c0-9308-3d9e7a700cff admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:34.122483 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-7d7bb73b-9ba4-49c8-b262-b332e5590e95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18e4b76c30fc45c299dd0bd48c345d61'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:34.124307 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-7d7bb73b-9ba4-49c8-b262-b332e5590e95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18e4b76c30fc45c299dd0bd48c345d61'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:34.125493 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-7d7bb73b-9ba4-49c8-b262-b332e5590e95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18e4b76c30fc45c299dd0bd48c345d61'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:34.137507 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a8df99-289a-4bcb-bb2d-d3be51c643af service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62aad71c6c1a4469805762bba330bf0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:34.138172 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a8df99-289a-4bcb-bb2d-d3be51c643af service nova] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:34.138459 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a8df99-289a-4bcb-bb2d-d3be51c643af service nova] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:34.138731 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a8df99-289a-4bcb-bb2d-d3be51c643af service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:34.142437 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-63a8df99-289a-4bcb-bb2d-d3be51c643af service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:34.147538 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-7d7bb73b-9ba4-49c8-b262-b332e5590e95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18e4b76c30fc45c299dd0bd48c345d61'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:34.170125 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-7d7bb73b-9ba4-49c8-b262-b332e5590e95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18e4b76c30fc45c299dd0bd48c345d61'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:34.172844 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a8df99-289a-4bcb-bb2d-d3be51c643af service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:34.175827 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a8df99-289a-4bcb-bb2d-d3be51c643af service nova] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:34.192015 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 917/1866] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:29:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:29:34.192916 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a8df99-289a-4bcb-bb2d-d3be51c643af service nova] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:34.194785 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-63a8df99-289a-4bcb-bb2d-d3be51c643af service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:34.211488 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a8df99-289a-4bcb-bb2d-d3be51c643af service nova] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:34.218855 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce88ee49-8c25-49c8-9696-8bf64476399b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:34.219792 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce88ee49-8c25-49c8-9696-8bf64476399b admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:34.220217 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce88ee49-8c25-49c8-9696-8bf64476399b admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:34.220765 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce88ee49-8c25-49c8-9696-8bf64476399b admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:34.221660 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce88ee49-8c25-49c8-9696-8bf64476399b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:34.223907 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce88ee49-8c25-49c8-9696-8bf64476399b admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:34.230151 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 950/1867] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 13 15:29:33 2022] DELETE /identity/v3/users/18e4b76c30fc45c299dd0bd48c345d61 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:29:34.241529 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 918/1868] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:29:34 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 15:29:34.251224 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7bb73b-9ba4-49c8-b262-b332e5590e95 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:34.406452 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7bb73b-9ba4-49c8-b262-b332e5590e95 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:34.421830 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a27bc7-f719-4f00-964d-a9a7d9d9f01c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:34.423436 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a27bc7-f719-4f00-964d-a9a7d9d9f01c admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:34.424083 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a27bc7-f719-4f00-964d-a9a7d9d9f01c admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:34.424504 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a27bc7-f719-4f00-964d-a9a7d9d9f01c admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:34.425847 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a27bc7-f719-4f00-964d-a9a7d9d9f01c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:34.430742 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a27bc7-f719-4f00-964d-a9a7d9d9f01c admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:34.446590 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 951/1869] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:29:34 2022] GET /identity/v3/roles => generated 1420 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 15:29:34.450999 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce88ee49-8c25-49c8-9696-8bf64476399b admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:34.465732 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce88ee49-8c25-49c8-9696-8bf64476399b admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:34.489372 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd129891-67dd-45a2-bfec-a7c6b4fa037f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:34.490097 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd129891-67dd-45a2-bfec-a7c6b4fa037f admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:34.490386 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd129891-67dd-45a2-bfec-a7c6b4fa037f admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:34.490685 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd129891-67dd-45a2-bfec-a7c6b4fa037f admin admin] PATH_INFO: `/v3/projects/b850767b8f0444ea95e113257aa6cb00/users/ed892f735bf642b09d7007fc538aa864/roles/3fae3d3a28e147d3b2bede2378ff79ae` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:34.524007 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd129891-67dd-45a2-bfec-a7c6b4fa037f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b850767b8f0444ea95e113257aa6cb00, user_id=ed892f735bf642b09d7007fc538aa864, role_id=3fae3d3a28e147d3b2bede2378ff79ae)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:34.527905 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd129891-67dd-45a2-bfec-a7c6b4fa037f admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:34.553945 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 919/1870] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 13 15:29:34 2022] PUT /identity/v3/projects/b850767b8f0444ea95e113257aa6cb00/users/ed892f735bf642b09d7007fc538aa864/roles/3fae3d3a28e147d3b2bede2378ff79ae => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:29:34.563905 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a719e863-9f33-4dfb-bf08-a8bc4315a099 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:34.564445 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a719e863-9f33-4dfb-bf08-a8bc4315a099 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:34.564616 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a719e863-9f33-4dfb-bf08-a8bc4315a099 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:34.600878 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-a719e863-9f33-4dfb-bf08-a8bc4315a099 None None] MFA Rules not processed for user `ed892f735bf642b09d7007fc538aa864`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:29:34.602188 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-a719e863-9f33-4dfb-bf08-a8bc4315a099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:34.608188 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:29:34.730904 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 952/1871] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:29:34 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:29:34.732913 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd129891-67dd-45a2-bfec-a7c6b4fa037f admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:34.736856 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-cd129891-67dd-45a2-bfec-a7c6b4fa037f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:34.744662 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a719e863-9f33-4dfb-bf08-a8bc4315a099 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:34.760303 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:29:34.877967 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a719e863-9f33-4dfb-bf08-a8bc4315a099 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:34.886997 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38194980-25b2-4b42-9746-33ed3dc615a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:34.887903 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38194980-25b2-4b42-9746-33ed3dc615a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:34.888395 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38194980-25b2-4b42-9746-33ed3dc615a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:34.888891 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38194980-25b2-4b42-9746-33ed3dc615a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:34.889682 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd129891-67dd-45a2-bfec-a7c6b4fa037f admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:34.891405 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38194980-25b2-4b42-9746-33ed3dc615a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:34.895211 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38194980-25b2-4b42-9746-33ed3dc615a6 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:34.906256 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c8c71d-87cb-4d74-940c-aa1ebd06db22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:34.907689 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c8c71d-87cb-4d74-940c-aa1ebd06db22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:34.908142 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c8c71d-87cb-4d74-940c-aa1ebd06db22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:34.908493 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c8c71d-87cb-4d74-940c-aa1ebd06db22 admin admin] PATH_INFO: `/v3/projects/bb0bc81ebeca4025891889090b371f40` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:34.911821 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c8c71d-87cb-4d74-940c-aa1ebd06db22 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb0bc81ebeca4025891889090b371f40)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:34.914470 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c8c71d-87cb-4d74-940c-aa1ebd06db22 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:34.940309 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 953/1872] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 13 15:29:34 2022] POST /identity/v3/projects => generated 371 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:29:34.946824 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38194980-25b2-4b42-9746-33ed3dc615a6 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:35.004815 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-c4c8c71d-87cb-4d74-940c-aa1ebd06db22 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb0bc81ebeca4025891889090b371f40', 'request_id': 'req-c4c8c71d-87cb-4d74-940c-aa1ebd06db22'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:35.017542 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-c4c8c71d-87cb-4d74-940c-aa1ebd06db22 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb0bc81ebeca4025891889090b371f40', 'request_id': 'req-c4c8c71d-87cb-4d74-940c-aa1ebd06db22'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:35.029765 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-c4c8c71d-87cb-4d74-940c-aa1ebd06db22 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb0bc81ebeca4025891889090b371f40', 'request_id': 'req-c4c8c71d-87cb-4d74-940c-aa1ebd06db22'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:35.038432 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38194980-25b2-4b42-9746-33ed3dc615a6 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:35.052310 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-c4c8c71d-87cb-4d74-940c-aa1ebd06db22 admin admin] The token cache is being invalidate because project bb0bc81ebeca4025891889090b371f40 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 15:29:35.057586 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-c4c8c71d-87cb-4d74-940c-aa1ebd06db22 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:35.060008 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-c4c8c71d-87cb-4d74-940c-aa1ebd06db22 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:35.062105 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 920/1873] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 13 15:29:34 2022] DELETE /identity/v3/projects/bb0bc81ebeca4025891889090b371f40 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:29:35.067779 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfa6034-fd5a-45ed-9fc5-788a44b46bb9 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:35.067779 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfa6034-fd5a-45ed-9fc5-788a44b46bb9 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:35.068031 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfa6034-fd5a-45ed-9fc5-788a44b46bb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:35.098578 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-acfa6034-fd5a-45ed-9fc5-788a44b46bb9 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:29:35.099627 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:29:35.100349 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-acfa6034-fd5a-45ed-9fc5-788a44b46bb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:35.132203 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1eeb49-44d9-4251-bb92-5108d94216ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:35.132737 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1eeb49-44d9-4251-bb92-5108d94216ba admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:35.133018 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1eeb49-44d9-4251-bb92-5108d94216ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:35.133295 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1eeb49-44d9-4251-bb92-5108d94216ba admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:35.134447 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1eeb49-44d9-4251-bb92-5108d94216ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:35.137275 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1eeb49-44d9-4251-bb92-5108d94216ba admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:35.169813 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 954/1874] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 13 15:29:34 2022] POST /identity/v3/users => generated 292 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:29:35.173657 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1eeb49-44d9-4251-bb92-5108d94216ba admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:35.175515 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-cf1eeb49-44d9-4251-bb92-5108d94216ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:35.182318 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 921/1875] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:29:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:29:35.194929 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1eeb49-44d9-4251-bb92-5108d94216ba admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:35.202341 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c4d607-a71c-42b4-9472-0288adabe386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:35.208881 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9664f6a5-c08f-4716-8b96-e57811ff80f3 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:35.209334 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9664f6a5-c08f-4716-8b96-e57811ff80f3 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:35.209933 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9664f6a5-c08f-4716-8b96-e57811ff80f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:35.216308 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c4d607-a71c-42b4-9472-0288adabe386 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:35.216597 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c4d607-a71c-42b4-9472-0288adabe386 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:35.216881 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c4d607-a71c-42b4-9472-0288adabe386 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:35.219549 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c4d607-a71c-42b4-9472-0288adabe386 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:35.221677 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c4d607-a71c-42b4-9472-0288adabe386 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:35.241282 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-9664f6a5-c08f-4716-8b96-e57811ff80f3 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:29:35.242739 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-9664f6a5-c08f-4716-8b96-e57811ff80f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:35.243632 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 955/1876] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:29:35 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 15:29:35.247990 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c4d607-a71c-42b4-9472-0288adabe386 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:35.254403 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 922/1877] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:29:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 15:29:35.258559 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9664f6a5-c08f-4716-8b96-e57811ff80f3 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:35.259465 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c4d607-a71c-42b4-9472-0288adabe386 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:35.264074 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5619aa0-a822-428f-a456-c9c7aa52ac30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:35.264791 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5619aa0-a822-428f-a456-c9c7aa52ac30 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:35.265081 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5619aa0-a822-428f-a456-c9c7aa52ac30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:35.265357 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5619aa0-a822-428f-a456-c9c7aa52ac30 admin admin] PATH_INFO: `/v3/projects/b92be32ffe244f008b78d0a8ccdc8abc/users/6a50aa65cb0e4777b6cedc104f9ea537/roles/f34412ad29f1478cba775b033129f71f` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:35.268187 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9664f6a5-c08f-4716-8b96-e57811ff80f3 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:35.275228 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595cd9cf-6424-406f-a18a-857691ba65a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:35.275956 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595cd9cf-6424-406f-a18a-857691ba65a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:35.276139 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595cd9cf-6424-406f-a18a-857691ba65a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:35.276806 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595cd9cf-6424-406f-a18a-857691ba65a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:35.277111 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595cd9cf-6424-406f-a18a-857691ba65a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:29:35.277422 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595cd9cf-6424-406f-a18a-857691ba65a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:35.279096 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595cd9cf-6424-406f-a18a-857691ba65a9 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:35.284265 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5619aa0-a822-428f-a456-c9c7aa52ac30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b92be32ffe244f008b78d0a8ccdc8abc, user_id=6a50aa65cb0e4777b6cedc104f9ea537, role_id=f34412ad29f1478cba775b033129f71f)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:35.288357 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5619aa0-a822-428f-a456-c9c7aa52ac30 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:35.292378 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 923/1878] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Sep 13 15:29:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 15:29:35.297290 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595cd9cf-6424-406f-a18a-857691ba65a9 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:35.307443 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 956/1879] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 13 15:29:35 2022] PUT /identity/v3/projects/b92be32ffe244f008b78d0a8ccdc8abc/users/6a50aa65cb0e4777b6cedc104f9ea537/roles/f34412ad29f1478cba775b033129f71f => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 15:29:35.311478 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5619aa0-a822-428f-a456-c9c7aa52ac30 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:35.312815 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595cd9cf-6424-406f-a18a-857691ba65a9 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:35.342755 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:29:35.437671 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948d8a04-301d-4314-b5b7-fd318b9b150a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:35.438336 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948d8a04-301d-4314-b5b7-fd318b9b150a admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:35.439102 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948d8a04-301d-4314-b5b7-fd318b9b150a admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:35.439531 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948d8a04-301d-4314-b5b7-fd318b9b150a admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:35.440808 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948d8a04-301d-4314-b5b7-fd318b9b150a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:35.442494 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948d8a04-301d-4314-b5b7-fd318b9b150a admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:35.461603 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5619aa0-a822-428f-a456-c9c7aa52ac30 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:35.468590 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd04cda7-ee66-43e3-bcaf-260a5b2dd03c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:35.469465 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd04cda7-ee66-43e3-bcaf-260a5b2dd03c admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:35.469985 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd04cda7-ee66-43e3-bcaf-260a5b2dd03c admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:35.470294 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd04cda7-ee66-43e3-bcaf-260a5b2dd03c admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:35.471262 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd04cda7-ee66-43e3-bcaf-260a5b2dd03c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:35.474138 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd04cda7-ee66-43e3-bcaf-260a5b2dd03c admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:35.486786 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 957/1880] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:29:35 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 15:29:35.490994 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd04cda7-ee66-43e3-bcaf-260a5b2dd03c admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:35.494333 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 924/1881] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 13 15:29:35 2022] POST /identity/v3/projects => generated 367 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:29:35.500925 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948d8a04-301d-4314-b5b7-fd318b9b150a admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:35.512568 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd04cda7-ee66-43e3-bcaf-260a5b2dd03c admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:35.601996 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948d8a04-301d-4314-b5b7-fd318b9b150a admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:35.607123 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b97d9b-a027-4ce2-a6db-e093dcb26541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:35.607728 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b97d9b-a027-4ce2-a6db-e093dcb26541 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:35.608012 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b97d9b-a027-4ce2-a6db-e093dcb26541 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:35.608286 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b97d9b-a027-4ce2-a6db-e093dcb26541 admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:35.608931 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b97d9b-a027-4ce2-a6db-e093dcb26541 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:35.611042 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b97d9b-a027-4ce2-a6db-e093dcb26541 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:35.615682 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88269f6b-d750-4017-ad84-82a62e67b7f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:35.616435 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88269f6b-d750-4017-ad84-82a62e67b7f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:35.616788 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88269f6b-d750-4017-ad84-82a62e67b7f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:35.617130 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88269f6b-d750-4017-ad84-82a62e67b7f3 admin admin] PATH_INFO: `/v3/projects/b92be32ffe244f008b78d0a8ccdc8abc/users/6a50aa65cb0e4777b6cedc104f9ea537/roles/f34412ad29f1478cba775b033129f71f` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:35.619355 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88269f6b-d750-4017-ad84-82a62e67b7f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b92be32ffe244f008b78d0a8ccdc8abc, user_id=6a50aa65cb0e4777b6cedc104f9ea537, role_id=f34412ad29f1478cba775b033129f71f)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:35.622031 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88269f6b-d750-4017-ad84-82a62e67b7f3 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:35.635176 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 958/1882] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 13 15:29:35 2022] PUT /identity/v3/projects/b92be32ffe244f008b78d0a8ccdc8abc/users/6a50aa65cb0e4777b6cedc104f9ea537/roles/f34412ad29f1478cba775b033129f71f => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 15:29:35.642739 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 925/1883] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 13 15:29:35 2022] POST /identity/v3/users => generated 284 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:29:35.646300 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88269f6b-d750-4017-ad84-82a62e67b7f3 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:35.647021 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3960f682-7c04-4f42-81dc-e6020b6bac36 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:35.647523 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3960f682-7c04-4f42-81dc-e6020b6bac36 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:35.647713 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3960f682-7c04-4f42-81dc-e6020b6bac36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:35.678504 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:29:35.687371 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-3960f682-7c04-4f42-81dc-e6020b6bac36 None None] MFA Rules not processed for user `6a50aa65cb0e4777b6cedc104f9ea537`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:29:35.688736 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-3960f682-7c04-4f42-81dc-e6020b6bac36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:35.731249 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88269f6b-d750-4017-ad84-82a62e67b7f3 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:35.736361 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64415f47-f3a8-4573-abf3-8d1c9aec1441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:35.736978 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64415f47-f3a8-4573-abf3-8d1c9aec1441 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:35.737266 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64415f47-f3a8-4573-abf3-8d1c9aec1441 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:35.738549 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64415f47-f3a8-4573-abf3-8d1c9aec1441 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:35.738880 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64415f47-f3a8-4573-abf3-8d1c9aec1441 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:35.740631 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64415f47-f3a8-4573-abf3-8d1c9aec1441 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:35.751759 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 959/1884] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:29:35 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 15:29:35.756481 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64415f47-f3a8-4573-abf3-8d1c9aec1441 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:35.766733 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64415f47-f3a8-4573-abf3-8d1c9aec1441 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:35.772091 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74a7a2e-ed71-4f61-a72e-9e2028623b99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:35.772839 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74a7a2e-ed71-4f61-a72e-9e2028623b99 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:35.773154 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74a7a2e-ed71-4f61-a72e-9e2028623b99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:35.773456 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74a7a2e-ed71-4f61-a72e-9e2028623b99 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:35.774138 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74a7a2e-ed71-4f61-a72e-9e2028623b99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:35.775732 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74a7a2e-ed71-4f61-a72e-9e2028623b99 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:35.779385 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 926/1885] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:29:35 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:29:35.786654 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 960/1886] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:29:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 15:29:35.790768 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3960f682-7c04-4f42-81dc-e6020b6bac36 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:35.791056 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74a7a2e-ed71-4f61-a72e-9e2028623b99 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:35.795272 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-f74a7a2e-ed71-4f61-a72e-9e2028623b99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:35.808196 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3960f682-7c04-4f42-81dc-e6020b6bac36 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:35.813805 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d50efc-2b40-4ace-bc94-6e4e2f2ff5c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:35.814678 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d50efc-2b40-4ace-bc94-6e4e2f2ff5c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:35.814908 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d50efc-2b40-4ace-bc94-6e4e2f2ff5c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:35.815193 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d50efc-2b40-4ace-bc94-6e4e2f2ff5c6 admin admin] PATH_INFO: `/v3/projects/ee420aa5c2cd454a906bf257cb9ad72b/users/2328bb08ab7e4651aa0676004a5ebeca/roles/3fae3d3a28e147d3b2bede2378ff79ae` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:35.841291 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d50efc-2b40-4ace-bc94-6e4e2f2ff5c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee420aa5c2cd454a906bf257cb9ad72b, user_id=2328bb08ab7e4651aa0676004a5ebeca, role_id=3fae3d3a28e147d3b2bede2378ff79ae)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:35.845520 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d50efc-2b40-4ace-bc94-6e4e2f2ff5c6 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:35.848951 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:29:35.874452 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74a7a2e-ed71-4f61-a72e-9e2028623b99 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:35.874911 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 927/1887] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 13 15:29:35 2022] PUT /identity/v3/projects/ee420aa5c2cd454a906bf257cb9ad72b/users/2328bb08ab7e4651aa0676004a5ebeca/roles/3fae3d3a28e147d3b2bede2378ff79ae => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:29:35.875975 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d50efc-2b40-4ace-bc94-6e4e2f2ff5c6 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:35.886886 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-05d50efc-2b40-4ace-bc94-6e4e2f2ff5c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:35.946300 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e14fd6-0e44-49d3-b004-e925a8b61d5b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97acd23097d54bf7805c3cef60626ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:35.947614 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e14fd6-0e44-49d3-b004-e925a8b61d5b service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:35.947907 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e14fd6-0e44-49d3-b004-e925a8b61d5b service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:35.948227 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e14fd6-0e44-49d3-b004-e925a8b61d5b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:35.969692 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d50efc-2b40-4ace-bc94-6e4e2f2ff5c6 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:35.976877 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17c488b-402a-4f44-99f7-518147e3c698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:35.977757 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17c488b-402a-4f44-99f7-518147e3c698 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:35.978054 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17c488b-402a-4f44-99f7-518147e3c698 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:35.978335 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17c488b-402a-4f44-99f7-518147e3c698 admin admin] PATH_INFO: `/v3/users/208cc5c06e7b43ca955a3234eaca0151` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:35.979703 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17c488b-402a-4f44-99f7-518147e3c698 admin admin] RBAC: Authorizing `identity:delete_user(user_id=208cc5c06e7b43ca955a3234eaca0151)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:35.982323 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17c488b-402a-4f44-99f7-518147e3c698 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:36.026597 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e14fd6-0e44-49d3-b004-e925a8b61d5b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:36.028055 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e14fd6-0e44-49d3-b004-e925a8b61d5b service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:36.040025 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 961/1888] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:29:35 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 15:29:36.041149 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69f5f56-6e68-4b85-a428-34aa71e412e9 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:36.041453 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69f5f56-6e68-4b85-a428-34aa71e412e9 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:36.041735 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69f5f56-6e68-4b85-a428-34aa71e412e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:36.053047 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-c17c488b-402a-4f44-99f7-518147e3c698 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '208cc5c06e7b43ca955a3234eaca0151'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:36.053622 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-c17c488b-402a-4f44-99f7-518147e3c698 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '208cc5c06e7b43ca955a3234eaca0151'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:36.054301 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-c17c488b-402a-4f44-99f7-518147e3c698 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '208cc5c06e7b43ca955a3234eaca0151'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:36.063201 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-c17c488b-402a-4f44-99f7-518147e3c698 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '208cc5c06e7b43ca955a3234eaca0151'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:36.086444 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-f69f5f56-6e68-4b85-a428-34aa71e412e9 None None] MFA Rules not processed for user `2328bb08ab7e4651aa0676004a5ebeca`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:29:36.087769 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-f69f5f56-6e68-4b85-a428-34aa71e412e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:36.091960 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:29:36.099682 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-c17c488b-402a-4f44-99f7-518147e3c698 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '208cc5c06e7b43ca955a3234eaca0151'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:36.116650 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 928/1889] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 13 15:29:35 2022] DELETE /identity/v3/users/208cc5c06e7b43ca955a3234eaca0151 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:29:36.124370 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14068ead-d2ba-431e-b1d2-344a3cea871f None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:36.124370 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14068ead-d2ba-431e-b1d2-344a3cea871f None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:36.124370 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14068ead-d2ba-431e-b1d2-344a3cea871f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:36.146470 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-14068ead-d2ba-431e-b1d2-344a3cea871f None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:29:36.147714 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-14068ead-d2ba-431e-b1d2-344a3cea871f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:36.179009 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 962/1890] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:29:36 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:29:36.183848 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69f5f56-6e68-4b85-a428-34aa71e412e9 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:36.185422 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-f69f5f56-6e68-4b85-a428-34aa71e412e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:36.199398 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69f5f56-6e68-4b85-a428-34aa71e412e9 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:36.225074 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 929/1891] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:29:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:29:36.234895 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14068ead-d2ba-431e-b1d2-344a3cea871f None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:36.236299 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-14068ead-d2ba-431e-b1d2-344a3cea871f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:36.258993 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:INSERT=2,keystone:SELECT=88,keystone:DELETE=10 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:29:36.279698 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1a8abf-7647-433d-b1ab-bce1ae017b23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:36.281010 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1a8abf-7647-433d-b1ab-bce1ae017b23 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:36.281298 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1a8abf-7647-433d-b1ab-bce1ae017b23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:36.281571 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1a8abf-7647-433d-b1ab-bce1ae017b23 admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:36.282377 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1a8abf-7647-433d-b1ab-bce1ae017b23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:36.284363 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1a8abf-7647-433d-b1ab-bce1ae017b23 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:36.324897 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14068ead-d2ba-431e-b1d2-344a3cea871f None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:36.335874 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 963/1892] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 13 15:29:36 2022] POST /identity/v3/projects => generated 369 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 15:29:36.340233 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1a8abf-7647-433d-b1ab-bce1ae017b23 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:36.423142 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c8c43d-77d6-42c4-a417-003741f28a07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41675154bbba47388040966f75d84c3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:36.424481 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c8c43d-77d6-42c4-a417-003741f28a07 service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:36.424771 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c8c43d-77d6-42c4-a417-003741f28a07 service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:36.425046 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c8c43d-77d6-42c4-a417-003741f28a07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:36.487517 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1a8abf-7647-433d-b1ab-bce1ae017b23 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:36.495796 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa9ce03-ec90-4cf0-94a3-e2af1a18f6c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:36.495796 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa9ce03-ec90-4cf0-94a3-e2af1a18f6c8 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:36.496121 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa9ce03-ec90-4cf0-94a3-e2af1a18f6c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:36.496238 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa9ce03-ec90-4cf0-94a3-e2af1a18f6c8 admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:36.496900 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa9ce03-ec90-4cf0-94a3-e2af1a18f6c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:36.499749 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa9ce03-ec90-4cf0-94a3-e2af1a18f6c8 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:36.521292 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c8c43d-77d6-42c4-a417-003741f28a07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:36.522912 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c8c43d-77d6-42c4-a417-003741f28a07 service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:36.533208 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 964/1893] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 13 15:29:36 2022] POST /identity/v3/users => generated 291 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 15:29:36.538920 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa9ce03-ec90-4cf0-94a3-e2af1a18f6c8 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:36.542268 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 930/1894] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:29:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 15:29:36.576738 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa9ce03-ec90-4cf0-94a3-e2af1a18f6c8 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:36.582567 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550ee6d4-24a0-44e7-b07a-9247b3b7176a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:36.583242 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550ee6d4-24a0-44e7-b07a-9247b3b7176a admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:36.583507 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550ee6d4-24a0-44e7-b07a-9247b3b7176a admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:36.583784 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550ee6d4-24a0-44e7-b07a-9247b3b7176a admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:36.584439 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550ee6d4-24a0-44e7-b07a-9247b3b7176a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:36.586067 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550ee6d4-24a0-44e7-b07a-9247b3b7176a admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:36.604159 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 965/1895] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:29:36 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 15:29:36.605202 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c8c43d-77d6-42c4-a417-003741f28a07 service neutron] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:36.617192 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c8c43d-77d6-42c4-a417-003741f28a07 service neutron] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:36.639112 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b886ab-bf83-4a18-a955-0da502f70b38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:36.639926 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b886ab-bf83-4a18-a955-0da502f70b38 admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:36.640187 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b886ab-bf83-4a18-a955-0da502f70b38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:36.640527 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b886ab-bf83-4a18-a955-0da502f70b38 admin admin] PATH_INFO: `/v3/projects/38dd819fa8d749f3af5410e0edabc7a2/users/d79c5f6b93ad4e5a8affb97f37aa8e81/roles/f34412ad29f1478cba775b033129f71f` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:36.649340 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550ee6d4-24a0-44e7-b07a-9247b3b7176a admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:36.651869 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-550ee6d4-24a0-44e7-b07a-9247b3b7176a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:36.685555 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b886ab-bf83-4a18-a955-0da502f70b38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38dd819fa8d749f3af5410e0edabc7a2, user_id=d79c5f6b93ad4e5a8affb97f37aa8e81, role_id=f34412ad29f1478cba775b033129f71f)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:36.685555 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b886ab-bf83-4a18-a955-0da502f70b38 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:36.687922 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550ee6d4-24a0-44e7-b07a-9247b3b7176a admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:36.702824 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb98f28f-632e-4f77-8394-9a5dec6b8722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:36.703479 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb98f28f-632e-4f77-8394-9a5dec6b8722 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:36.703939 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb98f28f-632e-4f77-8394-9a5dec6b8722 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:36.704218 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb98f28f-632e-4f77-8394-9a5dec6b8722 admin admin] PATH_INFO: `/v3/users/ed892f735bf642b09d7007fc538aa864` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:36.707456 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb98f28f-632e-4f77-8394-9a5dec6b8722 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed892f735bf642b09d7007fc538aa864)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:36.712568 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb98f28f-632e-4f77-8394-9a5dec6b8722 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:36.715971 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:29:36.737279 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 931/1896] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 13 15:29:36 2022] PUT /identity/v3/projects/38dd819fa8d749f3af5410e0edabc7a2/users/d79c5f6b93ad4e5a8affb97f37aa8e81/roles/f34412ad29f1478cba775b033129f71f => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 15:29:36.743443 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b886ab-bf83-4a18-a955-0da502f70b38 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:36.836544 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-cb98f28f-632e-4f77-8394-9a5dec6b8722 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed892f735bf642b09d7007fc538aa864'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:36.840145 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-cb98f28f-632e-4f77-8394-9a5dec6b8722 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed892f735bf642b09d7007fc538aa864'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:36.842397 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-cb98f28f-632e-4f77-8394-9a5dec6b8722 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed892f735bf642b09d7007fc538aa864'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:36.871890 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-cb98f28f-632e-4f77-8394-9a5dec6b8722 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed892f735bf642b09d7007fc538aa864'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:36.891669 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:29:36.914939 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b886ab-bf83-4a18-a955-0da502f70b38 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:36.917403 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-cb98f28f-632e-4f77-8394-9a5dec6b8722 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed892f735bf642b09d7007fc538aa864'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:36.930554 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efb888f-6dbc-4b6e-94df-8ed397b4f140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:36.931303 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efb888f-6dbc-4b6e-94df-8ed397b4f140 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:36.931587 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efb888f-6dbc-4b6e-94df-8ed397b4f140 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:36.932004 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efb888f-6dbc-4b6e-94df-8ed397b4f140 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:36.932520 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efb888f-6dbc-4b6e-94df-8ed397b4f140 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:36.937201 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efb888f-6dbc-4b6e-94df-8ed397b4f140 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:36.943261 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 966/1897] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 13 15:29:36 2022] DELETE /identity/v3/users/ed892f735bf642b09d7007fc538aa864 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 15:29:36.965937 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84db6691-d591-4df3-b11d-caa17d83cee6 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:36.966232 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84db6691-d591-4df3-b11d-caa17d83cee6 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:36.966517 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84db6691-d591-4df3-b11d-caa17d83cee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:37.014914 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 932/1898] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:29:36 2022] GET /identity/v3/roles => generated 1420 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 15:29:37.017631 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efb888f-6dbc-4b6e-94df-8ed397b4f140 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:37.021156 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-6efb888f-6dbc-4b6e-94df-8ed397b4f140 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:37.045287 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-84db6691-d591-4df3-b11d-caa17d83cee6 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:29:37.045466 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efb888f-6dbc-4b6e-94df-8ed397b4f140 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:37.046580 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-84db6691-d591-4df3-b11d-caa17d83cee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:37.172248 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8270d4-651d-4d24-92ec-ae3b6538ee75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:37.173912 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8270d4-651d-4d24-92ec-ae3b6538ee75 admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:37.174297 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8270d4-651d-4d24-92ec-ae3b6538ee75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:37.174581 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8270d4-651d-4d24-92ec-ae3b6538ee75 admin admin] PATH_INFO: `/v3/projects/38dd819fa8d749f3af5410e0edabc7a2/users/d79c5f6b93ad4e5a8affb97f37aa8e81/roles/f34412ad29f1478cba775b033129f71f` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:37.178997 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8270d4-651d-4d24-92ec-ae3b6538ee75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38dd819fa8d749f3af5410e0edabc7a2, user_id=d79c5f6b93ad4e5a8affb97f37aa8e81, role_id=f34412ad29f1478cba775b033129f71f)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:37.183141 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8270d4-651d-4d24-92ec-ae3b6538ee75 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:37.191321 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 967/1899] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:29:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:29:37.192439 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84db6691-d591-4df3-b11d-caa17d83cee6 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:37.193927 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-84db6691-d591-4df3-b11d-caa17d83cee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:37.203547 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 933/1900] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 13 15:29:37 2022] PUT /identity/v3/projects/38dd819fa8d749f3af5410e0edabc7a2/users/d79c5f6b93ad4e5a8affb97f37aa8e81/roles/f34412ad29f1478cba775b033129f71f => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:29:37.205143 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8270d4-651d-4d24-92ec-ae3b6538ee75 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:37.224783 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84db6691-d591-4df3-b11d-caa17d83cee6 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:37.227078 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-bb8270d4-651d-4d24-92ec-ae3b6538ee75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:37.291613 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cae34f-bdf0-497c-9c50-4fad62fd88b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:37.292386 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cae34f-bdf0-497c-9c50-4fad62fd88b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:37.292737 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cae34f-bdf0-497c-9c50-4fad62fd88b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:37.293083 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cae34f-bdf0-497c-9c50-4fad62fd88b9 admin admin] PATH_INFO: `/v3/users/797f3eb3b64c4cccae65ac0e3cde922a` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:37.294320 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cae34f-bdf0-497c-9c50-4fad62fd88b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=797f3eb3b64c4cccae65ac0e3cde922a)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:37.296318 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cae34f-bdf0-497c-9c50-4fad62fd88b9 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:37.310641 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8270d4-651d-4d24-92ec-ae3b6538ee75 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:37.314566 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fe967c-0b54-4b29-b78b-d3704a9f3b42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41675154bbba47388040966f75d84c3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:37.315381 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fe967c-0b54-4b29-b78b-d3704a9f3b42 service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:37.315949 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fe967c-0b54-4b29-b78b-d3704a9f3b42 service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:37.316397 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fe967c-0b54-4b29-b78b-d3704a9f3b42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:37.327225 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:29:37.330250 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fe967c-0b54-4b29-b78b-d3704a9f3b42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:37.333349 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fe967c-0b54-4b29-b78b-d3704a9f3b42 service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:37.345539 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 934/1901] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:29:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:29:37.346989 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5553535d-83ff-4127-860c-386c4928b176 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:37.347993 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5553535d-83ff-4127-860c-386c4928b176 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:37.348352 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5553535d-83ff-4127-860c-386c4928b176 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:37.374976 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-81cae34f-bdf0-497c-9c50-4fad62fd88b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '797f3eb3b64c4cccae65ac0e3cde922a'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:37.375727 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-81cae34f-bdf0-497c-9c50-4fad62fd88b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '797f3eb3b64c4cccae65ac0e3cde922a'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:37.377017 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-81cae34f-bdf0-497c-9c50-4fad62fd88b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '797f3eb3b64c4cccae65ac0e3cde922a'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:37.390010 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-81cae34f-bdf0-497c-9c50-4fad62fd88b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '797f3eb3b64c4cccae65ac0e3cde922a'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:37.395389 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-5553535d-83ff-4127-860c-386c4928b176 None None] MFA Rules not processed for user `d79c5f6b93ad4e5a8affb97f37aa8e81`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:29:37.396889 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-5553535d-83ff-4127-860c-386c4928b176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:37.420709 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-81cae34f-bdf0-497c-9c50-4fad62fd88b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '797f3eb3b64c4cccae65ac0e3cde922a'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:37.443746 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 968/1902] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 13 15:29:37 2022] DELETE /identity/v3/users/797f3eb3b64c4cccae65ac0e3cde922a => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:29:37.450357 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece31b96-4959-4f5b-9cb3-0a8cae22694e None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:37.450651 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece31b96-4959-4f5b-9cb3-0a8cae22694e None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:37.450947 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece31b96-4959-4f5b-9cb3-0a8cae22694e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:37.481097 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-ece31b96-4959-4f5b-9cb3-0a8cae22694e None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:29:37.482293 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-ece31b96-4959-4f5b-9cb3-0a8cae22694e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:37.504460 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 935/1903] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:29:37 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:29:37.515404 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5553535d-83ff-4127-860c-386c4928b176 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:37.516918 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-5553535d-83ff-4127-860c-386c4928b176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:37.535810 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:29:37.598585 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 969/1904] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:29:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 15:29:37.618329 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5553535d-83ff-4127-860c-386c4928b176 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:37.624917 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece31b96-4959-4f5b-9cb3-0a8cae22694e None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:37.630236 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-ece31b96-4959-4f5b-9cb3-0a8cae22694e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:37.699627 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2603edea-aeb3-40d0-9a4f-504b7c80b408 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97acd23097d54bf7805c3cef60626ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:37.700562 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2603edea-aeb3-40d0-9a4f-504b7c80b408 service cinder] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:37.701571 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2603edea-aeb3-40d0-9a4f-504b7c80b408 service cinder] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:37.702151 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2603edea-aeb3-40d0-9a4f-504b7c80b408 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:37.764397 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece31b96-4959-4f5b-9cb3-0a8cae22694e None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:37.778572 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78afe30f-33e6-42c7-b26e-7a76e8ee01f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41675154bbba47388040966f75d84c3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:37.779240 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78afe30f-33e6-42c7-b26e-7a76e8ee01f9 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:37.779529 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78afe30f-33e6-42c7-b26e-7a76e8ee01f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:37.779810 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78afe30f-33e6-42c7-b26e-7a76e8ee01f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:37.804693 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78afe30f-33e6-42c7-b26e-7a76e8ee01f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:37.806650 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78afe30f-33e6-42c7-b26e-7a76e8ee01f9 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:37.818616 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 970/1905] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:29:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:29:37.819358 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78afe30f-33e6-42c7-b26e-7a76e8ee01f9 service neutron] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:37.820671 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-78afe30f-33e6-42c7-b26e-7a76e8ee01f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:37.830889 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2603edea-aeb3-40d0-9a4f-504b7c80b408 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:37.832722 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2603edea-aeb3-40d0-9a4f-504b7c80b408 service cinder] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:37.843723 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78afe30f-33e6-42c7-b26e-7a76e8ee01f9 service neutron] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:37.848635 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 936/1906] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:29:37 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 15:29:37.850205 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2603edea-aeb3-40d0-9a4f-504b7c80b408 service cinder] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:37.851229 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aae1f29-7fb0-43ac-8854-bbcd55a9e245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:37.851502 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-2603edea-aeb3-40d0-9a4f-504b7c80b408 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:37.852421 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aae1f29-7fb0-43ac-8854-bbcd55a9e245 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:37.852801 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aae1f29-7fb0-43ac-8854-bbcd55a9e245 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:37.853179 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aae1f29-7fb0-43ac-8854-bbcd55a9e245 admin admin] PATH_INFO: `/v3/projects/12443f4189db4e5db6614ba93d59770b` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:37.855901 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aae1f29-7fb0-43ac-8854-bbcd55a9e245 admin admin] RBAC: Authorizing `identity:delete_project(project_id=12443f4189db4e5db6614ba93d59770b)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:37.858454 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aae1f29-7fb0-43ac-8854-bbcd55a9e245 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:37.868398 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2603edea-aeb3-40d0-9a4f-504b7c80b408 service cinder] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:37.875243 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdf3d1a-b32c-4d0d-af9b-6acedb395dd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:37.875893 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdf3d1a-b32c-4d0d-af9b-6acedb395dd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:37.876177 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdf3d1a-b32c-4d0d-af9b-6acedb395dd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:37.876510 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdf3d1a-b32c-4d0d-af9b-6acedb395dd6 admin admin] PATH_INFO: `/v3/projects/b850767b8f0444ea95e113257aa6cb00` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:37.878291 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdf3d1a-b32c-4d0d-af9b-6acedb395dd6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b850767b8f0444ea95e113257aa6cb00)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:37.881717 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdf3d1a-b32c-4d0d-af9b-6acedb395dd6 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:37.930771 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:29:37.945616 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-6aae1f29-7fb0-43ac-8854-bbcd55a9e245 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12443f4189db4e5db6614ba93d59770b', 'request_id': 'req-6aae1f29-7fb0-43ac-8854-bbcd55a9e245'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:37.954545 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-6aae1f29-7fb0-43ac-8854-bbcd55a9e245 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12443f4189db4e5db6614ba93d59770b', 'request_id': 'req-6aae1f29-7fb0-43ac-8854-bbcd55a9e245'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:37.964049 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-5cdf3d1a-b32c-4d0d-af9b-6acedb395dd6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b850767b8f0444ea95e113257aa6cb00', 'request_id': 'req-5cdf3d1a-b32c-4d0d-af9b-6acedb395dd6'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:37.968096 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-6aae1f29-7fb0-43ac-8854-bbcd55a9e245 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12443f4189db4e5db6614ba93d59770b', 'request_id': 'req-6aae1f29-7fb0-43ac-8854-bbcd55a9e245'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:37.980192 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-5cdf3d1a-b32c-4d0d-af9b-6acedb395dd6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b850767b8f0444ea95e113257aa6cb00', 'request_id': 'req-5cdf3d1a-b32c-4d0d-af9b-6acedb395dd6'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:37.990151 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-6aae1f29-7fb0-43ac-8854-bbcd55a9e245 admin admin] The token cache is being invalidate because project 12443f4189db4e5db6614ba93d59770b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 15:29:37.991047 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-6aae1f29-7fb0-43ac-8854-bbcd55a9e245 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:37.991925 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-6aae1f29-7fb0-43ac-8854-bbcd55a9e245 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:37.993835 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 971/1907] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 13 15:29:37 2022] DELETE /identity/v3/projects/12443f4189db4e5db6614ba93d59770b => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:29:37.995504 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-5cdf3d1a-b32c-4d0d-af9b-6acedb395dd6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b850767b8f0444ea95e113257aa6cb00', 'request_id': 'req-5cdf3d1a-b32c-4d0d-af9b-6acedb395dd6'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:38.004186 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0688f4-9d49-4a07-b98d-f04179fa7c58 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:38.006055 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0688f4-9d49-4a07-b98d-f04179fa7c58 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:38.006055 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0688f4-9d49-4a07-b98d-f04179fa7c58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:38.024364 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-5cdf3d1a-b32c-4d0d-af9b-6acedb395dd6 admin admin] The token cache is being invalidate because project b850767b8f0444ea95e113257aa6cb00 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 15:29:38.030725 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-5cdf3d1a-b32c-4d0d-af9b-6acedb395dd6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:38.031763 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-5cdf3d1a-b32c-4d0d-af9b-6acedb395dd6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:38.034217 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 937/1908] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 13 15:29:37 2022] DELETE /identity/v3/projects/b850767b8f0444ea95e113257aa6cb00 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:29:38.054330 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdf3d1a-b32c-4d0d-af9b-6acedb395dd6 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:38.063510 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-5cdf3d1a-b32c-4d0d-af9b-6acedb395dd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:38.076513 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:29:38.077882 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-7b0688f4-9d49-4a07-b98d-f04179fa7c58 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:29:38.080698 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-7b0688f4-9d49-4a07-b98d-f04179fa7c58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:38.182683 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 972/1909] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:29:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:29:38.192941 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f028d457-10c9-4aaf-9d70-5c5b16ae37a6 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:38.193234 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f028d457-10c9-4aaf-9d70-5c5b16ae37a6 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:38.194324 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f028d457-10c9-4aaf-9d70-5c5b16ae37a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:38.223410 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-f028d457-10c9-4aaf-9d70-5c5b16ae37a6 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:29:38.224739 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-f028d457-10c9-4aaf-9d70-5c5b16ae37a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:38.236458 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdf3d1a-b32c-4d0d-af9b-6acedb395dd6 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:38.239245 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 973/1910] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:29:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:29:38.240576 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f028d457-10c9-4aaf-9d70-5c5b16ae37a6 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:38.249266 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f225106a-11b2-4318-8c9c-f8b03ee85fb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:38.249899 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f225106a-11b2-4318-8c9c-f8b03ee85fb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:38.250184 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f225106a-11b2-4318-8c9c-f8b03ee85fb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:38.250458 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f225106a-11b2-4318-8c9c-f8b03ee85fb2 admin admin] PATH_INFO: `/v3/users/6a50aa65cb0e4777b6cedc104f9ea537` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:38.251100 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f028d457-10c9-4aaf-9d70-5c5b16ae37a6 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:38.254969 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f225106a-11b2-4318-8c9c-f8b03ee85fb2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a50aa65cb0e4777b6cedc104f9ea537)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:38.256979 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f225106a-11b2-4318-8c9c-f8b03ee85fb2 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:38.257893 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c58d403-70ba-4ac2-9007-286f759aec5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:38.258520 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c58d403-70ba-4ac2-9007-286f759aec5b admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:38.258802 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c58d403-70ba-4ac2-9007-286f759aec5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:38.259077 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c58d403-70ba-4ac2-9007-286f759aec5b admin admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:38.260064 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c58d403-70ba-4ac2-9007-286f759aec5b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:29:38.260495 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c58d403-70ba-4ac2-9007-286f759aec5b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:38.262657 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c58d403-70ba-4ac2-9007-286f759aec5b admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:38.281182 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 974/1911] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Sep 13 15:29:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:29:38.289751 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c58d403-70ba-4ac2-9007-286f759aec5b admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:38.318608 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c58d403-70ba-4ac2-9007-286f759aec5b admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:38.329593 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74f7583-f31a-44e8-b1a8-b850deeeae8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:38.330495 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74f7583-f31a-44e8-b1a8-b850deeeae8a admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:38.330762 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74f7583-f31a-44e8-b1a8-b850deeeae8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:38.331122 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74f7583-f31a-44e8-b1a8-b850deeeae8a admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:38.334457 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74f7583-f31a-44e8-b1a8-b850deeeae8a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:38.339114 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74f7583-f31a-44e8-b1a8-b850deeeae8a admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:38.360462 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-f225106a-11b2-4318-8c9c-f8b03ee85fb2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a50aa65cb0e4777b6cedc104f9ea537'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:38.362142 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-f225106a-11b2-4318-8c9c-f8b03ee85fb2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a50aa65cb0e4777b6cedc104f9ea537'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:38.364233 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-f225106a-11b2-4318-8c9c-f8b03ee85fb2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a50aa65cb0e4777b6cedc104f9ea537'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:38.380839 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-f225106a-11b2-4318-8c9c-f8b03ee85fb2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a50aa65cb0e4777b6cedc104f9ea537'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:38.427263 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-f225106a-11b2-4318-8c9c-f8b03ee85fb2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a50aa65cb0e4777b6cedc104f9ea537'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:38.446460 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 975/1912] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 13 15:29:38 2022] POST /identity/v3/projects => generated 369 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:29:38.447350 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74f7583-f31a-44e8-b1a8-b850deeeae8a admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:38.452273 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-d74f7583-f31a-44e8-b1a8-b850deeeae8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:38.462412 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 938/1913] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 13 15:29:38 2022] DELETE /identity/v3/users/6a50aa65cb0e4777b6cedc104f9ea537 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:29:38.467352 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f225106a-11b2-4318-8c9c-f8b03ee85fb2 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:38.469569 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-f225106a-11b2-4318-8c9c-f8b03ee85fb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:38.562038 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f225106a-11b2-4318-8c9c-f8b03ee85fb2 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:38.569424 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93328cb9-34cf-4bd8-800d-5e2297f1abc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:38.570169 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93328cb9-34cf-4bd8-800d-5e2297f1abc0 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:38.570458 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93328cb9-34cf-4bd8-800d-5e2297f1abc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:38.570731 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93328cb9-34cf-4bd8-800d-5e2297f1abc0 admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:38.571382 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93328cb9-34cf-4bd8-800d-5e2297f1abc0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:38.578418 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93328cb9-34cf-4bd8-800d-5e2297f1abc0 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:38.601779 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 939/1914] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 13 15:29:38 2022] POST /identity/v3/users => generated 285 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:29:38.602787 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93328cb9-34cf-4bd8-800d-5e2297f1abc0 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:38.610951 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74f7583-f31a-44e8-b1a8-b850deeeae8a admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:38.616933 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93328cb9-34cf-4bd8-800d-5e2297f1abc0 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:38.617057 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28432b01-911c-454d-97e3-b31642d5a68f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:38.617990 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28432b01-911c-454d-97e3-b31642d5a68f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:38.618240 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28432b01-911c-454d-97e3-b31642d5a68f admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:38.618652 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28432b01-911c-454d-97e3-b31642d5a68f admin admin] PATH_INFO: `/v3/projects/1849ab8282cc49008feb89df602bd08c` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:38.619798 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28432b01-911c-454d-97e3-b31642d5a68f admin admin] RBAC: Authorizing `identity:delete_project(project_id=1849ab8282cc49008feb89df602bd08c)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:38.624752 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28432b01-911c-454d-97e3-b31642d5a68f admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:38.626532 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d279dc-f269-499c-b735-f33d4d61239e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:38.627269 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d279dc-f269-499c-b735-f33d4d61239e admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:38.627722 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d279dc-f269-499c-b735-f33d4d61239e admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:38.628009 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d279dc-f269-499c-b735-f33d4d61239e admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:38.629637 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d279dc-f269-499c-b735-f33d4d61239e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:38.631385 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d279dc-f269-499c-b735-f33d4d61239e admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:38.639211 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:29:38.648183 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 940/1915] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:29:38 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 15:29:38.654315 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d279dc-f269-499c-b735-f33d4d61239e admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:38.673143 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d279dc-f269-499c-b735-f33d4d61239e admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:38.674891 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:29:38.681555 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99eb38e3-e7fa-4f96-bdcd-533b0812d35f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:38.683041 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eb38e3-e7fa-4f96-bdcd-533b0812d35f admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:38.683443 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eb38e3-e7fa-4f96-bdcd-533b0812d35f admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:38.683727 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eb38e3-e7fa-4f96-bdcd-533b0812d35f admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:38.684435 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99eb38e3-e7fa-4f96-bdcd-533b0812d35f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:38.686289 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99eb38e3-e7fa-4f96-bdcd-533b0812d35f admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:38.701483 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 941/1916] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:29:38 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 15:29:38.707841 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99eb38e3-e7fa-4f96-bdcd-533b0812d35f admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:38.719874 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-28432b01-911c-454d-97e3-b31642d5a68f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1849ab8282cc49008feb89df602bd08c', 'request_id': 'req-28432b01-911c-454d-97e3-b31642d5a68f'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:38.733548 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99eb38e3-e7fa-4f96-bdcd-533b0812d35f admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:38.734551 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-28432b01-911c-454d-97e3-b31642d5a68f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1849ab8282cc49008feb89df602bd08c', 'request_id': 'req-28432b01-911c-454d-97e3-b31642d5a68f'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:38.749763 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-28432b01-911c-454d-97e3-b31642d5a68f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1849ab8282cc49008feb89df602bd08c', 'request_id': 'req-28432b01-911c-454d-97e3-b31642d5a68f'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:38.767737 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-28432b01-911c-454d-97e3-b31642d5a68f admin admin] The token cache is being invalidate because project 1849ab8282cc49008feb89df602bd08c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 15:29:38.768336 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-28432b01-911c-454d-97e3-b31642d5a68f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:38.768775 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-28432b01-911c-454d-97e3-b31642d5a68f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:38.774445 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 976/1917] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 13 15:29:38 2022] DELETE /identity/v3/projects/1849ab8282cc49008feb89df602bd08c => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:29:38.775755 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28432b01-911c-454d-97e3-b31642d5a68f admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:38.776964 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-28432b01-911c-454d-97e3-b31642d5a68f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:38.829328 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7054142-2416-40de-9829-524475d79462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:38.830147 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7054142-2416-40de-9829-524475d79462 admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:38.830876 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7054142-2416-40de-9829-524475d79462 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:38.831273 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7054142-2416-40de-9829-524475d79462 admin admin] PATH_INFO: `/v3/projects/b693df38b0d84022a8a463b4f841cdc9/users/9024bfbaba2842ae9dfff62f0c2a1000/roles/3fae3d3a28e147d3b2bede2378ff79ae` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:38.864373 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7054142-2416-40de-9829-524475d79462 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b693df38b0d84022a8a463b4f841cdc9, user_id=9024bfbaba2842ae9dfff62f0c2a1000, role_id=3fae3d3a28e147d3b2bede2378ff79ae)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:38.871611 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7054142-2416-40de-9829-524475d79462 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:38.914989 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 942/1918] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 13 15:29:38 2022] PUT /identity/v3/projects/b693df38b0d84022a8a463b4f841cdc9/users/9024bfbaba2842ae9dfff62f0c2a1000/roles/3fae3d3a28e147d3b2bede2378ff79ae => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:29:38.915982 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28432b01-911c-454d-97e3-b31642d5a68f admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:38.929117 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfe0d68-2e7d-406d-ad6e-ad808a0b229e None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:38.929292 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfe0d68-2e7d-406d-ad6e-ad808a0b229e None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:38.929498 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfe0d68-2e7d-406d-ad6e-ad808a0b229e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:38.989843 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-bdfe0d68-2e7d-406d-ad6e-ad808a0b229e None None] MFA Rules not processed for user `9024bfbaba2842ae9dfff62f0c2a1000`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:29:38.992138 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-bdfe0d68-2e7d-406d-ad6e-ad808a0b229e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:39.046462 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260a8387-5584-4817-af88-74312205449c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:39.047569 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260a8387-5584-4817-af88-74312205449c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:39.047933 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260a8387-5584-4817-af88-74312205449c admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:39.048295 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260a8387-5584-4817-af88-74312205449c admin admin] PATH_INFO: `/v3/users/7d29f6bc41354ab180c25c793cdf035f` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:39.054616 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260a8387-5584-4817-af88-74312205449c admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d29f6bc41354ab180c25c793cdf035f)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:39.057057 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260a8387-5584-4817-af88-74312205449c admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:39.110763 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 943/1919] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:29:38 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:29:39.111717 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfe0d68-2e7d-406d-ad6e-ad808a0b229e None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:39.113419 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-bdfe0d68-2e7d-406d-ad6e-ad808a0b229e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:39.128185 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfe0d68-2e7d-406d-ad6e-ad808a0b229e None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:39.129783 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-260a8387-5584-4817-af88-74312205449c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d29f6bc41354ab180c25c793cdf035f'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:39.134222 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-260a8387-5584-4817-af88-74312205449c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d29f6bc41354ab180c25c793cdf035f'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:39.134872 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-260a8387-5584-4817-af88-74312205449c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d29f6bc41354ab180c25c793cdf035f'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:39.137758 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86c9feb-fdee-45ef-be08-eb659e19ad03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:39.138565 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86c9feb-fdee-45ef-be08-eb659e19ad03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:39.138853 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86c9feb-fdee-45ef-be08-eb659e19ad03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:39.139121 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86c9feb-fdee-45ef-be08-eb659e19ad03 admin admin] PATH_INFO: `/v3/projects/b92be32ffe244f008b78d0a8ccdc8abc` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:39.140377 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86c9feb-fdee-45ef-be08-eb659e19ad03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b92be32ffe244f008b78d0a8ccdc8abc)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:39.142246 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86c9feb-fdee-45ef-be08-eb659e19ad03 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:39.143183 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-260a8387-5584-4817-af88-74312205449c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d29f6bc41354ab180c25c793cdf035f'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:39.152269 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:29:39.160204 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-260a8387-5584-4817-af88-74312205449c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d29f6bc41354ab180c25c793cdf035f'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:39.176089 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 977/1920] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 13 15:29:38 2022] DELETE /identity/v3/users/7d29f6bc41354ab180c25c793cdf035f => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:29:39.177774 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260a8387-5584-4817-af88-74312205449c admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:39.179582 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-260a8387-5584-4817-af88-74312205449c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:39.219809 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-b86c9feb-fdee-45ef-be08-eb659e19ad03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b92be32ffe244f008b78d0a8ccdc8abc', 'request_id': 'req-b86c9feb-fdee-45ef-be08-eb659e19ad03'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:39.227747 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-b86c9feb-fdee-45ef-be08-eb659e19ad03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b92be32ffe244f008b78d0a8ccdc8abc', 'request_id': 'req-b86c9feb-fdee-45ef-be08-eb659e19ad03'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:39.230851 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:29:39.235500 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-b86c9feb-fdee-45ef-be08-eb659e19ad03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b92be32ffe244f008b78d0a8ccdc8abc', 'request_id': 'req-b86c9feb-fdee-45ef-be08-eb659e19ad03'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:39.257496 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-b86c9feb-fdee-45ef-be08-eb659e19ad03 admin admin] The token cache is being invalidate because project b92be32ffe244f008b78d0a8ccdc8abc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 15:29:39.257881 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-b86c9feb-fdee-45ef-be08-eb659e19ad03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:39.258573 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-b86c9feb-fdee-45ef-be08-eb659e19ad03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:39.264372 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 944/1921] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 13 15:29:39 2022] DELETE /identity/v3/projects/b92be32ffe244f008b78d0a8ccdc8abc => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:29:39.266397 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881f7b56-a684-4e06-a549-4126e6b2858e None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:39.269770 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881f7b56-a684-4e06-a549-4126e6b2858e None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:39.270287 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881f7b56-a684-4e06-a549-4126e6b2858e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:39.295450 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-881f7b56-a684-4e06-a549-4126e6b2858e None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:29:39.297183 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-881f7b56-a684-4e06-a549-4126e6b2858e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:39.325373 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260a8387-5584-4817-af88-74312205449c admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:39.394849 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 945/1922] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:29:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:29:39.402493 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791a99b8-df98-4e03-8f94-2058fc3ae26f None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:39.402493 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791a99b8-df98-4e03-8f94-2058fc3ae26f None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:39.403017 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791a99b8-df98-4e03-8f94-2058fc3ae26f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:39.415403 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2728e0b7-d753-4c71-b1ef-01f884b4c410 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef26a5203094c83b52f10b930dfc453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:39.416303 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2728e0b7-d753-4c71-b1ef-01f884b4c410 service glance] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:39.416303 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2728e0b7-d753-4c71-b1ef-01f884b4c410 service glance] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:39.416599 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2728e0b7-d753-4c71-b1ef-01f884b4c410 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:39.418432 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-2728e0b7-d753-4c71-b1ef-01f884b4c410 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:39.427042 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-791a99b8-df98-4e03-8f94-2058fc3ae26f None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:29:39.428406 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-791a99b8-df98-4e03-8f94-2058fc3ae26f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:39.441011 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 946/1923] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:29:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:29:39.442393 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791a99b8-df98-4e03-8f94-2058fc3ae26f None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:39.463733 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791a99b8-df98-4e03-8f94-2058fc3ae26f None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:39.476554 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3def66c0-b0cc-48e3-b144-2a94221fe5d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:39.477512 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3def66c0-b0cc-48e3-b144-2a94221fe5d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:39.477979 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3def66c0-b0cc-48e3-b144-2a94221fe5d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:39.478407 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3def66c0-b0cc-48e3-b144-2a94221fe5d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:39.480034 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3def66c0-b0cc-48e3-b144-2a94221fe5d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:29:39.480688 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3def66c0-b0cc-48e3-b144-2a94221fe5d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:39.483237 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3def66c0-b0cc-48e3-b144-2a94221fe5d5 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:39.508885 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 947/1924] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Sep 13 15:29:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:29:39.510064 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3def66c0-b0cc-48e3-b144-2a94221fe5d5 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:39.523684 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3def66c0-b0cc-48e3-b144-2a94221fe5d5 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:39.530841 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d7b6d1-2247-4f20-bef1-092665647556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:39.531480 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d7b6d1-2247-4f20-bef1-092665647556 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:39.531763 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d7b6d1-2247-4f20-bef1-092665647556 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:39.532431 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d7b6d1-2247-4f20-bef1-092665647556 admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:39.541730 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d7b6d1-2247-4f20-bef1-092665647556 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:39.541730 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d7b6d1-2247-4f20-bef1-092665647556 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:39.571764 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2728e0b7-d753-4c71-b1ef-01f884b4c410 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:39.577743 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2728e0b7-d753-4c71-b1ef-01f884b4c410 service glance] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:39.599885 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 948/1925] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 13 15:29:39 2022] POST /identity/v3/projects => generated 385 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:29:39.601381 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d7b6d1-2247-4f20-bef1-092665647556 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:39.620133 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 978/1926] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:29:39 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:29:39.634738 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2728e0b7-d753-4c71-b1ef-01f884b4c410 service glance] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:39.636834 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-2728e0b7-d753-4c71-b1ef-01f884b4c410 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:39.668233 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2728e0b7-d753-4c71-b1ef-01f884b4c410 service glance] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:39.766948 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d7b6d1-2247-4f20-bef1-092665647556 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:39.774157 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdcb863-5dd9-49df-82f5-74cd814bf1bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:39.774836 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdcb863-5dd9-49df-82f5-74cd814bf1bd admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:39.775381 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdcb863-5dd9-49df-82f5-74cd814bf1bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:39.775726 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdcb863-5dd9-49df-82f5-74cd814bf1bd admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:39.776309 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdcb863-5dd9-49df-82f5-74cd814bf1bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:39.785925 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdcb863-5dd9-49df-82f5-74cd814bf1bd admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:39.790826 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:29:39.842067 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 949/1927] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 13 15:29:39 2022] POST /identity/v3/users => generated 293 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:29:39.857299 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdcb863-5dd9-49df-82f5-74cd814bf1bd admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:39.867785 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-3fdcb863-5dd9-49df-82f5-74cd814bf1bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:39.888646 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b642f7f3-dac1-48a2-9438-43db64ed51a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:39.889869 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b642f7f3-dac1-48a2-9438-43db64ed51a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:39.890219 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b642f7f3-dac1-48a2-9438-43db64ed51a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:39.891001 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b642f7f3-dac1-48a2-9438-43db64ed51a0 admin admin] PATH_INFO: `/v3/users/ce78f15e45d34cf6aaefdd1432e8dda5` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:39.892325 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdcb863-5dd9-49df-82f5-74cd814bf1bd admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:39.892422 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b642f7f3-dac1-48a2-9438-43db64ed51a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce78f15e45d34cf6aaefdd1432e8dda5)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:39.895577 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b642f7f3-dac1-48a2-9438-43db64ed51a0 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:39.897319 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7674754e-ba9c-4644-840e-8e1f497ff048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:39.898301 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7674754e-ba9c-4644-840e-8e1f497ff048 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:39.899247 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7674754e-ba9c-4644-840e-8e1f497ff048 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:39.899582 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7674754e-ba9c-4644-840e-8e1f497ff048 admin admin] PATH_INFO: `/v3/projects/fe0ed95091384eb18c1ab107f81a7599` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:39.900854 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7674754e-ba9c-4644-840e-8e1f497ff048 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe0ed95091384eb18c1ab107f81a7599)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:39.903518 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7674754e-ba9c-4644-840e-8e1f497ff048 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:39.986428 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-b642f7f3-dac1-48a2-9438-43db64ed51a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce78f15e45d34cf6aaefdd1432e8dda5'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:39.989387 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-b642f7f3-dac1-48a2-9438-43db64ed51a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce78f15e45d34cf6aaefdd1432e8dda5'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:39.990717 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-b642f7f3-dac1-48a2-9438-43db64ed51a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce78f15e45d34cf6aaefdd1432e8dda5'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:40.005771 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:29:40.012498 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-b642f7f3-dac1-48a2-9438-43db64ed51a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce78f15e45d34cf6aaefdd1432e8dda5'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:40.035782 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-7674754e-ba9c-4644-840e-8e1f497ff048 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe0ed95091384eb18c1ab107f81a7599', 'request_id': 'req-7674754e-ba9c-4644-840e-8e1f497ff048'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:40.044317 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-7674754e-ba9c-4644-840e-8e1f497ff048 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe0ed95091384eb18c1ab107f81a7599', 'request_id': 'req-7674754e-ba9c-4644-840e-8e1f497ff048'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:40.060595 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-7674754e-ba9c-4644-840e-8e1f497ff048 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe0ed95091384eb18c1ab107f81a7599', 'request_id': 'req-7674754e-ba9c-4644-840e-8e1f497ff048'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:40.063782 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-b642f7f3-dac1-48a2-9438-43db64ed51a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce78f15e45d34cf6aaefdd1432e8dda5'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:40.095088 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-7674754e-ba9c-4644-840e-8e1f497ff048 admin admin] The token cache is being invalidate because project fe0ed95091384eb18c1ab107f81a7599 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 15:29:40.095698 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 979/1928] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 13 15:29:39 2022] DELETE /identity/v3/users/ce78f15e45d34cf6aaefdd1432e8dda5 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:29:40.096634 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b642f7f3-dac1-48a2-9438-43db64ed51a0 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:40.099156 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-7674754e-ba9c-4644-840e-8e1f497ff048 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:40.099366 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-b642f7f3-dac1-48a2-9438-43db64ed51a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:40.099928 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-7674754e-ba9c-4644-840e-8e1f497ff048 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:40.109290 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 950/1929] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 13 15:29:39 2022] DELETE /identity/v3/projects/fe0ed95091384eb18c1ab107f81a7599 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:29:40.110762 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a696f6d-d2a4-460e-a760-d07e9d2f9b40 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:40.111126 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a696f6d-d2a4-460e-a760-d07e9d2f9b40 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:40.111307 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a696f6d-d2a4-460e-a760-d07e9d2f9b40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:40.139835 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-2a696f6d-d2a4-460e-a760-d07e9d2f9b40 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:29:40.143620 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-2a696f6d-d2a4-460e-a760-d07e9d2f9b40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:40.193463 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b642f7f3-dac1-48a2-9438-43db64ed51a0 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:40.202130 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e135df9-e1ee-40dc-b3b8-5e825f4c89dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:40.206118 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e135df9-e1ee-40dc-b3b8-5e825f4c89dd admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:40.206118 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e135df9-e1ee-40dc-b3b8-5e825f4c89dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:40.206118 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e135df9-e1ee-40dc-b3b8-5e825f4c89dd admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:40.206118 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e135df9-e1ee-40dc-b3b8-5e825f4c89dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:40.208046 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e135df9-e1ee-40dc-b3b8-5e825f4c89dd admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:40.225135 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 980/1930] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:29:40 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 15:29:40.227024 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dadb560-e9dd-4998-ab29-3f87f01cdc55 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:40.227336 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dadb560-e9dd-4998-ab29-3f87f01cdc55 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:40.227772 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dadb560-e9dd-4998-ab29-3f87f01cdc55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:40.252851 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 951/1931] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:29:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:29:40.253754 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a696f6d-d2a4-460e-a760-d07e9d2f9b40 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:40.255614 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-2a696f6d-d2a4-460e-a760-d07e9d2f9b40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:40.272003 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a696f6d-d2a4-460e-a760-d07e9d2f9b40 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:40.273182 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-7dadb560-e9dd-4998-ab29-3f87f01cdc55 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:29:40.274493 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-7dadb560-e9dd-4998-ab29-3f87f01cdc55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:40.280191 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2469ecc-53d7-4612-812d-4755a79270fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:40.281451 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2469ecc-53d7-4612-812d-4755a79270fe admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:40.282079 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2469ecc-53d7-4612-812d-4755a79270fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:40.282726 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2469ecc-53d7-4612-812d-4755a79270fe admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:40.283972 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2469ecc-53d7-4612-812d-4755a79270fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:40.286631 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2469ecc-53d7-4612-812d-4755a79270fe admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:40.305759 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 952/1932] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:29:40 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 15:29:40.305759 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2469ecc-53d7-4612-812d-4755a79270fe admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:40.306855 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-c2469ecc-53d7-4612-812d-4755a79270fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:40.316075 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 981/1933] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:29:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:29:40.317332 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dadb560-e9dd-4998-ab29-3f87f01cdc55 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:40.337488 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dadb560-e9dd-4998-ab29-3f87f01cdc55 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:40.351975 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f617708-6cf1-4ad3-9f07-6f92ec51df04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:40.353828 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f617708-6cf1-4ad3-9f07-6f92ec51df04 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:40.355039 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f617708-6cf1-4ad3-9f07-6f92ec51df04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:40.355252 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f617708-6cf1-4ad3-9f07-6f92ec51df04 admin admin] PATH_INFO: `/v3/projects/dd91663d35ab461bb22ba10716dfd91c/users/97ebeda781ba43c7a14f39312eafcc90/roles/3fae3d3a28e147d3b2bede2378ff79ae` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:40.374211 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f617708-6cf1-4ad3-9f07-6f92ec51df04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd91663d35ab461bb22ba10716dfd91c, user_id=97ebeda781ba43c7a14f39312eafcc90, role_id=3fae3d3a28e147d3b2bede2378ff79ae)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:40.377173 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f617708-6cf1-4ad3-9f07-6f92ec51df04 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:40.395070 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2469ecc-53d7-4612-812d-4755a79270fe admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:40.411943 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 982/1934] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 13 15:29:40 2022] PUT /identity/v3/projects/dd91663d35ab461bb22ba10716dfd91c/users/97ebeda781ba43c7a14f39312eafcc90/roles/3fae3d3a28e147d3b2bede2378ff79ae => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:29:40.413324 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4969e3-ba43-46c9-be2f-1ffb4331c23a None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:40.413620 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4969e3-ba43-46c9-be2f-1ffb4331c23a None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:40.413929 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4969e3-ba43-46c9-be2f-1ffb4331c23a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:40.436229 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-eb4969e3-ba43-46c9-be2f-1ffb4331c23a None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:29:40.437576 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-eb4969e3-ba43-46c9-be2f-1ffb4331c23a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:40.452286 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:29:40.525112 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f639568-14cc-4eb6-8738-6d56a20ec55f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41675154bbba47388040966f75d84c3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:40.525112 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f639568-14cc-4eb6-8738-6d56a20ec55f service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:40.525112 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f639568-14cc-4eb6-8738-6d56a20ec55f service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:40.525112 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f639568-14cc-4eb6-8738-6d56a20ec55f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:40.554036 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 983/1935] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:29:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:29:40.554036 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e657dcf0-03be-4127-964e-5b79cf0de0e9 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:40.554036 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e657dcf0-03be-4127-964e-5b79cf0de0e9 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:40.554036 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e657dcf0-03be-4127-964e-5b79cf0de0e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:40.554409 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:29:40.592860 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-e657dcf0-03be-4127-964e-5b79cf0de0e9 None None] MFA Rules not processed for user `97ebeda781ba43c7a14f39312eafcc90`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:29:40.594208 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-e657dcf0-03be-4127-964e-5b79cf0de0e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:40.629414 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f639568-14cc-4eb6-8738-6d56a20ec55f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:40.631125 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f639568-14cc-4eb6-8738-6d56a20ec55f service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:40.641127 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 953/1936] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:29:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:29:40.641960 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f639568-14cc-4eb6-8738-6d56a20ec55f service neutron] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:40.652031 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f639568-14cc-4eb6-8738-6d56a20ec55f service neutron] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:40.656864 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4351592d-e9cc-4eec-9664-c260d1768d3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:40.657584 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4351592d-e9cc-4eec-9664-c260d1768d3b admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:40.657918 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4351592d-e9cc-4eec-9664-c260d1768d3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:40.658168 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4351592d-e9cc-4eec-9664-c260d1768d3b admin admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:40.658820 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4351592d-e9cc-4eec-9664-c260d1768d3b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:29:40.659155 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4351592d-e9cc-4eec-9664-c260d1768d3b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:40.660910 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4351592d-e9cc-4eec-9664-c260d1768d3b admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:40.673472 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 954/1937] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Sep 13 15:29:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:29:40.674363 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4351592d-e9cc-4eec-9664-c260d1768d3b admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:40.676185 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 984/1938] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:29:40 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:29:40.676981 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e657dcf0-03be-4127-964e-5b79cf0de0e9 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:40.679719 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-4351592d-e9cc-4eec-9664-c260d1768d3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:40.689161 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e657dcf0-03be-4127-964e-5b79cf0de0e9 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:40.696506 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474f04d3-9ff7-4dfa-aa9a-636d6e3ee922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:40.696946 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4351592d-e9cc-4eec-9664-c260d1768d3b admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:40.697128 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474f04d3-9ff7-4dfa-aa9a-636d6e3ee922 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:40.697409 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474f04d3-9ff7-4dfa-aa9a-636d6e3ee922 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:40.698063 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474f04d3-9ff7-4dfa-aa9a-636d6e3ee922 admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:40.698744 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474f04d3-9ff7-4dfa-aa9a-636d6e3ee922 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:40.700908 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474f04d3-9ff7-4dfa-aa9a-636d6e3ee922 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:40.703147 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a4ae13-3e37-49d7-aa60-ff49b720ba9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:40.703769 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a4ae13-3e37-49d7-aa60-ff49b720ba9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:40.704055 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a4ae13-3e37-49d7-aa60-ff49b720ba9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:40.704383 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a4ae13-3e37-49d7-aa60-ff49b720ba9a admin admin] PATH_INFO: `/v3/users/2328bb08ab7e4651aa0676004a5ebeca` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:40.705566 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a4ae13-3e37-49d7-aa60-ff49b720ba9a admin admin] RBAC: Authorizing `identity:delete_user(user_id=2328bb08ab7e4651aa0676004a5ebeca)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:40.709949 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a4ae13-3e37-49d7-aa60-ff49b720ba9a admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:40.753094 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 985/1939] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 13 15:29:40 2022] POST /identity/v3/projects => generated 387 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:29:40.755001 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474f04d3-9ff7-4dfa-aa9a-636d6e3ee922 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:40.781478 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-e1a4ae13-3e37-49d7-aa60-ff49b720ba9a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2328bb08ab7e4651aa0676004a5ebeca'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:40.782359 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-e1a4ae13-3e37-49d7-aa60-ff49b720ba9a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2328bb08ab7e4651aa0676004a5ebeca'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:40.783267 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-e1a4ae13-3e37-49d7-aa60-ff49b720ba9a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2328bb08ab7e4651aa0676004a5ebeca'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:40.792378 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-e1a4ae13-3e37-49d7-aa60-ff49b720ba9a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2328bb08ab7e4651aa0676004a5ebeca'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:40.810249 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-e1a4ae13-3e37-49d7-aa60-ff49b720ba9a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2328bb08ab7e4651aa0676004a5ebeca'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:40.843209 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 955/1940] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 13 15:29:40 2022] DELETE /identity/v3/users/2328bb08ab7e4651aa0676004a5ebeca => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:29:40.846594 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a4ae13-3e37-49d7-aa60-ff49b720ba9a admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:40.849319 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-e1a4ae13-3e37-49d7-aa60-ff49b720ba9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:40.866095 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474f04d3-9ff7-4dfa-aa9a-636d6e3ee922 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:40.950557 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:29:40.998763 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a4ae13-3e37-49d7-aa60-ff49b720ba9a admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:41.010547 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aa26da-0c9c-40ea-b208-26450e3a26db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:41.011210 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aa26da-0c9c-40ea-b208-26450e3a26db admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:41.011496 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aa26da-0c9c-40ea-b208-26450e3a26db admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:41.011772 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aa26da-0c9c-40ea-b208-26450e3a26db admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:41.012448 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01aa26da-0c9c-40ea-b208-26450e3a26db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:41.016155 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01aa26da-0c9c-40ea-b208-26450e3a26db admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:41.041063 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58895dc1-2e8d-4c51-a6cc-6aadd8ab1cff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:41.042369 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58895dc1-2e8d-4c51-a6cc-6aadd8ab1cff admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:41.042921 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58895dc1-2e8d-4c51-a6cc-6aadd8ab1cff admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:41.043059 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58895dc1-2e8d-4c51-a6cc-6aadd8ab1cff admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:41.043863 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58895dc1-2e8d-4c51-a6cc-6aadd8ab1cff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:41.046350 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58895dc1-2e8d-4c51-a6cc-6aadd8ab1cff admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:41.051596 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:29:41.066923 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 956/1941] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 13 15:29:40 2022] POST /identity/v3/users => generated 300 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:29:41.069148 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ced3938-cb36-43c4-8e4b-03d0104be192 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:41.069494 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ced3938-cb36-43c4-8e4b-03d0104be192 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:41.070075 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ced3938-cb36-43c4-8e4b-03d0104be192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:41.102741 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 986/1942] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 13 15:29:40 2022] POST /identity/v3/projects => generated 385 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:29:41.103943 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58895dc1-2e8d-4c51-a6cc-6aadd8ab1cff admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:41.106491 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-58895dc1-2e8d-4c51-a6cc-6aadd8ab1cff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:41.108376 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-2ced3938-cb36-43c4-8e4b-03d0104be192 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:29:41.109600 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-2ced3938-cb36-43c4-8e4b-03d0104be192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:41.198120 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58895dc1-2e8d-4c51-a6cc-6aadd8ab1cff admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:41.203387 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41ae6dc-674f-4c19-a618-547dfa6527a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:41.204037 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41ae6dc-674f-4c19-a618-547dfa6527a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:41.204324 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41ae6dc-674f-4c19-a618-547dfa6527a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:41.204605 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41ae6dc-674f-4c19-a618-547dfa6527a5 admin admin] PATH_INFO: `/v3/projects/6252d13df0264d40a8178fbb4da85930` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:41.205786 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41ae6dc-674f-4c19-a618-547dfa6527a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6252d13df0264d40a8178fbb4da85930)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:41.208085 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 957/1943] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:29:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:29:41.208224 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41ae6dc-674f-4c19-a618-547dfa6527a5 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:41.209674 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ced3938-cb36-43c4-8e4b-03d0104be192 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:41.230457 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ced3938-cb36-43c4-8e4b-03d0104be192 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:41.249086 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3603074d-b64f-4e26-8791-99bb410c0000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:41.250002 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3603074d-b64f-4e26-8791-99bb410c0000 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:41.250350 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3603074d-b64f-4e26-8791-99bb410c0000 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:41.255388 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3603074d-b64f-4e26-8791-99bb410c0000 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:41.256732 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3603074d-b64f-4e26-8791-99bb410c0000 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:41.261309 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3603074d-b64f-4e26-8791-99bb410c0000 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:41.281327 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 958/1944] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:29:41 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 15:29:41.282220 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3603074d-b64f-4e26-8791-99bb410c0000 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:41.291816 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-3603074d-b64f-4e26-8791-99bb410c0000 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:41.319900 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3603074d-b64f-4e26-8791-99bb410c0000 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:41.336774 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-d41ae6dc-674f-4c19-a618-547dfa6527a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6252d13df0264d40a8178fbb4da85930', 'request_id': 'req-d41ae6dc-674f-4c19-a618-547dfa6527a5'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:41.356553 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-d41ae6dc-674f-4c19-a618-547dfa6527a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6252d13df0264d40a8178fbb4da85930', 'request_id': 'req-d41ae6dc-674f-4c19-a618-547dfa6527a5'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:41.376637 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-d41ae6dc-674f-4c19-a618-547dfa6527a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6252d13df0264d40a8178fbb4da85930', 'request_id': 'req-d41ae6dc-674f-4c19-a618-547dfa6527a5'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:41.402094 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-d41ae6dc-674f-4c19-a618-547dfa6527a5 admin admin] The token cache is being invalidate because project 6252d13df0264d40a8178fbb4da85930 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 15:29:41.403873 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-d41ae6dc-674f-4c19-a618-547dfa6527a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:41.404860 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-d41ae6dc-674f-4c19-a618-547dfa6527a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:41.409330 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 987/1945] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 13 15:29:41 2022] DELETE /identity/v3/projects/6252d13df0264d40a8178fbb4da85930 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:29:41.411034 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41ae6dc-674f-4c19-a618-547dfa6527a5 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:41.415034 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-d41ae6dc-674f-4c19-a618-547dfa6527a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:41.453306 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adacd6f7-5553-401e-aaf4-36573f42cb23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:41.454128 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adacd6f7-5553-401e-aaf4-36573f42cb23 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:41.454431 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adacd6f7-5553-401e-aaf4-36573f42cb23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:41.454869 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adacd6f7-5553-401e-aaf4-36573f42cb23 admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:41.456396 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adacd6f7-5553-401e-aaf4-36573f42cb23 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:41.459380 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adacd6f7-5553-401e-aaf4-36573f42cb23 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:41.489956 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 959/1946] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 13 15:29:41 2022] POST /identity/v3/users => generated 293 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:29:41.489956 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adacd6f7-5553-401e-aaf4-36573f42cb23 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:41.491993 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-adacd6f7-5553-401e-aaf4-36573f42cb23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:41.496758 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:29:41.502195 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41ae6dc-674f-4c19-a618-547dfa6527a5 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:41.508082 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d408e485-03fb-4b18-882d-809350429f7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41675154bbba47388040966f75d84c3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:41.508448 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adacd6f7-5553-401e-aaf4-36573f42cb23 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:41.508725 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d408e485-03fb-4b18-882d-809350429f7c service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:41.509509 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d408e485-03fb-4b18-882d-809350429f7c service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:41.509907 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d408e485-03fb-4b18-882d-809350429f7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:41.513067 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-d408e485-03fb-4b18-882d-809350429f7c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:41.516157 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c4087f-968a-4991-8d3e-56a32de87963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:41.516960 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c4087f-968a-4991-8d3e-56a32de87963 admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:41.517254 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c4087f-968a-4991-8d3e-56a32de87963 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:41.517631 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c4087f-968a-4991-8d3e-56a32de87963 admin admin] PATH_INFO: `/v3/projects/96ce6bf3df8b4c2eaf2ad07e93751425/users/57db7a06ecc7448c810824d122b85ad6/roles/f34412ad29f1478cba775b033129f71f` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:41.528811 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d408e485-03fb-4b18-882d-809350429f7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:41.530423 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d408e485-03fb-4b18-882d-809350429f7c service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:41.535876 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c4087f-968a-4991-8d3e-56a32de87963 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96ce6bf3df8b4c2eaf2ad07e93751425, user_id=57db7a06ecc7448c810824d122b85ad6, role_id=f34412ad29f1478cba775b033129f71f)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:41.539041 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c4087f-968a-4991-8d3e-56a32de87963 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:41.545335 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 988/1947] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:29:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:29:41.557988 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d408e485-03fb-4b18-882d-809350429f7c service neutron] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:41.559102 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 960/1948] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 13 15:29:41 2022] PUT /identity/v3/projects/96ce6bf3df8b4c2eaf2ad07e93751425/users/57db7a06ecc7448c810824d122b85ad6/roles/f34412ad29f1478cba775b033129f71f => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:29:41.560388 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c4087f-968a-4991-8d3e-56a32de87963 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:41.574313 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-66c4087f-968a-4991-8d3e-56a32de87963 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:41.574813 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-d408e485-03fb-4b18-882d-809350429f7c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:41.597129 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d408e485-03fb-4b18-882d-809350429f7c service neutron] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:41.680412 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:29:41.691158 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c4087f-968a-4991-8d3e-56a32de87963 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:41.705156 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bc72da-8890-405b-bd6f-04c411fe72dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:41.706207 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bc72da-8890-405b-bd6f-04c411fe72dd admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:41.707336 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bc72da-8890-405b-bd6f-04c411fe72dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:41.708078 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bc72da-8890-405b-bd6f-04c411fe72dd admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:41.709296 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bc72da-8890-405b-bd6f-04c411fe72dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:41.711796 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bc72da-8890-405b-bd6f-04c411fe72dd admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:41.732582 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5730933d-a825-4b62-84d5-13c3bd3135f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:41.733244 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5730933d-a825-4b62-84d5-13c3bd3135f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:41.733534 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5730933d-a825-4b62-84d5-13c3bd3135f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:41.733997 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5730933d-a825-4b62-84d5-13c3bd3135f3 admin admin] PATH_INFO: `/v3/users/ef951fe9082b43b993dfa5d1e9dc08d7` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:41.734505 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 961/1949] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:29:41 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 15:29:41.735116 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5730933d-a825-4b62-84d5-13c3bd3135f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef951fe9082b43b993dfa5d1e9dc08d7)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:41.735893 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bc72da-8890-405b-bd6f-04c411fe72dd admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:41.737748 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5730933d-a825-4b62-84d5-13c3bd3135f3 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:41.749912 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bc72da-8890-405b-bd6f-04c411fe72dd admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:41.775992 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa2334f-c88b-4c34-81e6-a876b37494f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:41.778557 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa2334f-c88b-4c34-81e6-a876b37494f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:41.779723 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa2334f-c88b-4c34-81e6-a876b37494f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:41.781237 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa2334f-c88b-4c34-81e6-a876b37494f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:41.783656 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa2334f-c88b-4c34-81e6-a876b37494f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:41.787426 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa2334f-c88b-4c34-81e6-a876b37494f2 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:41.813653 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 962/1950] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:29:41 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 15:29:41.813653 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa2334f-c88b-4c34-81e6-a876b37494f2 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:41.830640 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa2334f-c88b-4c34-81e6-a876b37494f2 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:41.837039 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b9da49-0b42-4b5a-804e-a2607f35595a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:41.837841 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b9da49-0b42-4b5a-804e-a2607f35595a admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:41.838125 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b9da49-0b42-4b5a-804e-a2607f35595a admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:41.838456 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b9da49-0b42-4b5a-804e-a2607f35595a admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:41.839236 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b9da49-0b42-4b5a-804e-a2607f35595a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:41.841139 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b9da49-0b42-4b5a-804e-a2607f35595a admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:41.843276 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-5730933d-a825-4b62-84d5-13c3bd3135f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef951fe9082b43b993dfa5d1e9dc08d7'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:41.844715 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-5730933d-a825-4b62-84d5-13c3bd3135f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef951fe9082b43b993dfa5d1e9dc08d7'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:41.845850 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-5730933d-a825-4b62-84d5-13c3bd3135f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef951fe9082b43b993dfa5d1e9dc08d7'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:41.860645 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 963/1951] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:29:41 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 15:29:41.860645 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b9da49-0b42-4b5a-804e-a2607f35595a admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:41.861137 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-75b9da49-0b42-4b5a-804e-a2607f35595a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:41.877502 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-5730933d-a825-4b62-84d5-13c3bd3135f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef951fe9082b43b993dfa5d1e9dc08d7'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:41.887535 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b9da49-0b42-4b5a-804e-a2607f35595a admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:41.897334 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4682c5-ca2a-4996-9f7a-0abba737aab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:41.898178 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4682c5-ca2a-4996-9f7a-0abba737aab8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:41.898313 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4682c5-ca2a-4996-9f7a-0abba737aab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:41.899208 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4682c5-ca2a-4996-9f7a-0abba737aab8 admin admin] PATH_INFO: `/v3/projects/96ce6bf3df8b4c2eaf2ad07e93751425/users/57db7a06ecc7448c810824d122b85ad6/roles/f34412ad29f1478cba775b033129f71f` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:41.900221 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-5730933d-a825-4b62-84d5-13c3bd3135f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef951fe9082b43b993dfa5d1e9dc08d7'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:41.901984 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4682c5-ca2a-4996-9f7a-0abba737aab8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96ce6bf3df8b4c2eaf2ad07e93751425, user_id=57db7a06ecc7448c810824d122b85ad6, role_id=f34412ad29f1478cba775b033129f71f)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:41.906153 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4682c5-ca2a-4996-9f7a-0abba737aab8 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:41.928459 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 964/1952] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 13 15:29:41 2022] PUT /identity/v3/projects/96ce6bf3df8b4c2eaf2ad07e93751425/users/57db7a06ecc7448c810824d122b85ad6/roles/f34412ad29f1478cba775b033129f71f => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:29:41.929677 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4682c5-ca2a-4996-9f7a-0abba737aab8 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:41.932442 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-dd4682c5-ca2a-4996-9f7a-0abba737aab8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:41.953382 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 989/1953] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 13 15:29:41 2022] DELETE /identity/v3/users/ef951fe9082b43b993dfa5d1e9dc08d7 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:29:41.957395 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25552e9a-7a59-419b-a854-592bb83f3e69 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:41.957395 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25552e9a-7a59-419b-a854-592bb83f3e69 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:41.957395 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25552e9a-7a59-419b-a854-592bb83f3e69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:42.022187 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-25552e9a-7a59-419b-a854-592bb83f3e69 None None] MFA Rules not processed for user `57db7a06ecc7448c810824d122b85ad6`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:29:42.025675 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-25552e9a-7a59-419b-a854-592bb83f3e69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:42.078376 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4682c5-ca2a-4996-9f7a-0abba737aab8 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:42.126209 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:29:42.163760 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 990/1954] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:29:41 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:29:42.174894 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25552e9a-7a59-419b-a854-592bb83f3e69 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:42.178557 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-25552e9a-7a59-419b-a854-592bb83f3e69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:42.208255 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce73fe4e-dc32-4d1d-a297-51038edcf085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:42.208952 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce73fe4e-dc32-4d1d-a297-51038edcf085 admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:42.209289 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce73fe4e-dc32-4d1d-a297-51038edcf085 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:42.209521 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce73fe4e-dc32-4d1d-a297-51038edcf085 admin admin] PATH_INFO: `/v3/projects/6543f07c6b7041bd8151761658c14d4d/users/83b778b5a264472b92690b671d444a35/roles/3fae3d3a28e147d3b2bede2378ff79ae` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:42.245879 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce73fe4e-dc32-4d1d-a297-51038edcf085 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6543f07c6b7041bd8151761658c14d4d, user_id=83b778b5a264472b92690b671d444a35, role_id=3fae3d3a28e147d3b2bede2378ff79ae)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:42.249337 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce73fe4e-dc32-4d1d-a297-51038edcf085 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:42.282964 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 965/1955] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 13 15:29:41 2022] PUT /identity/v3/projects/6543f07c6b7041bd8151761658c14d4d/users/83b778b5a264472b92690b671d444a35/roles/3fae3d3a28e147d3b2bede2378ff79ae => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:29:42.283931 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce73fe4e-dc32-4d1d-a297-51038edcf085 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:42.293102 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-ce73fe4e-dc32-4d1d-a297-51038edcf085 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:42.390976 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25552e9a-7a59-419b-a854-592bb83f3e69 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:42.397627 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:29:42.400746 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce73fe4e-dc32-4d1d-a297-51038edcf085 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:42.413541 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0ab5ce-64e3-4e54-b82f-218d528c35d5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97acd23097d54bf7805c3cef60626ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:42.414223 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0ab5ce-64e3-4e54-b82f-218d528c35d5 service cinder] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:42.414507 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0ab5ce-64e3-4e54-b82f-218d528c35d5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:42.414783 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0ab5ce-64e3-4e54-b82f-218d528c35d5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:42.508962 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c63f54f-a10c-4c75-b164-93ecb2d63f0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:42.509571 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c63f54f-a10c-4c75-b164-93ecb2d63f0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:42.509914 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c63f54f-a10c-4c75-b164-93ecb2d63f0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:42.510195 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c63f54f-a10c-4c75-b164-93ecb2d63f0b admin admin] PATH_INFO: `/v3/projects/ee420aa5c2cd454a906bf257cb9ad72b` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:42.512016 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c63f54f-a10c-4c75-b164-93ecb2d63f0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee420aa5c2cd454a906bf257cb9ad72b)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:42.513042 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0ab5ce-64e3-4e54-b82f-218d528c35d5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:42.514041 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c63f54f-a10c-4c75-b164-93ecb2d63f0b admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:42.514520 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0ab5ce-64e3-4e54-b82f-218d528c35d5 service cinder] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:42.526632 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 966/1956] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:29:42 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:29:42.529913 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac43e79-9ecf-46ca-87da-719886693180 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:42.539956 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac43e79-9ecf-46ca-87da-719886693180 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:42.542078 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac43e79-9ecf-46ca-87da-719886693180 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:42.607259 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-6c63f54f-a10c-4c75-b164-93ecb2d63f0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee420aa5c2cd454a906bf257cb9ad72b', 'request_id': 'req-6c63f54f-a10c-4c75-b164-93ecb2d63f0b'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:42.627596 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-6c63f54f-a10c-4c75-b164-93ecb2d63f0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee420aa5c2cd454a906bf257cb9ad72b', 'request_id': 'req-6c63f54f-a10c-4c75-b164-93ecb2d63f0b'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:42.641088 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-cac43e79-9ecf-46ca-87da-719886693180 None None] MFA Rules not processed for user `83b778b5a264472b92690b671d444a35`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:29:42.643098 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-cac43e79-9ecf-46ca-87da-719886693180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:42.643475 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-6c63f54f-a10c-4c75-b164-93ecb2d63f0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee420aa5c2cd454a906bf257cb9ad72b', 'request_id': 'req-6c63f54f-a10c-4c75-b164-93ecb2d63f0b'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:42.674081 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-6c63f54f-a10c-4c75-b164-93ecb2d63f0b admin admin] The token cache is being invalidate because project ee420aa5c2cd454a906bf257cb9ad72b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 15:29:42.674081 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-6c63f54f-a10c-4c75-b164-93ecb2d63f0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:42.677075 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-6c63f54f-a10c-4c75-b164-93ecb2d63f0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:42.678881 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 991/1957] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 13 15:29:42 2022] DELETE /identity/v3/projects/ee420aa5c2cd454a906bf257cb9ad72b => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:29:42.679662 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c63f54f-a10c-4c75-b164-93ecb2d63f0b admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:42.682130 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-6c63f54f-a10c-4c75-b164-93ecb2d63f0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:42.783852 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 967/1958] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:29:42 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:29:42.786227 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac43e79-9ecf-46ca-87da-719886693180 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:42.787956 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-cac43e79-9ecf-46ca-87da-719886693180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:42.792622 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:29:42.853457 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c63f54f-a10c-4c75-b164-93ecb2d63f0b admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:42.860575 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d005850-f2bb-4b1a-ab29-fe5551a957fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:42.861235 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d005850-f2bb-4b1a-ab29-fe5551a957fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:42.861522 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d005850-f2bb-4b1a-ab29-fe5551a957fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:42.862022 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d005850-f2bb-4b1a-ab29-fe5551a957fe admin admin] PATH_INFO: `/v3/projects/0f6765ac4f7a4e22bdf187e6d724fda4` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:42.864784 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d005850-f2bb-4b1a-ab29-fe5551a957fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f6765ac4f7a4e22bdf187e6d724fda4)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:42.867378 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d005850-f2bb-4b1a-ab29-fe5551a957fe admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:42.902428 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac43e79-9ecf-46ca-87da-719886693180 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:42.910023 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742a8912-ff08-46fd-8581-a3691b89d7c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:42.911129 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742a8912-ff08-46fd-8581-a3691b89d7c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:42.911591 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742a8912-ff08-46fd-8581-a3691b89d7c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:42.912845 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742a8912-ff08-46fd-8581-a3691b89d7c7 admin admin] PATH_INFO: `/v3/users/d79c5f6b93ad4e5a8affb97f37aa8e81` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:42.914650 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742a8912-ff08-46fd-8581-a3691b89d7c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d79c5f6b93ad4e5a8affb97f37aa8e81)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:42.917230 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742a8912-ff08-46fd-8581-a3691b89d7c7 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:42.964151 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:29:42.978769 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-3d005850-f2bb-4b1a-ab29-fe5551a957fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f6765ac4f7a4e22bdf187e6d724fda4', 'request_id': 'req-3d005850-f2bb-4b1a-ab29-fe5551a957fe'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:42.990924 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-3d005850-f2bb-4b1a-ab29-fe5551a957fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f6765ac4f7a4e22bdf187e6d724fda4', 'request_id': 'req-3d005850-f2bb-4b1a-ab29-fe5551a957fe'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:42.998492 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-742a8912-ff08-46fd-8581-a3691b89d7c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd79c5f6b93ad4e5a8affb97f37aa8e81'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:42.999282 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-742a8912-ff08-46fd-8581-a3691b89d7c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd79c5f6b93ad4e5a8affb97f37aa8e81'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:43.000112 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-742a8912-ff08-46fd-8581-a3691b89d7c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd79c5f6b93ad4e5a8affb97f37aa8e81'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:43.004083 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-3d005850-f2bb-4b1a-ab29-fe5551a957fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f6765ac4f7a4e22bdf187e6d724fda4', 'request_id': 'req-3d005850-f2bb-4b1a-ab29-fe5551a957fe'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:43.009464 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-742a8912-ff08-46fd-8581-a3691b89d7c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd79c5f6b93ad4e5a8affb97f37aa8e81'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:43.027094 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-3d005850-f2bb-4b1a-ab29-fe5551a957fe admin admin] The token cache is being invalidate because project 0f6765ac4f7a4e22bdf187e6d724fda4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 15:29:43.027764 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-742a8912-ff08-46fd-8581-a3691b89d7c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd79c5f6b93ad4e5a8affb97f37aa8e81'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:43.028025 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-3d005850-f2bb-4b1a-ab29-fe5551a957fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:43.029086 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-3d005850-f2bb-4b1a-ab29-fe5551a957fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:43.031610 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 992/1959] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 13 15:29:42 2022] DELETE /identity/v3/projects/0f6765ac4f7a4e22bdf187e6d724fda4 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:29:43.032791 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d005850-f2bb-4b1a-ab29-fe5551a957fe admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:43.044633 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-3d005850-f2bb-4b1a-ab29-fe5551a957fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:43.058848 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 968/1960] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 13 15:29:42 2022] DELETE /identity/v3/users/d79c5f6b93ad4e5a8affb97f37aa8e81 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:29:43.062948 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c49cb4-6b41-4cf4-8d33-0cfaf2faa7f3 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:43.063240 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c49cb4-6b41-4cf4-8d33-0cfaf2faa7f3 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:43.063542 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c49cb4-6b41-4cf4-8d33-0cfaf2faa7f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:43.103807 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-b9c49cb4-6b41-4cf4-8d33-0cfaf2faa7f3 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:29:43.109010 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-b9c49cb4-6b41-4cf4-8d33-0cfaf2faa7f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:43.199666 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d005850-f2bb-4b1a-ab29-fe5551a957fe admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:43.243594 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 969/1961] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:29:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:29:43.245367 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfc1c89-30ae-4679-bf3b-7b75e6c007c1 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:43.246033 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfc1c89-30ae-4679-bf3b-7b75e6c007c1 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:43.246480 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfc1c89-30ae-4679-bf3b-7b75e6c007c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:43.275658 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-4dfc1c89-30ae-4679-bf3b-7b75e6c007c1 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:29:43.277229 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-4dfc1c89-30ae-4679-bf3b-7b75e6c007c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:43.292990 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 970/1962] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:29:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:29:43.298440 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfc1c89-30ae-4679-bf3b-7b75e6c007c1 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:43.343492 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfc1c89-30ae-4679-bf3b-7b75e6c007c1 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:43.345671 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a766cd0f-99ea-4dfa-be44-03bd46b4aeeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:43.346612 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a766cd0f-99ea-4dfa-be44-03bd46b4aeeb admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:43.349205 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a766cd0f-99ea-4dfa-be44-03bd46b4aeeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:43.349497 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a766cd0f-99ea-4dfa-be44-03bd46b4aeeb admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:43.350284 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a766cd0f-99ea-4dfa-be44-03bd46b4aeeb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:43.352605 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a766cd0f-99ea-4dfa-be44-03bd46b4aeeb admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:43.353298 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa86779-c768-4bdb-8f7b-870fe06cda06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:43.354155 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa86779-c768-4bdb-8f7b-870fe06cda06 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:43.354359 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa86779-c768-4bdb-8f7b-870fe06cda06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:43.354560 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa86779-c768-4bdb-8f7b-870fe06cda06 admin admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:43.355237 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa86779-c768-4bdb-8f7b-870fe06cda06 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:29:43.355939 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa86779-c768-4bdb-8f7b-870fe06cda06 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:43.357796 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa86779-c768-4bdb-8f7b-870fe06cda06 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:43.379076 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 971/1963] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Sep 13 15:29:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:29:43.380018 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:29:43.380981 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa86779-c768-4bdb-8f7b-870fe06cda06 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:43.394995 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa86779-c768-4bdb-8f7b-870fe06cda06 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:43.404012 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d80b638-1a0a-49e2-b2b8-54f3009d3299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:43.404012 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d80b638-1a0a-49e2-b2b8-54f3009d3299 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:43.405150 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d80b638-1a0a-49e2-b2b8-54f3009d3299 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:43.405150 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d80b638-1a0a-49e2-b2b8-54f3009d3299 admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:43.405532 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d80b638-1a0a-49e2-b2b8-54f3009d3299 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:43.406023 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 993/1964] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 13 15:29:43 2022] POST /identity/v3/projects => generated 387 bytes in 373 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:29:43.407122 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a766cd0f-99ea-4dfa-be44-03bd46b4aeeb admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:43.410713 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d80b638-1a0a-49e2-b2b8-54f3009d3299 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:43.489189 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 972/1965] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 13 15:29:43 2022] POST /identity/v3/projects => generated 369 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:29:43.494490 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d80b638-1a0a-49e2-b2b8-54f3009d3299 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:43.506048 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a766cd0f-99ea-4dfa-be44-03bd46b4aeeb admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:43.582435 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a261cf78-efc8-49be-835f-8a366942883c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:43.583314 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a261cf78-efc8-49be-835f-8a366942883c admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:43.583665 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a261cf78-efc8-49be-835f-8a366942883c admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:43.584010 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a261cf78-efc8-49be-835f-8a366942883c admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:43.585251 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a261cf78-efc8-49be-835f-8a366942883c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:43.587163 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a261cf78-efc8-49be-835f-8a366942883c admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:43.634399 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 994/1966] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 13 15:29:43 2022] POST /identity/v3/users => generated 294 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:29:43.635415 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a261cf78-efc8-49be-835f-8a366942883c admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:43.636977 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d80b638-1a0a-49e2-b2b8-54f3009d3299 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:43.645981 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3560728d-ce78-4422-8c7d-c3e7bd8f1205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:43.645981 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3560728d-ce78-4422-8c7d-c3e7bd8f1205 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:43.645981 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3560728d-ce78-4422-8c7d-c3e7bd8f1205 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:43.646308 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3560728d-ce78-4422-8c7d-c3e7bd8f1205 admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:43.646891 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a261cf78-efc8-49be-835f-8a366942883c admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:43.647006 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3560728d-ce78-4422-8c7d-c3e7bd8f1205 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:43.649437 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3560728d-ce78-4422-8c7d-c3e7bd8f1205 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:43.656834 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e49c6f-7faf-462c-a7de-b834791abe64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:43.656834 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e49c6f-7faf-462c-a7de-b834791abe64 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:43.656834 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e49c6f-7faf-462c-a7de-b834791abe64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:43.656834 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e49c6f-7faf-462c-a7de-b834791abe64 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:43.662301 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e49c6f-7faf-462c-a7de-b834791abe64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:43.662829 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:29:43.664942 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e49c6f-7faf-462c-a7de-b834791abe64 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:43.685948 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 995/1967] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:29:43 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 15:29:43.685948 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e49c6f-7faf-462c-a7de-b834791abe64 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:43.686256 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 973/1968] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 13 15:29:43 2022] POST /identity/v3/users => generated 285 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 15:29:43.687596 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3560728d-ce78-4422-8c7d-c3e7bd8f1205 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:43.687819 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-47e49c6f-7faf-462c-a7de-b834791abe64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:43.710373 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e49c6f-7faf-462c-a7de-b834791abe64 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:43.718947 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39040ede-3dfd-4682-b8c4-6e619b639554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:43.719613 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39040ede-3dfd-4682-b8c4-6e619b639554 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:43.719961 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39040ede-3dfd-4682-b8c4-6e619b639554 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:43.721621 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39040ede-3dfd-4682-b8c4-6e619b639554 admin admin] PATH_INFO: `/v3/users/97ebeda781ba43c7a14f39312eafcc90` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:43.722828 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39040ede-3dfd-4682-b8c4-6e619b639554 admin admin] RBAC: Authorizing `identity:delete_user(user_id=97ebeda781ba43c7a14f39312eafcc90)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:43.724793 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39040ede-3dfd-4682-b8c4-6e619b639554 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:43.742550 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3560728d-ce78-4422-8c7d-c3e7bd8f1205 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:43.748580 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7933e6e1-8b30-462f-b68c-fb9860e3ac7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:43.749070 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7933e6e1-8b30-462f-b68c-fb9860e3ac7e admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:43.749457 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7933e6e1-8b30-462f-b68c-fb9860e3ac7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:43.749637 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7933e6e1-8b30-462f-b68c-fb9860e3ac7e admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:43.750471 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7933e6e1-8b30-462f-b68c-fb9860e3ac7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:43.752521 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7933e6e1-8b30-462f-b68c-fb9860e3ac7e admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:43.764059 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 974/1969] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:29:43 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 15:29:43.769131 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7933e6e1-8b30-462f-b68c-fb9860e3ac7e admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:43.779930 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7933e6e1-8b30-462f-b68c-fb9860e3ac7e admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:43.786777 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed695519-264c-440b-8fcb-86fc2092efa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:43.788139 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed695519-264c-440b-8fcb-86fc2092efa4 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:43.788139 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed695519-264c-440b-8fcb-86fc2092efa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:43.788370 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed695519-264c-440b-8fcb-86fc2092efa4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:43.789028 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed695519-264c-440b-8fcb-86fc2092efa4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:43.790678 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed695519-264c-440b-8fcb-86fc2092efa4 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:43.818073 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-39040ede-3dfd-4682-b8c4-6e619b639554 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97ebeda781ba43c7a14f39312eafcc90'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:43.821866 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 975/1970] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:29:43 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 15:29:43.821866 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed695519-264c-440b-8fcb-86fc2092efa4 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:43.823593 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-39040ede-3dfd-4682-b8c4-6e619b639554 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97ebeda781ba43c7a14f39312eafcc90'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:43.824470 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-ed695519-264c-440b-8fcb-86fc2092efa4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:43.826441 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-39040ede-3dfd-4682-b8c4-6e619b639554 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97ebeda781ba43c7a14f39312eafcc90'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:43.846129 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-39040ede-3dfd-4682-b8c4-6e619b639554 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97ebeda781ba43c7a14f39312eafcc90'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:43.871986 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed695519-264c-440b-8fcb-86fc2092efa4 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:43.874768 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-39040ede-3dfd-4682-b8c4-6e619b639554 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97ebeda781ba43c7a14f39312eafcc90'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:43.879466 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=87,keystone:INSERT=4,keystone:DELETE=9 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:29:43.881364 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cf10d9-4778-4364-9aef-bbe531062c24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:43.882467 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cf10d9-4778-4364-9aef-bbe531062c24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:43.882609 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cf10d9-4778-4364-9aef-bbe531062c24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:43.883017 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cf10d9-4778-4364-9aef-bbe531062c24 admin admin] PATH_INFO: `/v3/projects/38dd819fa8d749f3af5410e0edabc7a2` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:43.884935 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cf10d9-4778-4364-9aef-bbe531062c24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=38dd819fa8d749f3af5410e0edabc7a2)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:43.888199 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cf10d9-4778-4364-9aef-bbe531062c24 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:43.919445 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 996/1971] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 13 15:29:43 2022] DELETE /identity/v3/users/97ebeda781ba43c7a14f39312eafcc90 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:29:43.921229 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39040ede-3dfd-4682-b8c4-6e619b639554 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:43.923685 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-39040ede-3dfd-4682-b8c4-6e619b639554 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:43.984921 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-33cf10d9-4778-4364-9aef-bbe531062c24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38dd819fa8d749f3af5410e0edabc7a2', 'request_id': 'req-33cf10d9-4778-4364-9aef-bbe531062c24'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:43.993808 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-33cf10d9-4778-4364-9aef-bbe531062c24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38dd819fa8d749f3af5410e0edabc7a2', 'request_id': 'req-33cf10d9-4778-4364-9aef-bbe531062c24'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:44.005158 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-33cf10d9-4778-4364-9aef-bbe531062c24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38dd819fa8d749f3af5410e0edabc7a2', 'request_id': 'req-33cf10d9-4778-4364-9aef-bbe531062c24'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:44.029775 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-33cf10d9-4778-4364-9aef-bbe531062c24 admin admin] The token cache is being invalidate because project 38dd819fa8d749f3af5410e0edabc7a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 15:29:44.033182 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-33cf10d9-4778-4364-9aef-bbe531062c24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:44.033362 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-33cf10d9-4778-4364-9aef-bbe531062c24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:44.036391 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 976/1972] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 13 15:29:43 2022] DELETE /identity/v3/projects/38dd819fa8d749f3af5410e0edabc7a2 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:29:44.037184 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cf10d9-4778-4364-9aef-bbe531062c24 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:44.038641 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-33cf10d9-4778-4364-9aef-bbe531062c24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:44.131802 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39040ede-3dfd-4682-b8c4-6e619b639554 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:44.163643 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cf10d9-4778-4364-9aef-bbe531062c24 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:44.172960 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae9e1c3-821e-4c29-a23d-8450d55cc3b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:44.173854 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae9e1c3-821e-4c29-a23d-8450d55cc3b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:44.174237 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae9e1c3-821e-4c29-a23d-8450d55cc3b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:44.174613 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae9e1c3-821e-4c29-a23d-8450d55cc3b1 admin admin] PATH_INFO: `/v3/projects/a281d192f635452f9725190279c26afd/users/6e05a2d6b2ec4d17a1ebec70497c3332/roles/3fae3d3a28e147d3b2bede2378ff79ae` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:44.194517 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae9e1c3-821e-4c29-a23d-8450d55cc3b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a281d192f635452f9725190279c26afd, user_id=6e05a2d6b2ec4d17a1ebec70497c3332, role_id=3fae3d3a28e147d3b2bede2378ff79ae)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:44.197823 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae9e1c3-821e-4c29-a23d-8450d55cc3b1 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:44.222761 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 977/1973] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 13 15:29:44 2022] PUT /identity/v3/projects/a281d192f635452f9725190279c26afd/users/6e05a2d6b2ec4d17a1ebec70497c3332/roles/3fae3d3a28e147d3b2bede2378ff79ae => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:29:44.235750 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f65caf3-36d4-4db2-8043-0215a62eeb98 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:44.236144 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f65caf3-36d4-4db2-8043-0215a62eeb98 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:44.236519 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f65caf3-36d4-4db2-8043-0215a62eeb98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:44.271852 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-5f65caf3-36d4-4db2-8043-0215a62eeb98 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:29:44.273913 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-5f65caf3-36d4-4db2-8043-0215a62eeb98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:44.274708 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c92cd3b-178c-47bd-afb4-48cbb7075e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:44.275559 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c92cd3b-178c-47bd-afb4-48cbb7075e60 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:44.275990 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c92cd3b-178c-47bd-afb4-48cbb7075e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:44.276391 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c92cd3b-178c-47bd-afb4-48cbb7075e60 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:44.278448 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c92cd3b-178c-47bd-afb4-48cbb7075e60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:44.281794 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c92cd3b-178c-47bd-afb4-48cbb7075e60 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:44.297231 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 997/1974] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:29:43 2022] GET /identity/v3/roles => generated 1420 bytes in 374 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 15:29:44.297231 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48708d04-752f-4fb2-9166-1948edd754ed None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:44.297231 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48708d04-752f-4fb2-9166-1948edd754ed None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:44.297231 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48708d04-752f-4fb2-9166-1948edd754ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:44.329961 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-48708d04-752f-4fb2-9166-1948edd754ed None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:29:44.332291 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-48708d04-752f-4fb2-9166-1948edd754ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:44.382328 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:INSERT=3,keystone:SELECT=90,keystone:DELETE=7 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:29:44.432664 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 998/1975] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:29:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:29:44.432664 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5e7e8d-b4ee-41da-a386-d0a29a51b2c7 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:44.432664 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5e7e8d-b4ee-41da-a386-d0a29a51b2c7 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:44.432664 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5e7e8d-b4ee-41da-a386-d0a29a51b2c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:44.462345 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 978/1976] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:29:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:29:44.463591 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f65caf3-36d4-4db2-8043-0215a62eeb98 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:44.466904 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-5f65caf3-36d4-4db2-8043-0215a62eeb98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:44.476816 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-8e5e7e8d-b4ee-41da-a386-d0a29a51b2c7 None None] MFA Rules not processed for user `6e05a2d6b2ec4d17a1ebec70497c3332`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:29:44.478149 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-8e5e7e8d-b4ee-41da-a386-d0a29a51b2c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:44.487492 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f65caf3-36d4-4db2-8043-0215a62eeb98 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:44.493118 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7971b09-d7e3-4dc1-a0e6-6700476a9695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:44.494276 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7971b09-d7e3-4dc1-a0e6-6700476a9695 admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:44.497193 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7971b09-d7e3-4dc1-a0e6-6700476a9695 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:44.497846 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7971b09-d7e3-4dc1-a0e6-6700476a9695 admin admin] PATH_INFO: `/v3/projects/71d7facad944461ab668a1cbf1e29477/users/076baae3dc0549678f5d19bc01804f21/roles/3fae3d3a28e147d3b2bede2378ff79ae` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:44.514856 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:DELETE=1,keystone:SELECT=99 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:29:44.515947 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7971b09-d7e3-4dc1-a0e6-6700476a9695 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71d7facad944461ab668a1cbf1e29477, user_id=076baae3dc0549678f5d19bc01804f21, role_id=3fae3d3a28e147d3b2bede2378ff79ae)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:44.519812 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7971b09-d7e3-4dc1-a0e6-6700476a9695 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:44.567000 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 979/1977] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 13 15:29:44 2022] PUT /identity/v3/projects/71d7facad944461ab668a1cbf1e29477/users/076baae3dc0549678f5d19bc01804f21/roles/3fae3d3a28e147d3b2bede2378ff79ae => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:29:44.569029 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c16b3a-222d-4dea-9cdc-d430fa98799c None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:44.569486 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c16b3a-222d-4dea-9cdc-d430fa98799c None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:44.569995 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c16b3a-222d-4dea-9cdc-d430fa98799c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:44.571546 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 999/1978] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:29:44 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:29:44.572675 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5e7e8d-b4ee-41da-a386-d0a29a51b2c7 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:44.574489 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-8e5e7e8d-b4ee-41da-a386-d0a29a51b2c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:44.598365 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-c1c16b3a-222d-4dea-9cdc-d430fa98799c None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:29:44.599890 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-c1c16b3a-222d-4dea-9cdc-d430fa98799c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:44.661753 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5e7e8d-b4ee-41da-a386-d0a29a51b2c7 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:44.694286 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 980/1979] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:29:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:29:44.699450 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c510234-8a49-45de-83db-6a1c025260fe None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:44.699878 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c510234-8a49-45de-83db-6a1c025260fe None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:44.700341 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c510234-8a49-45de-83db-6a1c025260fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:44.730194 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7696b87d-3ec7-44b7-9096-b376957e5bd7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41675154bbba47388040966f75d84c3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:44.730975 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7696b87d-3ec7-44b7-9096-b376957e5bd7 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:44.731262 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7696b87d-3ec7-44b7-9096-b376957e5bd7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:44.731540 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7696b87d-3ec7-44b7-9096-b376957e5bd7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:44.743154 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7696b87d-3ec7-44b7-9096-b376957e5bd7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:44.745049 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7696b87d-3ec7-44b7-9096-b376957e5bd7 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:44.748225 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-7c510234-8a49-45de-83db-6a1c025260fe None None] MFA Rules not processed for user `076baae3dc0549678f5d19bc01804f21`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:29:44.749461 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-7c510234-8a49-45de-83db-6a1c025260fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:44.756166 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1000/1980] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:29:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:29:44.757225 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7696b87d-3ec7-44b7-9096-b376957e5bd7 service neutron] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:44.768311 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7696b87d-3ec7-44b7-9096-b376957e5bd7 service neutron] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:44.777881 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfa2106-8ff0-4a9b-9463-a145aab2cd2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:44.780157 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfa2106-8ff0-4a9b-9463-a145aab2cd2d admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:44.781008 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfa2106-8ff0-4a9b-9463-a145aab2cd2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:44.787462 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfa2106-8ff0-4a9b-9463-a145aab2cd2d admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:44.788871 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfa2106-8ff0-4a9b-9463-a145aab2cd2d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:44.792080 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfa2106-8ff0-4a9b-9463-a145aab2cd2d admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:44.868711 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1001/1981] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 13 15:29:44 2022] POST /identity/v3/projects => generated 385 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:29:44.871960 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfa2106-8ff0-4a9b-9463-a145aab2cd2d admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:44.895319 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 981/1982] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:29:44 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:29:44.897004 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c510234-8a49-45de-83db-6a1c025260fe None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:44.914209 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c510234-8a49-45de-83db-6a1c025260fe None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:44.978682 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:29:44.997419 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd7799e-1961-4908-840d-b483b9320bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:44.998456 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd7799e-1961-4908-840d-b483b9320bda admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:44.998850 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd7799e-1961-4908-840d-b483b9320bda admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:44.999317 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd7799e-1961-4908-840d-b483b9320bda admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:45.000132 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd7799e-1961-4908-840d-b483b9320bda admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:45.004035 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd7799e-1961-4908-840d-b483b9320bda admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:45.010148 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfa2106-8ff0-4a9b-9463-a145aab2cd2d admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:45.016522 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe4b099-ab27-44a0-84ef-b1ad2e1524fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:45.017156 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe4b099-ab27-44a0-84ef-b1ad2e1524fe admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:45.017439 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe4b099-ab27-44a0-84ef-b1ad2e1524fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:45.017735 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe4b099-ab27-44a0-84ef-b1ad2e1524fe admin admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:45.018434 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe4b099-ab27-44a0-84ef-b1ad2e1524fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:29:45.018802 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe4b099-ab27-44a0-84ef-b1ad2e1524fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:45.020823 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe4b099-ab27-44a0-84ef-b1ad2e1524fe admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:45.032010 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:29:45.037490 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 982/1983] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 13 15:29:44 2022] POST /identity/v3/users => generated 299 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:29:45.038400 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd7799e-1961-4908-840d-b483b9320bda admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:45.051937 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd7799e-1961-4908-840d-b483b9320bda admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:45.056759 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1002/1984] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Sep 13 15:29:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:29:45.057667 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72623c22-0c79-4745-a6d7-653b23e154b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:45.058185 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72623c22-0c79-4745-a6d7-653b23e154b8 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:45.058465 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72623c22-0c79-4745-a6d7-653b23e154b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:45.058803 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72623c22-0c79-4745-a6d7-653b23e154b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:45.059509 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72623c22-0c79-4745-a6d7-653b23e154b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:45.059989 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe4b099-ab27-44a0-84ef-b1ad2e1524fe admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:45.061574 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72623c22-0c79-4745-a6d7-653b23e154b8 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:45.073534 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe4b099-ab27-44a0-84ef-b1ad2e1524fe admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:45.083312 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d490c1-b2bc-4988-ab47-4239c3ede7a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:45.084027 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d490c1-b2bc-4988-ab47-4239c3ede7a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:45.084315 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d490c1-b2bc-4988-ab47-4239c3ede7a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:45.084603 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d490c1-b2bc-4988-ab47-4239c3ede7a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:45.088925 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d490c1-b2bc-4988-ab47-4239c3ede7a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:45.088925 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d490c1-b2bc-4988-ab47-4239c3ede7a0 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:45.100683 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1003/1985] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:29:45 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 15:29:45.104752 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d490c1-b2bc-4988-ab47-4239c3ede7a0 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:45.106934 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 983/1986] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 13 15:29:45 2022] POST /identity/v3/projects => generated 369 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:29:45.108138 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72623c22-0c79-4745-a6d7-653b23e154b8 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:45.116660 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d490c1-b2bc-4988-ab47-4239c3ede7a0 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:45.192178 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66adda0c-d549-47fd-9eb1-2873e2402197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:45.192940 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66adda0c-d549-47fd-9eb1-2873e2402197 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:45.193135 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66adda0c-d549-47fd-9eb1-2873e2402197 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:45.193405 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66adda0c-d549-47fd-9eb1-2873e2402197 admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:45.194091 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66adda0c-d549-47fd-9eb1-2873e2402197 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:45.196390 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66adda0c-d549-47fd-9eb1-2873e2402197 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:45.196820 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72623c22-0c79-4745-a6d7-653b23e154b8 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:45.202586 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dddde83-11a0-4b7b-98db-2adf0bee4035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:45.203453 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dddde83-11a0-4b7b-98db-2adf0bee4035 admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:45.203838 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dddde83-11a0-4b7b-98db-2adf0bee4035 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:45.204209 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dddde83-11a0-4b7b-98db-2adf0bee4035 admin admin] PATH_INFO: `/v3/projects/429e0eafd10e4c4db79106d97b5e0eb9/users/2905928f5503405e83bf552aafa3de6b/roles/f34412ad29f1478cba775b033129f71f` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:45.221070 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dddde83-11a0-4b7b-98db-2adf0bee4035 admin admin] RBAC: Authorizing `identity:create_grant(project_id=429e0eafd10e4c4db79106d97b5e0eb9, user_id=2905928f5503405e83bf552aafa3de6b, role_id=f34412ad29f1478cba775b033129f71f)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:45.224960 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dddde83-11a0-4b7b-98db-2adf0bee4035 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:45.227588 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1004/1987] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 13 15:29:45 2022] POST /identity/v3/projects => generated 371 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:29:45.228405 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66adda0c-d549-47fd-9eb1-2873e2402197 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:45.240915 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 984/1988] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 13 15:29:45 2022] PUT /identity/v3/projects/429e0eafd10e4c4db79106d97b5e0eb9/users/2905928f5503405e83bf552aafa3de6b/roles/f34412ad29f1478cba775b033129f71f => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:29:45.241928 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dddde83-11a0-4b7b-98db-2adf0bee4035 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:45.244009 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-6dddde83-11a0-4b7b-98db-2adf0bee4035 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:45.310642 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66adda0c-d549-47fd-9eb1-2873e2402197 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:45.324947 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dddde83-11a0-4b7b-98db-2adf0bee4035 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:45.330007 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba9d40c-99eb-4106-a4cd-cb5c3574f4a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:45.334074 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba9d40c-99eb-4106-a4cd-cb5c3574f4a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:45.334074 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba9d40c-99eb-4106-a4cd-cb5c3574f4a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:45.334074 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba9d40c-99eb-4106-a4cd-cb5c3574f4a9 admin admin] PATH_INFO: `/v3/projects/dd91663d35ab461bb22ba10716dfd91c` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:45.334074 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba9d40c-99eb-4106-a4cd-cb5c3574f4a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd91663d35ab461bb22ba10716dfd91c)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:45.334811 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba9d40c-99eb-4106-a4cd-cb5c3574f4a9 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:45.386570 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:29:45.386893 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba25fac-61d0-4052-9d44-c12efd4ef2ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:45.387710 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba25fac-61d0-4052-9d44-c12efd4ef2ac admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:45.387850 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba25fac-61d0-4052-9d44-c12efd4ef2ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:45.388236 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba25fac-61d0-4052-9d44-c12efd4ef2ac admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:45.389038 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba25fac-61d0-4052-9d44-c12efd4ef2ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:45.390981 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba25fac-61d0-4052-9d44-c12efd4ef2ac admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:45.399464 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-0ba9d40c-99eb-4106-a4cd-cb5c3574f4a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd91663d35ab461bb22ba10716dfd91c', 'request_id': 'req-0ba9d40c-99eb-4106-a4cd-cb5c3574f4a9'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:45.407052 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-0ba9d40c-99eb-4106-a4cd-cb5c3574f4a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd91663d35ab461bb22ba10716dfd91c', 'request_id': 'req-0ba9d40c-99eb-4106-a4cd-cb5c3574f4a9'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:45.414959 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-0ba9d40c-99eb-4106-a4cd-cb5c3574f4a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd91663d35ab461bb22ba10716dfd91c', 'request_id': 'req-0ba9d40c-99eb-4106-a4cd-cb5c3574f4a9'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:45.420183 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1005/1989] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 13 15:29:45 2022] POST /identity/v3/users => generated 291 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:29:45.420183 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba25fac-61d0-4052-9d44-c12efd4ef2ac admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:45.432500 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba25fac-61d0-4052-9d44-c12efd4ef2ac admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:45.434656 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-0ba9d40c-99eb-4106-a4cd-cb5c3574f4a9 admin admin] The token cache is being invalidate because project dd91663d35ab461bb22ba10716dfd91c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 15:29:45.435073 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-0ba9d40c-99eb-4106-a4cd-cb5c3574f4a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:45.435867 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-0ba9d40c-99eb-4106-a4cd-cb5c3574f4a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:45.438612 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 985/1990] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 13 15:29:45 2022] DELETE /identity/v3/projects/dd91663d35ab461bb22ba10716dfd91c => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:29:45.439579 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba9d40c-99eb-4106-a4cd-cb5c3574f4a9 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:45.441572 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-0ba9d40c-99eb-4106-a4cd-cb5c3574f4a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:45.442605 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:29:45.518461 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fa5759-f08f-4827-a244-ce708db46a33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:45.520151 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fa5759-f08f-4827-a244-ce708db46a33 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:45.520666 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fa5759-f08f-4827-a244-ce708db46a33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:45.521260 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fa5759-f08f-4827-a244-ce708db46a33 admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:45.522197 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fa5759-f08f-4827-a244-ce708db46a33 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:45.524765 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fa5759-f08f-4827-a244-ce708db46a33 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:45.532631 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba9d40c-99eb-4106-a4cd-cb5c3574f4a9 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:45.539593 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d79348-1a1e-4225-b7f3-66aa539eacac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:45.540562 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d79348-1a1e-4225-b7f3-66aa539eacac admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:45.540858 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d79348-1a1e-4225-b7f3-66aa539eacac admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:45.541208 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d79348-1a1e-4225-b7f3-66aa539eacac admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:45.541965 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d79348-1a1e-4225-b7f3-66aa539eacac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:45.544136 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d79348-1a1e-4225-b7f3-66aa539eacac admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:45.556774 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1006/1991] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 13 15:29:45 2022] POST /identity/v3/users => generated 286 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:29:45.557978 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fa5759-f08f-4827-a244-ce708db46a33 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:45.559993 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-75fa5759-f08f-4827-a244-ce708db46a33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:45.560486 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 986/1992] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:29:45 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 15:29:45.561355 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d79348-1a1e-4225-b7f3-66aa539eacac admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:45.564119 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-c7d79348-1a1e-4225-b7f3-66aa539eacac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:45.576388 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fa5759-f08f-4827-a244-ce708db46a33 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:45.582194 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d79348-1a1e-4225-b7f3-66aa539eacac admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:45.586230 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecbeb77-0404-4c99-9367-bd1005135f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:45.587087 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecbeb77-0404-4c99-9367-bd1005135f98 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:45.587629 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecbeb77-0404-4c99-9367-bd1005135f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:45.588006 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecbeb77-0404-4c99-9367-bd1005135f98 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:45.588925 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecbeb77-0404-4c99-9367-bd1005135f98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:45.590668 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40380152-8d0c-4496-bd8e-ea38de4c7eef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:45.590819 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecbeb77-0404-4c99-9367-bd1005135f98 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:45.591558 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40380152-8d0c-4496-bd8e-ea38de4c7eef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:45.592136 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40380152-8d0c-4496-bd8e-ea38de4c7eef admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:45.592594 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40380152-8d0c-4496-bd8e-ea38de4c7eef admin admin] PATH_INFO: `/v3/users/57db7a06ecc7448c810824d122b85ad6` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:45.594208 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40380152-8d0c-4496-bd8e-ea38de4c7eef admin admin] RBAC: Authorizing `identity:delete_user(user_id=57db7a06ecc7448c810824d122b85ad6)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:45.596438 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40380152-8d0c-4496-bd8e-ea38de4c7eef admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:45.605100 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1007/1993] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:29:45 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 15:29:45.606111 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecbeb77-0404-4c99-9367-bd1005135f98 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:45.610040 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-7ecbeb77-0404-4c99-9367-bd1005135f98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:45.626915 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecbeb77-0404-4c99-9367-bd1005135f98 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:45.632847 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e6d2e7-da4b-4d47-866d-225aff5307ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:45.636748 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e6d2e7-da4b-4d47-866d-225aff5307ef admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:45.637173 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e6d2e7-da4b-4d47-866d-225aff5307ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:45.637560 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e6d2e7-da4b-4d47-866d-225aff5307ef admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:45.638530 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e6d2e7-da4b-4d47-866d-225aff5307ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:45.640360 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e6d2e7-da4b-4d47-866d-225aff5307ef admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:45.652683 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1008/1994] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:29:45 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 15:29:45.657398 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e6d2e7-da4b-4d47-866d-225aff5307ef admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:45.670963 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e6d2e7-da4b-4d47-866d-225aff5307ef admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:45.677924 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624d6480-6206-418f-818c-e6e1b2b3d6a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:45.678955 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624d6480-6206-418f-818c-e6e1b2b3d6a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:45.679310 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624d6480-6206-418f-818c-e6e1b2b3d6a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:45.679663 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624d6480-6206-418f-818c-e6e1b2b3d6a5 admin admin] PATH_INFO: `/v3/projects/429e0eafd10e4c4db79106d97b5e0eb9/users/2905928f5503405e83bf552aafa3de6b/roles/f34412ad29f1478cba775b033129f71f` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:45.680660 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-40380152-8d0c-4496-bd8e-ea38de4c7eef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57db7a06ecc7448c810824d122b85ad6'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:45.682051 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-40380152-8d0c-4496-bd8e-ea38de4c7eef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57db7a06ecc7448c810824d122b85ad6'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:45.694389 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-40380152-8d0c-4496-bd8e-ea38de4c7eef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57db7a06ecc7448c810824d122b85ad6'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:45.696216 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624d6480-6206-418f-818c-e6e1b2b3d6a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=429e0eafd10e4c4db79106d97b5e0eb9, user_id=2905928f5503405e83bf552aafa3de6b, role_id=f34412ad29f1478cba775b033129f71f)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:45.699316 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624d6480-6206-418f-818c-e6e1b2b3d6a5 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:45.707357 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-40380152-8d0c-4496-bd8e-ea38de4c7eef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57db7a06ecc7448c810824d122b85ad6'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:45.712175 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1009/1995] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 13 15:29:45 2022] PUT /identity/v3/projects/429e0eafd10e4c4db79106d97b5e0eb9/users/2905928f5503405e83bf552aafa3de6b/roles/f34412ad29f1478cba775b033129f71f => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:29:45.713527 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624d6480-6206-418f-818c-e6e1b2b3d6a5 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:45.723785 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-624d6480-6206-418f-818c-e6e1b2b3d6a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:45.739418 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-40380152-8d0c-4496-bd8e-ea38de4c7eef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57db7a06ecc7448c810824d122b85ad6'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:45.762738 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 987/1996] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 13 15:29:45 2022] DELETE /identity/v3/users/57db7a06ecc7448c810824d122b85ad6 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:29:45.764137 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40380152-8d0c-4496-bd8e-ea38de4c7eef admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:45.766369 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-40380152-8d0c-4496-bd8e-ea38de4c7eef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:45.817981 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:29:45.830363 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624d6480-6206-418f-818c-e6e1b2b3d6a5 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:45.875318 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40380152-8d0c-4496-bd8e-ea38de4c7eef admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:45.882571 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c5266b-8a93-48a8-a777-65469a8dcbcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:45.883109 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c5266b-8a93-48a8-a777-65469a8dcbcb admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:45.883514 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c5266b-8a93-48a8-a777-65469a8dcbcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:45.884378 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c5266b-8a93-48a8-a777-65469a8dcbcb admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:45.885162 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c5266b-8a93-48a8-a777-65469a8dcbcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:45.887207 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c5266b-8a93-48a8-a777-65469a8dcbcb admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:45.905087 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 988/1997] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:29:45 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 15:29:45.905087 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dff194-dbbf-4367-9462-e78ff4a787b0 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:45.905087 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dff194-dbbf-4367-9462-e78ff4a787b0 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:45.905087 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dff194-dbbf-4367-9462-e78ff4a787b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:45.927886 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a441a8ae-2b28-41ea-89e8-82424b707cdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:45.928320 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a441a8ae-2b28-41ea-89e8-82424b707cdc admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:45.928651 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a441a8ae-2b28-41ea-89e8-82424b707cdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:45.928934 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a441a8ae-2b28-41ea-89e8-82424b707cdc admin admin] PATH_INFO: `/v3/projects/840adc14f8b6419f9016ab69d9b800d6/users/44375ed947a24b56a5883ab86d1ecea0/roles/f34412ad29f1478cba775b033129f71f` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:45.942691 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-c6dff194-dbbf-4367-9462-e78ff4a787b0 None None] MFA Rules not processed for user `2905928f5503405e83bf552aafa3de6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:29:45.944123 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-c6dff194-dbbf-4367-9462-e78ff4a787b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:45.959522 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a441a8ae-2b28-41ea-89e8-82424b707cdc admin admin] RBAC: Authorizing `identity:create_grant(project_id=840adc14f8b6419f9016ab69d9b800d6, user_id=44375ed947a24b56a5883ab86d1ecea0, role_id=f34412ad29f1478cba775b033129f71f)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:45.962986 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a441a8ae-2b28-41ea-89e8-82424b707cdc admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:45.969002 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:29:45.988945 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1010/1998] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 13 15:29:45 2022] PUT /identity/v3/projects/840adc14f8b6419f9016ab69d9b800d6/users/44375ed947a24b56a5883ab86d1ecea0/roles/f34412ad29f1478cba775b033129f71f => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:29:45.988945 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a441a8ae-2b28-41ea-89e8-82424b707cdc admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:46.036343 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 989/1999] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:29:45 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:29:46.036343 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dff194-dbbf-4367-9462-e78ff4a787b0 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:46.048429 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dff194-dbbf-4367-9462-e78ff4a787b0 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:46.072565 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a441a8ae-2b28-41ea-89e8-82424b707cdc admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:46.077475 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac542e3-afeb-46bd-92d3-8b22931e9c0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:46.078178 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac542e3-afeb-46bd-92d3-8b22931e9c0a admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:46.078464 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac542e3-afeb-46bd-92d3-8b22931e9c0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:46.078744 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac542e3-afeb-46bd-92d3-8b22931e9c0a admin admin] PATH_INFO: `/v3/projects/fb05e0747a5e4291861b5fb0b727a40a/users/563945912b194705a0045b7163a6bc81/roles/3fae3d3a28e147d3b2bede2378ff79ae` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:46.096292 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac542e3-afeb-46bd-92d3-8b22931e9c0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb05e0747a5e4291861b5fb0b727a40a, user_id=563945912b194705a0045b7163a6bc81, role_id=3fae3d3a28e147d3b2bede2378ff79ae)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:46.099085 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac542e3-afeb-46bd-92d3-8b22931e9c0a admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:46.115971 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1011/2000] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 13 15:29:45 2022] PUT /identity/v3/projects/fb05e0747a5e4291861b5fb0b727a40a/users/563945912b194705a0045b7163a6bc81/roles/3fae3d3a28e147d3b2bede2378ff79ae => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:29:46.116704 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac542e3-afeb-46bd-92d3-8b22931e9c0a admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:46.118368 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-3ac542e3-afeb-46bd-92d3-8b22931e9c0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:46.130025 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7a32fa-c893-4ac1-a6a2-b151a437e157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:46.130804 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7a32fa-c893-4ac1-a6a2-b151a437e157 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:46.131079 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7a32fa-c893-4ac1-a6a2-b151a437e157 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:46.131375 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7a32fa-c893-4ac1-a6a2-b151a437e157 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:46.132017 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7a32fa-c893-4ac1-a6a2-b151a437e157 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:46.133661 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7a32fa-c893-4ac1-a6a2-b151a437e157 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:46.149079 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 990/2001] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:29:46 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 15:29:46.150260 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c618a3d-691f-40d9-aba7-242d98854e8b None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:46.150554 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c618a3d-691f-40d9-aba7-242d98854e8b None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:46.150986 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c618a3d-691f-40d9-aba7-242d98854e8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:46.176802 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-6c618a3d-691f-40d9-aba7-242d98854e8b None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:29:46.178104 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-6c618a3d-691f-40d9-aba7-242d98854e8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:46.191178 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac542e3-afeb-46bd-92d3-8b22931e9c0a admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:46.195168 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e8bf9a-75a9-49ad-9de5-3558e066b456 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97acd23097d54bf7805c3cef60626ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:46.195782 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e8bf9a-75a9-49ad-9de5-3558e066b456 service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:46.196066 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e8bf9a-75a9-49ad-9de5-3558e066b456 service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:46.196399 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e8bf9a-75a9-49ad-9de5-3558e066b456 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:46.239607 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:29:46.266857 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 991/2002] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:29:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:29:46.268468 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c618a3d-691f-40d9-aba7-242d98854e8b None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:46.281833 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c618a3d-691f-40d9-aba7-242d98854e8b None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:46.287411 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf3e59e-1885-4f4d-88c6-43c914003bae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:46.287645 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e8bf9a-75a9-49ad-9de5-3558e066b456 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:46.288126 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf3e59e-1885-4f4d-88c6-43c914003bae admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:46.288413 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf3e59e-1885-4f4d-88c6-43c914003bae admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:46.288692 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf3e59e-1885-4f4d-88c6-43c914003bae admin admin] PATH_INFO: `/v3/projects/840adc14f8b6419f9016ab69d9b800d6/users/44375ed947a24b56a5883ab86d1ecea0/roles/f34412ad29f1478cba775b033129f71f` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:46.289214 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e8bf9a-75a9-49ad-9de5-3558e066b456 service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:46.290679 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf3e59e-1885-4f4d-88c6-43c914003bae admin admin] RBAC: Authorizing `identity:create_grant(project_id=840adc14f8b6419f9016ab69d9b800d6, user_id=44375ed947a24b56a5883ab86d1ecea0, role_id=f34412ad29f1478cba775b033129f71f)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:46.293925 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf3e59e-1885-4f4d-88c6-43c914003bae admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:46.299715 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1012/2003] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:29:46 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:29:46.301444 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e8bf9a-75a9-49ad-9de5-3558e066b456 service cinder] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:46.302919 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-d0e8bf9a-75a9-49ad-9de5-3558e066b456 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:46.305593 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 992/2004] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 13 15:29:46 2022] PUT /identity/v3/projects/840adc14f8b6419f9016ab69d9b800d6/users/44375ed947a24b56a5883ab86d1ecea0/roles/f34412ad29f1478cba775b033129f71f => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:29:46.306351 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf3e59e-1885-4f4d-88c6-43c914003bae admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:46.307914 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-3cf3e59e-1885-4f4d-88c6-43c914003bae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:46.324841 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e8bf9a-75a9-49ad-9de5-3558e066b456 service cinder] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:46.359289 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:29:46.404083 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf3e59e-1885-4f4d-88c6-43c914003bae admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:46.407920 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259845af-5db4-43e3-9bb8-b1ccda81aac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:46.408315 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f83797-b36c-4131-bedd-0570b00ea2d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41675154bbba47388040966f75d84c3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:46.408775 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259845af-5db4-43e3-9bb8-b1ccda81aac5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:46.409075 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f83797-b36c-4131-bedd-0570b00ea2d9 service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:46.409208 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259845af-5db4-43e3-9bb8-b1ccda81aac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:46.409568 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259845af-5db4-43e3-9bb8-b1ccda81aac5 admin admin] PATH_INFO: `/v3/projects/96ce6bf3df8b4c2eaf2ad07e93751425` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:46.409807 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f83797-b36c-4131-bedd-0570b00ea2d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:46.410166 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f83797-b36c-4131-bedd-0570b00ea2d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:46.411557 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259845af-5db4-43e3-9bb8-b1ccda81aac5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=96ce6bf3df8b4c2eaf2ad07e93751425)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:46.413576 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259845af-5db4-43e3-9bb8-b1ccda81aac5 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:46.438992 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f83797-b36c-4131-bedd-0570b00ea2d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:46.442365 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f83797-b36c-4131-bedd-0570b00ea2d9 service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:46.459650 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 993/2005] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:29:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:29:46.461886 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d1ce8d-d27e-41b2-ba63-dffbd81bec1e None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:46.462319 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d1ce8d-d27e-41b2-ba63-dffbd81bec1e None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:46.462518 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d1ce8d-d27e-41b2-ba63-dffbd81bec1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:46.483676 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-259845af-5db4-43e3-9bb8-b1ccda81aac5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96ce6bf3df8b4c2eaf2ad07e93751425', 'request_id': 'req-259845af-5db4-43e3-9bb8-b1ccda81aac5'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:46.493404 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-259845af-5db4-43e3-9bb8-b1ccda81aac5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96ce6bf3df8b4c2eaf2ad07e93751425', 'request_id': 'req-259845af-5db4-43e3-9bb8-b1ccda81aac5'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:46.501555 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-a1d1ce8d-d27e-41b2-ba63-dffbd81bec1e None None] MFA Rules not processed for user `44375ed947a24b56a5883ab86d1ecea0`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:29:46.504159 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-a1d1ce8d-d27e-41b2-ba63-dffbd81bec1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:46.505198 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-259845af-5db4-43e3-9bb8-b1ccda81aac5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96ce6bf3df8b4c2eaf2ad07e93751425', 'request_id': 'req-259845af-5db4-43e3-9bb8-b1ccda81aac5'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:46.523506 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-259845af-5db4-43e3-9bb8-b1ccda81aac5 admin admin] The token cache is being invalidate because project 96ce6bf3df8b4c2eaf2ad07e93751425 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 15:29:46.523870 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-259845af-5db4-43e3-9bb8-b1ccda81aac5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:46.524826 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-259845af-5db4-43e3-9bb8-b1ccda81aac5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:46.531259 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1013/2006] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 13 15:29:46 2022] DELETE /identity/v3/projects/96ce6bf3df8b4c2eaf2ad07e93751425 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:29:46.532556 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4a93a9-90e6-4746-971e-04d7604e313f None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:46.532863 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4a93a9-90e6-4746-971e-04d7604e313f None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:46.533501 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4a93a9-90e6-4746-971e-04d7604e313f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:46.572690 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-ae4a93a9-90e6-4746-971e-04d7604e313f None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:29:46.575315 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-ae4a93a9-90e6-4746-971e-04d7604e313f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:46.625183 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 994/2007] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:29:46 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:29:46.642330 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d1ce8d-d27e-41b2-ba63-dffbd81bec1e None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:46.644056 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-a1d1ce8d-d27e-41b2-ba63-dffbd81bec1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:46.690027 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1014/2008] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:29:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 15:29:46.700355 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35dbcd4-98b2-4d60-ada5-8a8db669dbe2 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:46.702519 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35dbcd4-98b2-4d60-ada5-8a8db669dbe2 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:46.702519 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35dbcd4-98b2-4d60-ada5-8a8db669dbe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:46.743809 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-d35dbcd4-98b2-4d60-ada5-8a8db669dbe2 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:29:46.745103 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-d35dbcd4-98b2-4d60-ada5-8a8db669dbe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:46.757394 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1015/2009] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:29:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 15:29:46.774467 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d1ce8d-d27e-41b2-ba63-dffbd81bec1e None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:46.776233 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35dbcd4-98b2-4d60-ada5-8a8db669dbe2 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:46.786426 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d0df29-0ca5-4a09-83af-45dee7833718 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97acd23097d54bf7805c3cef60626ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:46.787308 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d0df29-0ca5-4a09-83af-45dee7833718 service cinder] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:46.787787 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d0df29-0ca5-4a09-83af-45dee7833718 service cinder] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:46.788790 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d0df29-0ca5-4a09-83af-45dee7833718 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:46.798817 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35dbcd4-98b2-4d60-ada5-8a8db669dbe2 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:46.807201 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d0df29-0ca5-4a09-83af-45dee7833718 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:46.808403 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d0df29-0ca5-4a09-83af-45dee7833718 service cinder] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:46.814585 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61934cb4-b119-4fa4-8ff3-5ff8569f2810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:46.815598 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61934cb4-b119-4fa4-8ff3-5ff8569f2810 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:46.818805 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61934cb4-b119-4fa4-8ff3-5ff8569f2810 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:46.819194 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61934cb4-b119-4fa4-8ff3-5ff8569f2810 admin admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:46.819889 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61934cb4-b119-4fa4-8ff3-5ff8569f2810 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:29:46.820214 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61934cb4-b119-4fa4-8ff3-5ff8569f2810 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:46.825748 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 995/2010] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:29:46 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 15:29:46.825928 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61934cb4-b119-4fa4-8ff3-5ff8569f2810 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:46.843303 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1016/2011] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Sep 13 15:29:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:29:46.849272 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d0df29-0ca5-4a09-83af-45dee7833718 service cinder] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:46.861569 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d0df29-0ca5-4a09-83af-45dee7833718 service cinder] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:46.868765 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72691bc4-76e7-4095-aa71-cc7e0002c2f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:46.870354 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72691bc4-76e7-4095-aa71-cc7e0002c2f9 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:46.870709 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72691bc4-76e7-4095-aa71-cc7e0002c2f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:46.871161 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72691bc4-76e7-4095-aa71-cc7e0002c2f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:46.872586 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72691bc4-76e7-4095-aa71-cc7e0002c2f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:46.874365 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72691bc4-76e7-4095-aa71-cc7e0002c2f9 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:46.882535 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:29:46.919895 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61934cb4-b119-4fa4-8ff3-5ff8569f2810 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:46.939029 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 996/2012] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 13 15:29:46 2022] POST /identity/v3/projects => generated 385 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 15:29:46.941242 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72691bc4-76e7-4095-aa71-cc7e0002c2f9 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:46.943203 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61934cb4-b119-4fa4-8ff3-5ff8569f2810 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:47.016315 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:29:47.040715 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eb406f-e66b-48cf-abc5-fe77be5d160f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97acd23097d54bf7805c3cef60626ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:47.041568 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eb406f-e66b-48cf-abc5-fe77be5d160f service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:47.042371 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eb406f-e66b-48cf-abc5-fe77be5d160f service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:47.042954 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eb406f-e66b-48cf-abc5-fe77be5d160f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:47.045694 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-12eb406f-e66b-48cf-abc5-fe77be5d160f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:47.073439 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72691bc4-76e7-4095-aa71-cc7e0002c2f9 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:47.079423 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f7af8c-fa45-4a16-8621-a0cdf1b74f04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:47.079981 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f7af8c-fa45-4a16-8621-a0cdf1b74f04 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:47.080433 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f7af8c-fa45-4a16-8621-a0cdf1b74f04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:47.080729 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f7af8c-fa45-4a16-8621-a0cdf1b74f04 admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:47.081567 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f7af8c-fa45-4a16-8621-a0cdf1b74f04 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:47.083603 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f7af8c-fa45-4a16-8621-a0cdf1b74f04 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:47.115394 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 997/2013] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 13 15:29:46 2022] POST /identity/v3/users => generated 293 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 15:29:47.119670 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f7af8c-fa45-4a16-8621-a0cdf1b74f04 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:47.132975 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f7af8c-fa45-4a16-8621-a0cdf1b74f04 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:47.140459 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12562bc-dd71-4ec9-95f9-7a43a765b240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:47.141672 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12562bc-dd71-4ec9-95f9-7a43a765b240 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:47.142143 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12562bc-dd71-4ec9-95f9-7a43a765b240 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:47.142612 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12562bc-dd71-4ec9-95f9-7a43a765b240 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:47.144954 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12562bc-dd71-4ec9-95f9-7a43a765b240 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:47.147464 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12562bc-dd71-4ec9-95f9-7a43a765b240 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:47.161951 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12eb406f-e66b-48cf-abc5-fe77be5d160f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:47.163845 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12eb406f-e66b-48cf-abc5-fe77be5d160f service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:47.177959 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 998/2014] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:29:47 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 15:29:47.179095 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12562bc-dd71-4ec9-95f9-7a43a765b240 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:47.180877 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-c12562bc-dd71-4ec9-95f9-7a43a765b240 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:47.182206 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1017/2015] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:29:46 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:29:47.183638 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eb406f-e66b-48cf-abc5-fe77be5d160f service cinder] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:47.196365 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12562bc-dd71-4ec9-95f9-7a43a765b240 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:47.200176 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eb406f-e66b-48cf-abc5-fe77be5d160f service cinder] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:47.200635 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b858b153-d207-4bfc-883a-33559aad6599 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97acd23097d54bf7805c3cef60626ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:47.201138 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b858b153-d207-4bfc-883a-33559aad6599 service cinder] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:47.201409 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b858b153-d207-4bfc-883a-33559aad6599 service cinder] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:47.201691 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b858b153-d207-4bfc-883a-33559aad6599 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:47.204093 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-b858b153-d207-4bfc-883a-33559aad6599 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:47.208062 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c52170-ba8c-4d1c-944a-15494751ca2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:47.208882 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c52170-ba8c-4d1c-944a-15494751ca2d admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:47.209310 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c52170-ba8c-4d1c-944a-15494751ca2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:47.209693 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c52170-ba8c-4d1c-944a-15494751ca2d admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:47.210529 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c52170-ba8c-4d1c-944a-15494751ca2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:47.212465 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c52170-ba8c-4d1c-944a-15494751ca2d admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:47.225734 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1018/2016] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:29:47 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 15:29:47.236339 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c52170-ba8c-4d1c-944a-15494751ca2d admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:47.247672 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c52170-ba8c-4d1c-944a-15494751ca2d admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:47.255432 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9098c04-2111-4fde-a8be-1bd1ec812a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:47.256418 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9098c04-2111-4fde-a8be-1bd1ec812a51 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:47.256805 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9098c04-2111-4fde-a8be-1bd1ec812a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:47.257206 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9098c04-2111-4fde-a8be-1bd1ec812a51 admin admin] PATH_INFO: `/v3/projects/98772690b6b94efa9e9da9dc6010d907/users/c703cbe5dafd462aa6cb94621a3372a3/roles/3fae3d3a28e147d3b2bede2378ff79ae` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:47.281560 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9098c04-2111-4fde-a8be-1bd1ec812a51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98772690b6b94efa9e9da9dc6010d907, user_id=c703cbe5dafd462aa6cb94621a3372a3, role_id=3fae3d3a28e147d3b2bede2378ff79ae)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:47.285848 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9098c04-2111-4fde-a8be-1bd1ec812a51 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:47.297425 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b858b153-d207-4bfc-883a-33559aad6599 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:47.299450 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b858b153-d207-4bfc-883a-33559aad6599 service cinder] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:47.306753 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1019/2017] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 13 15:29:47 2022] PUT /identity/v3/projects/98772690b6b94efa9e9da9dc6010d907/users/c703cbe5dafd462aa6cb94621a3372a3/roles/3fae3d3a28e147d3b2bede2378ff79ae => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:29:47.319263 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47275914-4d16-4643-a43b-63218096cb01 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:47.319849 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47275914-4d16-4643-a43b-63218096cb01 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:47.320359 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47275914-4d16-4643-a43b-63218096cb01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:47.324946 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 999/2018] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:29:47 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:29:47.365825 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-47275914-4d16-4643-a43b-63218096cb01 None None] MFA Rules not processed for user `c703cbe5dafd462aa6cb94621a3372a3`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:29:47.367917 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-47275914-4d16-4643-a43b-63218096cb01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:47.475679 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1020/2019] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:29:47 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 15:29:47.482337 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b858b153-d207-4bfc-883a-33559aad6599 service cinder] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:47.499999 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b858b153-d207-4bfc-883a-33559aad6599 service cinder] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:47.646157 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89e33ac-f250-4b5e-9d3a-a3094ec2610c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:47.647857 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89e33ac-f250-4b5e-9d3a-a3094ec2610c admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:47.648180 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89e33ac-f250-4b5e-9d3a-a3094ec2610c admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:47.648612 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89e33ac-f250-4b5e-9d3a-a3094ec2610c admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:47.649394 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89e33ac-f250-4b5e-9d3a-a3094ec2610c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:47.653892 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89e33ac-f250-4b5e-9d3a-a3094ec2610c admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:47.682703 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:29:47.732607 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1000/2020] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 13 15:29:47 2022] POST /identity/v3/projects => generated 385 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:29:47.737119 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47275914-4d16-4643-a43b-63218096cb01 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:47.748710 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47275914-4d16-4643-a43b-63218096cb01 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:47.835821 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:29:47.858947 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4005a09-adfc-4e62-be80-e385c5a8e839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:47.859638 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4005a09-adfc-4e62-be80-e385c5a8e839 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:47.860022 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4005a09-adfc-4e62-be80-e385c5a8e839 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:47.860314 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4005a09-adfc-4e62-be80-e385c5a8e839 admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:47.861633 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4005a09-adfc-4e62-be80-e385c5a8e839 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:47.864474 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4005a09-adfc-4e62-be80-e385c5a8e839 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:47.906519 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1021/2021] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 13 15:29:47 2022] POST /identity/v3/users => generated 299 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:29:47.910674 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89e33ac-f250-4b5e-9d3a-a3094ec2610c admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:47.926763 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89e33ac-f250-4b5e-9d3a-a3094ec2610c admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:47.936182 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c97bbc-47b2-4c64-b570-500e7a1692da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:47.937209 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c97bbc-47b2-4c64-b570-500e7a1692da admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:47.937743 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c97bbc-47b2-4c64-b570-500e7a1692da admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:47.938254 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c97bbc-47b2-4c64-b570-500e7a1692da admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:47.939217 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c97bbc-47b2-4c64-b570-500e7a1692da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:47.941387 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c97bbc-47b2-4c64-b570-500e7a1692da admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:47.953982 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1001/2022] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:29:47 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 15:29:47.958691 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4005a09-adfc-4e62-be80-e385c5a8e839 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:47.969483 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4005a09-adfc-4e62-be80-e385c5a8e839 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:47.977337 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2097eef-bcd8-4fa6-b6f4-f258f7d99897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:47.978103 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2097eef-bcd8-4fa6-b6f4-f258f7d99897 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:47.978383 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2097eef-bcd8-4fa6-b6f4-f258f7d99897 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:47.978656 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2097eef-bcd8-4fa6-b6f4-f258f7d99897 admin admin] PATH_INFO: `/v3/projects/d8b66b8282e14d52a8da54472c377640/users/65cedd1bf5ee47658bff88897bd0f474/roles/f34412ad29f1478cba775b033129f71f` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:47.996665 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2097eef-bcd8-4fa6-b6f4-f258f7d99897 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8b66b8282e14d52a8da54472c377640, user_id=65cedd1bf5ee47658bff88897bd0f474, role_id=f34412ad29f1478cba775b033129f71f)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:47.999421 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2097eef-bcd8-4fa6-b6f4-f258f7d99897 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:48.027432 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1022/2023] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 13 15:29:47 2022] PUT /identity/v3/projects/d8b66b8282e14d52a8da54472c377640/users/65cedd1bf5ee47658bff88897bd0f474/roles/f34412ad29f1478cba775b033129f71f => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:29:48.031996 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c97bbc-47b2-4c64-b570-500e7a1692da admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:48.075272 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c97bbc-47b2-4c64-b570-500e7a1692da admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:48.276804 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238066bf-6de5-449c-a3ee-3de3a5e75466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:48.277449 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238066bf-6de5-449c-a3ee-3de3a5e75466 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:48.278028 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238066bf-6de5-449c-a3ee-3de3a5e75466 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:48.279089 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238066bf-6de5-449c-a3ee-3de3a5e75466 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:48.279089 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238066bf-6de5-449c-a3ee-3de3a5e75466 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:48.280746 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238066bf-6de5-449c-a3ee-3de3a5e75466 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:48.298179 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1002/2024] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:29:48 2022] GET /identity/v3/roles => generated 1420 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 15:29:48.299408 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2097eef-bcd8-4fa6-b6f4-f258f7d99897 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:48.316775 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2097eef-bcd8-4fa6-b6f4-f258f7d99897 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:48.330296 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a60c665-3875-4b0e-b569-2b8149a9657f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:48.332328 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a60c665-3875-4b0e-b569-2b8149a9657f admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:48.332839 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a60c665-3875-4b0e-b569-2b8149a9657f admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:48.333613 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a60c665-3875-4b0e-b569-2b8149a9657f admin admin] PATH_INFO: `/v3/projects/d8b66b8282e14d52a8da54472c377640/users/65cedd1bf5ee47658bff88897bd0f474/roles/f34412ad29f1478cba775b033129f71f` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:48.336319 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a60c665-3875-4b0e-b569-2b8149a9657f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8b66b8282e14d52a8da54472c377640, user_id=65cedd1bf5ee47658bff88897bd0f474, role_id=f34412ad29f1478cba775b033129f71f)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:48.339982 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a60c665-3875-4b0e-b569-2b8149a9657f admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:48.361481 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1023/2025] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 13 15:29:48 2022] PUT /identity/v3/projects/d8b66b8282e14d52a8da54472c377640/users/65cedd1bf5ee47658bff88897bd0f474/roles/f34412ad29f1478cba775b033129f71f => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:29:48.373130 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13541c66-1784-49a7-9cd8-6634a09dbe9f None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:48.373423 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13541c66-1784-49a7-9cd8-6634a09dbe9f None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:48.374098 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13541c66-1784-49a7-9cd8-6634a09dbe9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:48.415123 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-13541c66-1784-49a7-9cd8-6634a09dbe9f None None] MFA Rules not processed for user `65cedd1bf5ee47658bff88897bd0f474`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:29:48.416680 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-13541c66-1784-49a7-9cd8-6634a09dbe9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:48.436693 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5814e7b2-9cb6-445f-a076-5ad4f23981be None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:48.436986 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5814e7b2-9cb6-445f-a076-5ad4f23981be None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:48.437263 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5814e7b2-9cb6-445f-a076-5ad4f23981be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:48.483336 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-5814e7b2-9cb6-445f-a076-5ad4f23981be None None] MFA Rules not processed for user `563945912b194705a0045b7163a6bc81`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:29:48.485031 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-5814e7b2-9cb6-445f-a076-5ad4f23981be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:48.539953 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1003/2026] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:29:48 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:29:48.551281 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13541c66-1784-49a7-9cd8-6634a09dbe9f None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:48.579347 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1024/2027] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:29:48 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:29:48.582775 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5814e7b2-9cb6-445f-a076-5ad4f23981be None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:48.584406 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-5814e7b2-9cb6-445f-a076-5ad4f23981be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:48.641152 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13541c66-1784-49a7-9cd8-6634a09dbe9f None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:48.646367 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48607909-cb4c-4a9a-85e7-b6429cced181 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97acd23097d54bf7805c3cef60626ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:48.647190 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48607909-cb4c-4a9a-85e7-b6429cced181 service cinder] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:48.647711 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48607909-cb4c-4a9a-85e7-b6429cced181 service cinder] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:48.648179 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48607909-cb4c-4a9a-85e7-b6429cced181 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:48.665431 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:29:48.739423 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5814e7b2-9cb6-445f-a076-5ad4f23981be None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:48.761067 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c319ed-a034-40c4-b888-d79c3785122c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:48.761728 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c319ed-a034-40c4-b888-d79c3785122c admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:48.762009 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c319ed-a034-40c4-b888-d79c3785122c admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:48.762279 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c319ed-a034-40c4-b888-d79c3785122c admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:48.762955 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c319ed-a034-40c4-b888-d79c3785122c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:48.766423 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48607909-cb4c-4a9a-85e7-b6429cced181 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:48.768268 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48607909-cb4c-4a9a-85e7-b6429cced181 service cinder] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:48.778362 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c319ed-a034-40c4-b888-d79c3785122c admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:48.783726 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1004/2028] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:29:48 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 15:29:48.844300 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1025/2029] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 13 15:29:48 2022] POST /identity/v3/projects => generated 373 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 15:29:48.848521 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48607909-cb4c-4a9a-85e7-b6429cced181 service cinder] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:48.861131 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48607909-cb4c-4a9a-85e7-b6429cced181 service cinder] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:48.992813 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b491a7-ee0d-4673-8f8b-44f320036e34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:48.994176 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b491a7-ee0d-4673-8f8b-44f320036e34 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:48.994586 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b491a7-ee0d-4673-8f8b-44f320036e34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:48.994978 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b491a7-ee0d-4673-8f8b-44f320036e34 admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:48.995731 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b491a7-ee0d-4673-8f8b-44f320036e34 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:48.997813 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b491a7-ee0d-4673-8f8b-44f320036e34 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:49.029365 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1005/2030] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 13 15:29:48 2022] POST /identity/v3/users => generated 293 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:29:49.029526 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c319ed-a034-40c4-b888-d79c3785122c admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:49.042072 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c319ed-a034-40c4-b888-d79c3785122c admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:49.048623 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1140ec-7485-46d0-bb83-fd8eb8f913c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:49.049240 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1140ec-7485-46d0-bb83-fd8eb8f913c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:49.049639 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1140ec-7485-46d0-bb83-fd8eb8f913c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:49.050012 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1140ec-7485-46d0-bb83-fd8eb8f913c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:49.050613 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1140ec-7485-46d0-bb83-fd8eb8f913c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:49.052325 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1140ec-7485-46d0-bb83-fd8eb8f913c4 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:49.069820 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1026/2031] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:29:49 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 15:29:49.074267 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b491a7-ee0d-4673-8f8b-44f320036e34 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:49.088181 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b491a7-ee0d-4673-8f8b-44f320036e34 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:49.093925 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe401a1c-0b8d-42df-a795-3f56a1cc0411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:49.094757 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe401a1c-0b8d-42df-a795-3f56a1cc0411 admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:49.095108 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe401a1c-0b8d-42df-a795-3f56a1cc0411 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:49.095873 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe401a1c-0b8d-42df-a795-3f56a1cc0411 admin admin] PATH_INFO: `/v3/projects/3392aa9dbe144ec1be2ec91e8fa8f1cf/users/344e23c65a63430889a20621ff82b9dc/roles/f34412ad29f1478cba775b033129f71f` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:49.116788 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe401a1c-0b8d-42df-a795-3f56a1cc0411 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3392aa9dbe144ec1be2ec91e8fa8f1cf, user_id=344e23c65a63430889a20621ff82b9dc, role_id=f34412ad29f1478cba775b033129f71f)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:49.120185 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe401a1c-0b8d-42df-a795-3f56a1cc0411 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:49.137378 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1006/2032] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 13 15:29:49 2022] PUT /identity/v3/projects/3392aa9dbe144ec1be2ec91e8fa8f1cf/users/344e23c65a63430889a20621ff82b9dc/roles/f34412ad29f1478cba775b033129f71f => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:29:49.142036 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1140ec-7485-46d0-bb83-fd8eb8f913c4 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:49.147674 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:29:49.156235 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1140ec-7485-46d0-bb83-fd8eb8f913c4 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:49.248564 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8becdef-d3d2-4eca-9879-82260d61f2b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:49.249297 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8becdef-d3d2-4eca-9879-82260d61f2b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:49.249637 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8becdef-d3d2-4eca-9879-82260d61f2b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:49.250006 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8becdef-d3d2-4eca-9879-82260d61f2b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:49.250779 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8becdef-d3d2-4eca-9879-82260d61f2b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:49.252450 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8becdef-d3d2-4eca-9879-82260d61f2b8 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:49.266081 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1027/2033] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:29:49 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 15:29:49.271194 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe401a1c-0b8d-42df-a795-3f56a1cc0411 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:49.287981 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe401a1c-0b8d-42df-a795-3f56a1cc0411 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:49.297389 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772fe4f1-918c-453c-9f64-9cee354dd0e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:49.298192 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772fe4f1-918c-453c-9f64-9cee354dd0e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:49.301191 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772fe4f1-918c-453c-9f64-9cee354dd0e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:49.301665 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772fe4f1-918c-453c-9f64-9cee354dd0e9 admin admin] PATH_INFO: `/v3/projects/3392aa9dbe144ec1be2ec91e8fa8f1cf/users/344e23c65a63430889a20621ff82b9dc/roles/f34412ad29f1478cba775b033129f71f` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:49.304341 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772fe4f1-918c-453c-9f64-9cee354dd0e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3392aa9dbe144ec1be2ec91e8fa8f1cf, user_id=344e23c65a63430889a20621ff82b9dc, role_id=f34412ad29f1478cba775b033129f71f)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:49.307138 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772fe4f1-918c-453c-9f64-9cee354dd0e9 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:49.321780 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1007/2034] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 13 15:29:49 2022] PUT /identity/v3/projects/3392aa9dbe144ec1be2ec91e8fa8f1cf/users/344e23c65a63430889a20621ff82b9dc/roles/f34412ad29f1478cba775b033129f71f => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:29:50.200338 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e800a100-3421-408c-9c03-6cd580c55bb5 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:50.200830 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e800a100-3421-408c-9c03-6cd580c55bb5 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:50.206649 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e800a100-3421-408c-9c03-6cd580c55bb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:50.239362 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-e800a100-3421-408c-9c03-6cd580c55bb5 None None] MFA Rules not processed for user `344e23c65a63430889a20621ff82b9dc`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:29:50.240678 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-e800a100-3421-408c-9c03-6cd580c55bb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:50.331746 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1028/2035] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:29:50 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:29:50.342168 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a9d13a-79e7-4b86-af55-f3eb6504aa4a None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:50.342742 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a9d13a-79e7-4b86-af55-f3eb6504aa4a None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:50.342742 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a9d13a-79e7-4b86-af55-f3eb6504aa4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:50.363769 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-86a9d13a-79e7-4b86-af55-f3eb6504aa4a None None] MFA Rules not processed for user `563945912b194705a0045b7163a6bc81`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:29:50.365022 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-86a9d13a-79e7-4b86-af55-f3eb6504aa4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:50.439290 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1008/2036] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:29:50 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:29:50.450635 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e800a100-3421-408c-9c03-6cd580c55bb5 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:50.452310 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-e800a100-3421-408c-9c03-6cd580c55bb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:50.546644 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e800a100-3421-408c-9c03-6cd580c55bb5 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:50.554025 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e99ecb-c518-42d8-ae12-d5e5d0f1f045 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62aad71c6c1a4469805762bba330bf0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:50.554737 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e99ecb-c518-42d8-ae12-d5e5d0f1f045 service nova] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:50.554972 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e99ecb-c518-42d8-ae12-d5e5d0f1f045 service nova] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:50.555345 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e99ecb-c518-42d8-ae12-d5e5d0f1f045 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:50.563914 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e99ecb-c518-42d8-ae12-d5e5d0f1f045 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:50.566239 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e99ecb-c518-42d8-ae12-d5e5d0f1f045 service nova] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:50.577981 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1029/2037] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:29:50 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:29:51.616647 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a9d13a-79e7-4b86-af55-f3eb6504aa4a None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:51.624481 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-86a9d13a-79e7-4b86-af55-f3eb6504aa4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:51.639037 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:29:51.717499 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a9d13a-79e7-4b86-af55-f3eb6504aa4a None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:51.728880 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef568cd5-3652-4568-a033-8fc07d9630ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:51.730026 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef568cd5-3652-4568-a033-8fc07d9630ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:51.730362 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef568cd5-3652-4568-a033-8fc07d9630ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:51.730642 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef568cd5-3652-4568-a033-8fc07d9630ce admin admin] PATH_INFO: `/v3/users/076baae3dc0549678f5d19bc01804f21` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:51.731833 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef568cd5-3652-4568-a033-8fc07d9630ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=076baae3dc0549678f5d19bc01804f21)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:51.734012 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef568cd5-3652-4568-a033-8fc07d9630ce admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:51.802236 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-ef568cd5-3652-4568-a033-8fc07d9630ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '076baae3dc0549678f5d19bc01804f21'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:51.802972 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-ef568cd5-3652-4568-a033-8fc07d9630ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '076baae3dc0549678f5d19bc01804f21'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:51.803622 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-ef568cd5-3652-4568-a033-8fc07d9630ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '076baae3dc0549678f5d19bc01804f21'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:51.812814 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-ef568cd5-3652-4568-a033-8fc07d9630ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '076baae3dc0549678f5d19bc01804f21'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:51.828469 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-ef568cd5-3652-4568-a033-8fc07d9630ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '076baae3dc0549678f5d19bc01804f21'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:51.846046 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1009/2038] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 13 15:29:51 2022] DELETE /identity/v3/users/076baae3dc0549678f5d19bc01804f21 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:29:51.851053 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4006309-ea27-4eff-b865-7262451ca1ff None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:51.851689 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4006309-ea27-4eff-b865-7262451ca1ff None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:51.851689 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4006309-ea27-4eff-b865-7262451ca1ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:51.873997 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-d4006309-ea27-4eff-b865-7262451ca1ff None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:29:51.875235 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-d4006309-ea27-4eff-b865-7262451ca1ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:51.879798 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:29:51.948394 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1030/2039] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:29:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:29:51.960685 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef568cd5-3652-4568-a033-8fc07d9630ce admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:51.962334 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-ef568cd5-3652-4568-a033-8fc07d9630ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:52.040230 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef568cd5-3652-4568-a033-8fc07d9630ce admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:52.067587 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427ab494-6a75-4ee9-b684-593dca9792d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41675154bbba47388040966f75d84c3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:52.067587 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427ab494-6a75-4ee9-b684-593dca9792d2 service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:52.067587 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427ab494-6a75-4ee9-b684-593dca9792d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:52.067587 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427ab494-6a75-4ee9-b684-593dca9792d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:52.072392 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427ab494-6a75-4ee9-b684-593dca9792d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:52.075052 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427ab494-6a75-4ee9-b684-593dca9792d2 service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:52.100351 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1010/2040] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:29:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:29:52.416143 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4006309-ea27-4eff-b865-7262451ca1ff None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:52.417594 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-d4006309-ea27-4eff-b865-7262451ca1ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:52.511960 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427ab494-6a75-4ee9-b684-593dca9792d2 service neutron] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:52.512770 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-427ab494-6a75-4ee9-b684-593dca9792d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:52.556769 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427ab494-6a75-4ee9-b684-593dca9792d2 service neutron] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:52.586647 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3282c3-7c9c-41db-9142-a29cca25d232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:52.587226 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3282c3-7c9c-41db-9142-a29cca25d232 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:52.587516 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3282c3-7c9c-41db-9142-a29cca25d232 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:52.587798 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3282c3-7c9c-41db-9142-a29cca25d232 admin admin] PATH_INFO: `/v3/projects/71d7facad944461ab668a1cbf1e29477` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:52.592075 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4006309-ea27-4eff-b865-7262451ca1ff None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:52.593627 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3282c3-7c9c-41db-9142-a29cca25d232 admin admin] RBAC: Authorizing `identity:delete_project(project_id=71d7facad944461ab668a1cbf1e29477)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:52.595982 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024434d3-c79f-4f3e-9992-0b93680f84e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97acd23097d54bf7805c3cef60626ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:52.597965 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024434d3-c79f-4f3e-9992-0b93680f84e6 service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:52.597965 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024434d3-c79f-4f3e-9992-0b93680f84e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:52.597965 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024434d3-c79f-4f3e-9992-0b93680f84e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:52.599557 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-024434d3-c79f-4f3e-9992-0b93680f84e6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:52.600066 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3282c3-7c9c-41db-9142-a29cca25d232 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:52.719540 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:29:52.736792 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024434d3-c79f-4f3e-9992-0b93680f84e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:52.738367 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024434d3-c79f-4f3e-9992-0b93680f84e6 service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:52.749638 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-1e3282c3-7c9c-41db-9142-a29cca25d232 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71d7facad944461ab668a1cbf1e29477', 'request_id': 'req-1e3282c3-7c9c-41db-9142-a29cca25d232'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:52.764345 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-1e3282c3-7c9c-41db-9142-a29cca25d232 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71d7facad944461ab668a1cbf1e29477', 'request_id': 'req-1e3282c3-7c9c-41db-9142-a29cca25d232'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:52.765481 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1031/2041] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:29:52 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:29:52.781026 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-1e3282c3-7c9c-41db-9142-a29cca25d232 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71d7facad944461ab668a1cbf1e29477', 'request_id': 'req-1e3282c3-7c9c-41db-9142-a29cca25d232'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:52.810430 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-1e3282c3-7c9c-41db-9142-a29cca25d232 admin admin] The token cache is being invalidate because project 71d7facad944461ab668a1cbf1e29477 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 15:29:52.810683 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-1e3282c3-7c9c-41db-9142-a29cca25d232 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:52.812230 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-1e3282c3-7c9c-41db-9142-a29cca25d232 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:52.817338 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1011/2042] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 13 15:29:52 2022] DELETE /identity/v3/projects/71d7facad944461ab668a1cbf1e29477 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:29:52.824637 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024434d3-c79f-4f3e-9992-0b93680f84e6 service cinder] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:52.842308 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024434d3-c79f-4f3e-9992-0b93680f84e6 service cinder] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:52.954062 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d17e23-8a7e-4f60-a59b-0adcde3ffab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:52.955434 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d17e23-8a7e-4f60-a59b-0adcde3ffab2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:52.955918 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d17e23-8a7e-4f60-a59b-0adcde3ffab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:52.956987 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d17e23-8a7e-4f60-a59b-0adcde3ffab2 admin admin] PATH_INFO: `/v3/users/44375ed947a24b56a5883ab86d1ecea0` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:52.958652 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d17e23-8a7e-4f60-a59b-0adcde3ffab2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=44375ed947a24b56a5883ab86d1ecea0)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:52.961088 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d17e23-8a7e-4f60-a59b-0adcde3ffab2 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:52.973398 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:29:53.061563 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-85d17e23-8a7e-4f60-a59b-0adcde3ffab2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44375ed947a24b56a5883ab86d1ecea0'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:53.063345 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-85d17e23-8a7e-4f60-a59b-0adcde3ffab2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44375ed947a24b56a5883ab86d1ecea0'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:53.064242 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-85d17e23-8a7e-4f60-a59b-0adcde3ffab2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44375ed947a24b56a5883ab86d1ecea0'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:53.078976 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-85d17e23-8a7e-4f60-a59b-0adcde3ffab2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44375ed947a24b56a5883ab86d1ecea0'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:53.097489 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-85d17e23-8a7e-4f60-a59b-0adcde3ffab2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44375ed947a24b56a5883ab86d1ecea0'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:53.130347 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1032/2043] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 13 15:29:52 2022] DELETE /identity/v3/users/44375ed947a24b56a5883ab86d1ecea0 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:29:53.901083 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3282c3-7c9c-41db-9142-a29cca25d232 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:53.905832 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-1e3282c3-7c9c-41db-9142-a29cca25d232 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:54.014871 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3282c3-7c9c-41db-9142-a29cca25d232 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:54.083621 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f64401-2a3f-479c-bac1-ffc86a5d14f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97acd23097d54bf7805c3cef60626ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:54.084746 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f64401-2a3f-479c-bac1-ffc86a5d14f3 service cinder] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:54.085338 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f64401-2a3f-479c-bac1-ffc86a5d14f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:54.085893 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f64401-2a3f-479c-bac1-ffc86a5d14f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:54.088012 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-d9f64401-2a3f-479c-bac1-ffc86a5d14f3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:54.136579 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d17e23-8a7e-4f60-a59b-0adcde3ffab2 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:54.138119 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-85d17e23-8a7e-4f60-a59b-0adcde3ffab2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:54.173028 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f64401-2a3f-479c-bac1-ffc86a5d14f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:54.174986 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f64401-2a3f-479c-bac1-ffc86a5d14f3 service cinder] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:54.189410 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1012/2044] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:29:53 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:29:54.329005 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d17e23-8a7e-4f60-a59b-0adcde3ffab2 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:54.369678 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2a7885-a51c-4025-a4e9-35081610405c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:54.374262 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2a7885-a51c-4025-a4e9-35081610405c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:54.377123 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2a7885-a51c-4025-a4e9-35081610405c admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:54.377625 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2a7885-a51c-4025-a4e9-35081610405c admin admin] PATH_INFO: `/v3/projects/840adc14f8b6419f9016ab69d9b800d6` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:54.384353 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2a7885-a51c-4025-a4e9-35081610405c admin admin] RBAC: Authorizing `identity:delete_project(project_id=840adc14f8b6419f9016ab69d9b800d6)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:54.392817 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2a7885-a51c-4025-a4e9-35081610405c admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:54.495890 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-9b2a7885-a51c-4025-a4e9-35081610405c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '840adc14f8b6419f9016ab69d9b800d6', 'request_id': 'req-9b2a7885-a51c-4025-a4e9-35081610405c'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:54.504069 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-9b2a7885-a51c-4025-a4e9-35081610405c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '840adc14f8b6419f9016ab69d9b800d6', 'request_id': 'req-9b2a7885-a51c-4025-a4e9-35081610405c'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:54.516595 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-9b2a7885-a51c-4025-a4e9-35081610405c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '840adc14f8b6419f9016ab69d9b800d6', 'request_id': 'req-9b2a7885-a51c-4025-a4e9-35081610405c'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:54.545639 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-9b2a7885-a51c-4025-a4e9-35081610405c admin admin] The token cache is being invalidate because project 840adc14f8b6419f9016ab69d9b800d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 15:29:54.546217 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-9b2a7885-a51c-4025-a4e9-35081610405c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:54.547825 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-9b2a7885-a51c-4025-a4e9-35081610405c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:54.550179 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1033/2045] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 13 15:29:54 2022] DELETE /identity/v3/projects/840adc14f8b6419f9016ab69d9b800d6 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 15:29:54.555616 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7650c9-d454-4fd3-a0cb-81f2bafa0a6a None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:54.555966 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7650c9-d454-4fd3-a0cb-81f2bafa0a6a None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:54.556344 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7650c9-d454-4fd3-a0cb-81f2bafa0a6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:54.598106 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-2f7650c9-d454-4fd3-a0cb-81f2bafa0a6a None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:29:54.599365 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-2f7650c9-d454-4fd3-a0cb-81f2bafa0a6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:54.645382 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:29:54.722966 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1013/2046] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:29:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:29:54.730813 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e740507-f152-47ed-810b-35a7566e3dc9 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:54.732062 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e740507-f152-47ed-810b-35a7566e3dc9 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:54.732741 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e740507-f152-47ed-810b-35a7566e3dc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:54.757563 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-3e740507-f152-47ed-810b-35a7566e3dc9 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:29:54.759328 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-3e740507-f152-47ed-810b-35a7566e3dc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:54.770071 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1034/2047] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:29:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:29:54.774110 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7650c9-d454-4fd3-a0cb-81f2bafa0a6a None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:54.786851 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7650c9-d454-4fd3-a0cb-81f2bafa0a6a None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:54.792567 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba1d8b6-483b-41ed-a607-9435085798e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:54.793280 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba1d8b6-483b-41ed-a607-9435085798e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:54.793734 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba1d8b6-483b-41ed-a607-9435085798e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:54.794187 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba1d8b6-483b-41ed-a607-9435085798e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:54.795023 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba1d8b6-483b-41ed-a607-9435085798e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:29:54.795552 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba1d8b6-483b-41ed-a607-9435085798e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:54.809732 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba1d8b6-483b-41ed-a607-9435085798e5 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:54.813437 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1014/2048] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Sep 13 15:29:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 15:29:54.818820 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e740507-f152-47ed-810b-35a7566e3dc9 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:54.833750 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e740507-f152-47ed-810b-35a7566e3dc9 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:54.839203 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ebf389-6757-427b-8f7a-343afd8c3c59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:54.840195 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ebf389-6757-427b-8f7a-343afd8c3c59 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:54.840802 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ebf389-6757-427b-8f7a-343afd8c3c59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:54.841297 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ebf389-6757-427b-8f7a-343afd8c3c59 admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:54.842496 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ebf389-6757-427b-8f7a-343afd8c3c59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:54.844937 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ebf389-6757-427b-8f7a-343afd8c3c59 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:54.851872 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:29:54.916741 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1035/2049] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 13 15:29:54 2022] POST /identity/v3/projects => generated 387 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 15:29:54.921096 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba1d8b6-483b-41ed-a607-9435085798e5 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:54.938212 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba1d8b6-483b-41ed-a607-9435085798e5 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:55.055140 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3290f74-f38d-4370-bf00-935b3279b7c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:55.056010 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3290f74-f38d-4370-bf00-935b3279b7c7 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:55.056536 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3290f74-f38d-4370-bf00-935b3279b7c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:55.057012 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3290f74-f38d-4370-bf00-935b3279b7c7 admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:55.057905 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3290f74-f38d-4370-bf00-935b3279b7c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:55.060016 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3290f74-f38d-4370-bf00-935b3279b7c7 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:55.091193 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1015/2050] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 13 15:29:54 2022] POST /identity/v3/users => generated 294 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 15:29:55.095417 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ebf389-6757-427b-8f7a-343afd8c3c59 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:55.110720 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ebf389-6757-427b-8f7a-343afd8c3c59 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:55.120912 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10459e97-e641-4584-a0a8-d53143bf3eaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:55.122092 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10459e97-e641-4584-a0a8-d53143bf3eaa admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:55.122657 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10459e97-e641-4584-a0a8-d53143bf3eaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:55.123287 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10459e97-e641-4584-a0a8-d53143bf3eaa admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:55.124509 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10459e97-e641-4584-a0a8-d53143bf3eaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:55.127388 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10459e97-e641-4584-a0a8-d53143bf3eaa admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:55.149941 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1036/2051] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:29:55 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 15:29:55.151692 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3290f74-f38d-4370-bf00-935b3279b7c7 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:55.165534 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3290f74-f38d-4370-bf00-935b3279b7c7 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:55.172919 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d92eb8-f04b-4f90-887c-70637433fa3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:55.173511 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d92eb8-f04b-4f90-887c-70637433fa3d admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:55.174288 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d92eb8-f04b-4f90-887c-70637433fa3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:55.174651 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d92eb8-f04b-4f90-887c-70637433fa3d admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:55.175980 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d92eb8-f04b-4f90-887c-70637433fa3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:55.177765 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d92eb8-f04b-4f90-887c-70637433fa3d admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:55.198590 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1016/2052] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:29:55 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 15:29:55.203227 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10459e97-e641-4584-a0a8-d53143bf3eaa admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:55.226703 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10459e97-e641-4584-a0a8-d53143bf3eaa admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:55.232063 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df76131-ea7e-4a59-b08e-bb19654b6889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:55.233156 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df76131-ea7e-4a59-b08e-bb19654b6889 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:55.233509 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df76131-ea7e-4a59-b08e-bb19654b6889 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:55.233875 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df76131-ea7e-4a59-b08e-bb19654b6889 admin admin] PATH_INFO: `/v3/projects/5a4e7bcbe40d46fea92c55cf4cfa701e/users/5b83d32e7e2c4fc29d742a0f3f9ffe1b/roles/3fae3d3a28e147d3b2bede2378ff79ae` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:55.265570 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df76131-ea7e-4a59-b08e-bb19654b6889 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a4e7bcbe40d46fea92c55cf4cfa701e, user_id=5b83d32e7e2c4fc29d742a0f3f9ffe1b, role_id=3fae3d3a28e147d3b2bede2378ff79ae)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:55.271776 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df76131-ea7e-4a59-b08e-bb19654b6889 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:55.314500 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1037/2053] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 13 15:29:55 2022] PUT /identity/v3/projects/5a4e7bcbe40d46fea92c55cf4cfa701e/users/5b83d32e7e2c4fc29d742a0f3f9ffe1b/roles/3fae3d3a28e147d3b2bede2378ff79ae => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:29:55.317000 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fd54ac-8f6b-4ef8-b1bb-ae9ff6391444 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:55.317284 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fd54ac-8f6b-4ef8-b1bb-ae9ff6391444 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:55.317671 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fd54ac-8f6b-4ef8-b1bb-ae9ff6391444 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:55.381442 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-19fd54ac-8f6b-4ef8-b1bb-ae9ff6391444 None None] MFA Rules not processed for user `5b83d32e7e2c4fc29d742a0f3f9ffe1b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:29:55.383987 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-19fd54ac-8f6b-4ef8-b1bb-ae9ff6391444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:55.488100 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1017/2054] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:29:55 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:29:55.492562 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df76131-ea7e-4a59-b08e-bb19654b6889 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:55.590190 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df76131-ea7e-4a59-b08e-bb19654b6889 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:55.599496 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b41373-006d-44ec-b696-d92c773346df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:55.599496 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b41373-006d-44ec-b696-d92c773346df admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:55.599496 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b41373-006d-44ec-b696-d92c773346df admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:55.600565 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fd54ac-8f6b-4ef8-b1bb-ae9ff6391444 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:55.602057 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-19fd54ac-8f6b-4ef8-b1bb-ae9ff6391444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:55.602178 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b41373-006d-44ec-b696-d92c773346df admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:55.603498 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b41373-006d-44ec-b696-d92c773346df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:55.605115 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b41373-006d-44ec-b696-d92c773346df admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:55.618885 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fd54ac-8f6b-4ef8-b1bb-ae9ff6391444 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:55.624477 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ca6b56-cc51-4ebb-b383-6c4f73470058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:55.625260 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ca6b56-cc51-4ebb-b383-6c4f73470058 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:55.625622 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ca6b56-cc51-4ebb-b383-6c4f73470058 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:55.626001 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ca6b56-cc51-4ebb-b383-6c4f73470058 admin admin] PATH_INFO: `/v3/users/83b778b5a264472b92690b671d444a35` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:55.627397 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ca6b56-cc51-4ebb-b383-6c4f73470058 admin admin] RBAC: Authorizing `identity:delete_user(user_id=83b778b5a264472b92690b671d444a35)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:55.629906 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ca6b56-cc51-4ebb-b383-6c4f73470058 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:55.639899 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1038/2055] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 13 15:29:55 2022] POST /identity/v3/projects => generated 387 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:29:55.643769 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b41373-006d-44ec-b696-d92c773346df admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:55.647133 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:29:55.697045 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-29ca6b56-cc51-4ebb-b383-6c4f73470058 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83b778b5a264472b92690b671d444a35'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:55.698289 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-29ca6b56-cc51-4ebb-b383-6c4f73470058 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83b778b5a264472b92690b671d444a35'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:55.699137 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-29ca6b56-cc51-4ebb-b383-6c4f73470058 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83b778b5a264472b92690b671d444a35'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:55.710997 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-29ca6b56-cc51-4ebb-b383-6c4f73470058 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83b778b5a264472b92690b671d444a35'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:55.754362 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-29ca6b56-cc51-4ebb-b383-6c4f73470058 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83b778b5a264472b92690b671d444a35'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:55.762002 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b41373-006d-44ec-b696-d92c773346df admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:55.769369 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f1403a-c823-439e-bba4-d6f7f369ec73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:55.769713 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f1403a-c823-439e-bba4-d6f7f369ec73 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:55.774095 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f1403a-c823-439e-bba4-d6f7f369ec73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:55.774713 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f1403a-c823-439e-bba4-d6f7f369ec73 admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:55.778406 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f1403a-c823-439e-bba4-d6f7f369ec73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:55.779382 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1018/2056] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 13 15:29:55 2022] DELETE /identity/v3/users/83b778b5a264472b92690b671d444a35 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 15:29:55.781255 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f1403a-c823-439e-bba4-d6f7f369ec73 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:55.795245 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6e56e7-6cec-4113-845e-7eb877f49968 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:55.796716 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6e56e7-6cec-4113-845e-7eb877f49968 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:55.798177 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6e56e7-6cec-4113-845e-7eb877f49968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:55.842075 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1039/2057] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 13 15:29:55 2022] POST /identity/v3/users => generated 300 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 15:29:55.843345 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f1403a-c823-439e-bba4-d6f7f369ec73 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:55.858267 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-5f6e56e7-6cec-4113-845e-7eb877f49968 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:29:55.858267 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-5f6e56e7-6cec-4113-845e-7eb877f49968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:55.858525 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-60f1403a-c823-439e-bba4-d6f7f369ec73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:55.880680 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f1403a-c823-439e-bba4-d6f7f369ec73 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:55.906419 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:29:55.966823 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1019/2058] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:29:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:29:55.977634 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6e56e7-6cec-4113-845e-7eb877f49968 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:55.981016 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-5f6e56e7-6cec-4113-845e-7eb877f49968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:55.987917 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7101de9f-d7b3-4c5b-ad93-75b7af3c012a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:55.988603 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7101de9f-d7b3-4c5b-ad93-75b7af3c012a admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:55.988865 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7101de9f-d7b3-4c5b-ad93-75b7af3c012a admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:55.989141 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7101de9f-d7b3-4c5b-ad93-75b7af3c012a admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:55.989969 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7101de9f-d7b3-4c5b-ad93-75b7af3c012a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:55.991756 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7101de9f-d7b3-4c5b-ad93-75b7af3c012a admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:56.010005 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1040/2059] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:29:55 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 15:29:56.010998 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7101de9f-d7b3-4c5b-ad93-75b7af3c012a admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:56.036850 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7101de9f-d7b3-4c5b-ad93-75b7af3c012a admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:56.051282 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbc49e0-240e-4625-be78-7f4c1b8a55f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:56.051975 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbc49e0-240e-4625-be78-7f4c1b8a55f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:56.052985 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbc49e0-240e-4625-be78-7f4c1b8a55f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:56.053333 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbc49e0-240e-4625-be78-7f4c1b8a55f7 admin admin] PATH_INFO: `/v3/projects/38fb99ac00ca4406a14119e120e93d6b/users/eeb7c6665d4940328cb1341f7b8fc87b/roles/f34412ad29f1478cba775b033129f71f` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:56.100866 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6e56e7-6cec-4113-845e-7eb877f49968 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:56.104245 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbc49e0-240e-4625-be78-7f4c1b8a55f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38fb99ac00ca4406a14119e120e93d6b, user_id=eeb7c6665d4940328cb1341f7b8fc87b, role_id=f34412ad29f1478cba775b033129f71f)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:56.108383 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbc49e0-240e-4625-be78-7f4c1b8a55f7 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:56.111103 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627107e2-f6c6-476a-8edf-0e8f5989f869 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41675154bbba47388040966f75d84c3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:56.111741 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627107e2-f6c6-476a-8edf-0e8f5989f869 service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:56.112560 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627107e2-f6c6-476a-8edf-0e8f5989f869 service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:56.114718 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627107e2-f6c6-476a-8edf-0e8f5989f869 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:56.128452 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627107e2-f6c6-476a-8edf-0e8f5989f869 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:56.139317 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1041/2060] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 13 15:29:56 2022] PUT /identity/v3/projects/38fb99ac00ca4406a14119e120e93d6b/users/eeb7c6665d4940328cb1341f7b8fc87b/roles/f34412ad29f1478cba775b033129f71f => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:29:56.140542 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbc49e0-240e-4625-be78-7f4c1b8a55f7 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:56.142191 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627107e2-f6c6-476a-8edf-0e8f5989f869 service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:56.167661 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1020/2061] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:29:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 15:29:56.262794 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbc49e0-240e-4625-be78-7f4c1b8a55f7 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:56.273165 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0024ff96-2306-4488-b0ce-36991fa4ec9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:56.277133 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0024ff96-2306-4488-b0ce-36991fa4ec9f admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:56.277434 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0024ff96-2306-4488-b0ce-36991fa4ec9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:56.277742 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0024ff96-2306-4488-b0ce-36991fa4ec9f admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:56.278433 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0024ff96-2306-4488-b0ce-36991fa4ec9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:56.281002 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0024ff96-2306-4488-b0ce-36991fa4ec9f admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:56.307234 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1042/2062] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:29:56 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 15:29:56.311896 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627107e2-f6c6-476a-8edf-0e8f5989f869 service neutron] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:56.323123 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627107e2-f6c6-476a-8edf-0e8f5989f869 service neutron] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:56.329419 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5666813-3217-4946-9a51-be005218790a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:56.330193 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5666813-3217-4946-9a51-be005218790a admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:56.330498 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5666813-3217-4946-9a51-be005218790a admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:56.330833 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5666813-3217-4946-9a51-be005218790a admin admin] PATH_INFO: `/v3/projects/38fb99ac00ca4406a14119e120e93d6b/users/eeb7c6665d4940328cb1341f7b8fc87b/roles/f34412ad29f1478cba775b033129f71f` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:56.332983 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5666813-3217-4946-9a51-be005218790a admin admin] RBAC: Authorizing `identity:create_grant(project_id=38fb99ac00ca4406a14119e120e93d6b, user_id=eeb7c6665d4940328cb1341f7b8fc87b, role_id=f34412ad29f1478cba775b033129f71f)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:56.335782 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5666813-3217-4946-9a51-be005218790a admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:56.358439 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1021/2063] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 13 15:29:56 2022] PUT /identity/v3/projects/38fb99ac00ca4406a14119e120e93d6b/users/eeb7c6665d4940328cb1341f7b8fc87b/roles/f34412ad29f1478cba775b033129f71f => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 15:29:56.373244 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256988a9-58c5-45d0-8fa5-eb4b19631dfa None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:56.373398 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256988a9-58c5-45d0-8fa5-eb4b19631dfa None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:56.373789 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256988a9-58c5-45d0-8fa5-eb4b19631dfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:56.420972 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-256988a9-58c5-45d0-8fa5-eb4b19631dfa None None] MFA Rules not processed for user `eeb7c6665d4940328cb1341f7b8fc87b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:29:56.423583 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-256988a9-58c5-45d0-8fa5-eb4b19631dfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:56.533143 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1043/2064] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:29:56 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:29:56.548740 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5666813-3217-4946-9a51-be005218790a admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:56.551266 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-b5666813-3217-4946-9a51-be005218790a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:56.621528 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:29:56.692170 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5666813-3217-4946-9a51-be005218790a admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:56.697575 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4670ce0-ffc0-4960-bf2a-110fdbf370e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97acd23097d54bf7805c3cef60626ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:56.698526 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4670ce0-ffc0-4960-bf2a-110fdbf370e4 service cinder] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:56.698962 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4670ce0-ffc0-4960-bf2a-110fdbf370e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:56.699573 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4670ce0-ffc0-4960-bf2a-110fdbf370e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:56.718713 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4670ce0-ffc0-4960-bf2a-110fdbf370e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:56.722111 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4670ce0-ffc0-4960-bf2a-110fdbf370e4 service cinder] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:56.737482 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1022/2065] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:29:56 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:29:56.777516 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256988a9-58c5-45d0-8fa5-eb4b19631dfa None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:56.801865 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:29:56.865483 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4670ce0-ffc0-4960-bf2a-110fdbf370e4 service cinder] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:56.867335 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-d4670ce0-ffc0-4960-bf2a-110fdbf370e4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:56.939128 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256988a9-58c5-45d0-8fa5-eb4b19631dfa None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:56.950927 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a353abcb-1c84-41b2-bf95-bb93356c344f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:56.956440 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a353abcb-1c84-41b2-bf95-bb93356c344f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:56.956915 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a353abcb-1c84-41b2-bf95-bb93356c344f admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:56.957357 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a353abcb-1c84-41b2-bf95-bb93356c344f admin admin] PATH_INFO: `/v3/users/5b83d32e7e2c4fc29d742a0f3f9ffe1b` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:56.964110 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a353abcb-1c84-41b2-bf95-bb93356c344f admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b83d32e7e2c4fc29d742a0f3f9ffe1b)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:56.967588 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a353abcb-1c84-41b2-bf95-bb93356c344f admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:57.042952 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4670ce0-ffc0-4960-bf2a-110fdbf370e4 service cinder] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:57.059216 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29a1adc-3616-4d46-b9e9-95e9a88d3736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:57.060315 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29a1adc-3616-4d46-b9e9-95e9a88d3736 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:57.060762 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29a1adc-3616-4d46-b9e9-95e9a88d3736 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:57.061278 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29a1adc-3616-4d46-b9e9-95e9a88d3736 admin admin] PATH_INFO: `/v3/projects/6543f07c6b7041bd8151761658c14d4d` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:57.064980 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29a1adc-3616-4d46-b9e9-95e9a88d3736 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6543f07c6b7041bd8151761658c14d4d)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:57.067795 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29a1adc-3616-4d46-b9e9-95e9a88d3736 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:57.103509 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-a353abcb-1c84-41b2-bf95-bb93356c344f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b83d32e7e2c4fc29d742a0f3f9ffe1b'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:57.104445 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-a353abcb-1c84-41b2-bf95-bb93356c344f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b83d32e7e2c4fc29d742a0f3f9ffe1b'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:57.105848 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-a353abcb-1c84-41b2-bf95-bb93356c344f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b83d32e7e2c4fc29d742a0f3f9ffe1b'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:57.128235 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-a353abcb-1c84-41b2-bf95-bb93356c344f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b83d32e7e2c4fc29d742a0f3f9ffe1b'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:57.146033 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-a353abcb-1c84-41b2-bf95-bb93356c344f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b83d32e7e2c4fc29d742a0f3f9ffe1b'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:57.166678 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1044/2066] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 13 15:29:56 2022] DELETE /identity/v3/users/5b83d32e7e2c4fc29d742a0f3f9ffe1b => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:29:57.172072 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa88a11-c3ab-4aac-9759-6b6170075c05 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:57.172373 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa88a11-c3ab-4aac-9759-6b6170075c05 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:57.172830 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa88a11-c3ab-4aac-9759-6b6170075c05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:57.185437 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-c29a1adc-3616-4d46-b9e9-95e9a88d3736 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6543f07c6b7041bd8151761658c14d4d', 'request_id': 'req-c29a1adc-3616-4d46-b9e9-95e9a88d3736'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:57.200209 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-efa88a11-c3ab-4aac-9759-6b6170075c05 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:29:57.201578 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-efa88a11-c3ab-4aac-9759-6b6170075c05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:57.203019 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-c29a1adc-3616-4d46-b9e9-95e9a88d3736 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6543f07c6b7041bd8151761658c14d4d', 'request_id': 'req-c29a1adc-3616-4d46-b9e9-95e9a88d3736'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:57.214046 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-c29a1adc-3616-4d46-b9e9-95e9a88d3736 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6543f07c6b7041bd8151761658c14d4d', 'request_id': 'req-c29a1adc-3616-4d46-b9e9-95e9a88d3736'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:57.246927 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-c29a1adc-3616-4d46-b9e9-95e9a88d3736 admin admin] The token cache is being invalidate because project 6543f07c6b7041bd8151761658c14d4d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 15:29:57.247391 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-c29a1adc-3616-4d46-b9e9-95e9a88d3736 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:57.248060 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-c29a1adc-3616-4d46-b9e9-95e9a88d3736 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:57.254335 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1023/2067] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 13 15:29:56 2022] DELETE /identity/v3/projects/6543f07c6b7041bd8151761658c14d4d => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:29:57.268374 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29a1adc-3616-4d46-b9e9-95e9a88d3736 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:57.271175 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-c29a1adc-3616-4d46-b9e9-95e9a88d3736 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:57.326590 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1045/2068] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:29:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:29:57.385270 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa88a11-c3ab-4aac-9759-6b6170075c05 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:57.386896 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-efa88a11-c3ab-4aac-9759-6b6170075c05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:57.400210 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:29:57.435133 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29a1adc-3616-4d46-b9e9-95e9a88d3736 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:57.448555 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f03e3a2-4052-4e1e-91da-a0d1a8474b14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:57.450196 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f03e3a2-4052-4e1e-91da-a0d1a8474b14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:57.451142 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f03e3a2-4052-4e1e-91da-a0d1a8474b14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:57.451823 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f03e3a2-4052-4e1e-91da-a0d1a8474b14 admin admin] PATH_INFO: `/v3/users/6e05a2d6b2ec4d17a1ebec70497c3332` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:57.455346 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f03e3a2-4052-4e1e-91da-a0d1a8474b14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e05a2d6b2ec4d17a1ebec70497c3332)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:57.460109 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f03e3a2-4052-4e1e-91da-a0d1a8474b14 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:57.523079 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:29:57.545624 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa88a11-c3ab-4aac-9759-6b6170075c05 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:57.552042 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbe8421-f223-4511-a80e-d3cfec87fdf4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41675154bbba47388040966f75d84c3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:57.553055 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbe8421-f223-4511-a80e-d3cfec87fdf4 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:57.553247 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbe8421-f223-4511-a80e-d3cfec87fdf4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:57.553510 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbe8421-f223-4511-a80e-d3cfec87fdf4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:57.565036 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbe8421-f223-4511-a80e-d3cfec87fdf4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:57.567094 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbe8421-f223-4511-a80e-d3cfec87fdf4 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:57.588441 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-5f03e3a2-4052-4e1e-91da-a0d1a8474b14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e05a2d6b2ec4d17a1ebec70497c3332'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:57.588801 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1046/2069] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:29:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 15:29:57.589161 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-5f03e3a2-4052-4e1e-91da-a0d1a8474b14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e05a2d6b2ec4d17a1ebec70497c3332'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:57.590725 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-5f03e3a2-4052-4e1e-91da-a0d1a8474b14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e05a2d6b2ec4d17a1ebec70497c3332'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:57.602987 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-5f03e3a2-4052-4e1e-91da-a0d1a8474b14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e05a2d6b2ec4d17a1ebec70497c3332'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:57.623299 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-5f03e3a2-4052-4e1e-91da-a0d1a8474b14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e05a2d6b2ec4d17a1ebec70497c3332'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:57.645540 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213732a7-2003-4f2d-ab72-353d80957fc0 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:57.645990 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213732a7-2003-4f2d-ab72-353d80957fc0 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:57.646369 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213732a7-2003-4f2d-ab72-353d80957fc0 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:57.648271 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1047/2070] 10.222.0.27 () {54 vars in 921 bytes} [Tue Sep 13 15:29:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:29:57.649972 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1024/2071] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 13 15:29:57 2022] DELETE /identity/v3/users/6e05a2d6b2ec4d17a1ebec70497c3332 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:29:57.698390 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af66bc6-787a-4eb1-8203-7399f400a876 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:57.698826 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af66bc6-787a-4eb1-8203-7399f400a876 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:57.699347 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af66bc6-787a-4eb1-8203-7399f400a876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:57.736209 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-4af66bc6-787a-4eb1-8203-7399f400a876 None None] MFA Rules not processed for user `5b56f96cb3184a3ba82c8a0c3427e268`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:29:57.738541 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-4af66bc6-787a-4eb1-8203-7399f400a876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:57.779735 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f03e3a2-4052-4e1e-91da-a0d1a8474b14 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:57.781291 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-5f03e3a2-4052-4e1e-91da-a0d1a8474b14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:57.825907 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1048/2072] 10.222.0.27 () {58 vars in 1018 bytes} [Tue Sep 13 15:29:57 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:29:57.838330 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4809469c-f7bf-46f2-b4a3-6883289b981d None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:57.838695 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4809469c-f7bf-46f2-b4a3-6883289b981d None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:57.839257 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4809469c-f7bf-46f2-b4a3-6883289b981d None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:57.840687 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1049/2073] 10.222.0.27 () {54 vars in 961 bytes} [Tue Sep 13 15:29:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 15:29:57.847412 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337bc541-3c12-406f-9fdf-c5250aefee63 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:57.847703 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337bc541-3c12-406f-9fdf-c5250aefee63 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:57.847970 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337bc541-3c12-406f-9fdf-c5250aefee63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:57.870797 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f03e3a2-4052-4e1e-91da-a0d1a8474b14 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:57.873279 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-337bc541-3c12-406f-9fdf-c5250aefee63 None None] MFA Rules not processed for user `5b56f96cb3184a3ba82c8a0c3427e268`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:29:57.874926 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-337bc541-3c12-406f-9fdf-c5250aefee63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:57.876322 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0737fb51-f89e-47c6-a82e-fa937689f583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:57.877300 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0737fb51-f89e-47c6-a82e-fa937689f583 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:57.877647 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0737fb51-f89e-47c6-a82e-fa937689f583 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:57.878092 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0737fb51-f89e-47c6-a82e-fa937689f583 admin admin] PATH_INFO: `/v3/users/7d103d2fe211474ab70df0aac0632c30` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:57.879589 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0737fb51-f89e-47c6-a82e-fa937689f583 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d103d2fe211474ab70df0aac0632c30)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:57.881538 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0737fb51-f89e-47c6-a82e-fa937689f583 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:57.886918 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1050/2074] 10.222.0.27 () {58 vars in 1058 bytes} [Tue Sep 13 15:29:57 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 15:29:57.897242 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337bc541-3c12-406f-9fdf-c5250aefee63 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:57.908077 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337bc541-3c12-406f-9fdf-c5250aefee63 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:57.915165 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4e10cc-cfaa-4386-aba7-14de8fed8a37 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b56f96cb3184a3ba82c8a0c3427e268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:57.916078 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4e10cc-cfaa-4386-aba7-14de8fed8a37 service placement] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:57.916722 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4e10cc-cfaa-4386-aba7-14de8fed8a37 service placement] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:57.917076 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4e10cc-cfaa-4386-aba7-14de8fed8a37 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:57.926964 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4e10cc-cfaa-4386-aba7-14de8fed8a37 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:57.928664 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4e10cc-cfaa-4386-aba7-14de8fed8a37 service placement] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:57.942361 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-0737fb51-f89e-47c6-a82e-fa937689f583 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d103d2fe211474ab70df0aac0632c30'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:57.942554 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1051/2075] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:29:57 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:29:57.943489 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-0737fb51-f89e-47c6-a82e-fa937689f583 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d103d2fe211474ab70df0aac0632c30'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:57.944301 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-0737fb51-f89e-47c6-a82e-fa937689f583 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d103d2fe211474ab70df0aac0632c30'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:57.953011 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-0737fb51-f89e-47c6-a82e-fa937689f583 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d103d2fe211474ab70df0aac0632c30'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:57.992668 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-0737fb51-f89e-47c6-a82e-fa937689f583 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d103d2fe211474ab70df0aac0632c30'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:57.994521 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:29:58.011194 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1025/2076] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 13 15:29:57 2022] DELETE /identity/v3/users/7d103d2fe211474ab70df0aac0632c30 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 15:29:58.197363 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4e10cc-cfaa-4386-aba7-14de8fed8a37 service placement] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:58.224914 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4e10cc-cfaa-4386-aba7-14de8fed8a37 service placement] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:58.319743 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de143e1-2d84-47d7-9e22-d7c7f6abb1ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:58.321298 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de143e1-2d84-47d7-9e22-d7c7f6abb1ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:58.321599 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de143e1-2d84-47d7-9e22-d7c7f6abb1ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:58.321895 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de143e1-2d84-47d7-9e22-d7c7f6abb1ef admin admin] PATH_INFO: `/v3/projects/ff7c18fa3fc74931908e5736f7e4e0aa` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:58.323768 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de143e1-2d84-47d7-9e22-d7c7f6abb1ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff7c18fa3fc74931908e5736f7e4e0aa)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:58.326742 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de143e1-2d84-47d7-9e22-d7c7f6abb1ef admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:58.384327 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-8de143e1-2d84-47d7-9e22-d7c7f6abb1ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff7c18fa3fc74931908e5736f7e4e0aa', 'request_id': 'req-8de143e1-2d84-47d7-9e22-d7c7f6abb1ef'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:58.390533 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-8de143e1-2d84-47d7-9e22-d7c7f6abb1ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff7c18fa3fc74931908e5736f7e4e0aa', 'request_id': 'req-8de143e1-2d84-47d7-9e22-d7c7f6abb1ef'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:58.395110 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:29:58.399520 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-8de143e1-2d84-47d7-9e22-d7c7f6abb1ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff7c18fa3fc74931908e5736f7e4e0aa', 'request_id': 'req-8de143e1-2d84-47d7-9e22-d7c7f6abb1ef'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:58.412126 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-8de143e1-2d84-47d7-9e22-d7c7f6abb1ef admin admin] The token cache is being invalidate because project ff7c18fa3fc74931908e5736f7e4e0aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 15:29:58.412497 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-8de143e1-2d84-47d7-9e22-d7c7f6abb1ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:58.413344 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-8de143e1-2d84-47d7-9e22-d7c7f6abb1ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:58.415354 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1052/2077] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 13 15:29:58 2022] DELETE /identity/v3/projects/ff7c18fa3fc74931908e5736f7e4e0aa => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:29:58.420643 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa607b9f-893b-4658-9af5-0d06abe468b2 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:58.421189 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa607b9f-893b-4658-9af5-0d06abe468b2 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:58.421189 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa607b9f-893b-4658-9af5-0d06abe468b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:58.443052 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-aa607b9f-893b-4658-9af5-0d06abe468b2 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:29:58.444303 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-aa607b9f-893b-4658-9af5-0d06abe468b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:58.461013 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de143e1-2d84-47d7-9e22-d7c7f6abb1ef admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:58.464534 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-8de143e1-2d84-47d7-9e22-d7c7f6abb1ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:58.536434 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1026/2078] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:29:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:29:58.537081 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa607b9f-893b-4658-9af5-0d06abe468b2 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:58.538383 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-aa607b9f-893b-4658-9af5-0d06abe468b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:58.547573 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de143e1-2d84-47d7-9e22-d7c7f6abb1ef admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:58.550309 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa607b9f-893b-4658-9af5-0d06abe468b2 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:58.552456 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e983a7f-b74a-4264-9ca8-18b1129d7225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:58.553210 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e983a7f-b74a-4264-9ca8-18b1129d7225 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:58.553500 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e983a7f-b74a-4264-9ca8-18b1129d7225 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:58.553849 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e983a7f-b74a-4264-9ca8-18b1129d7225 admin admin] PATH_INFO: `/v3/projects/a281d192f635452f9725190279c26afd` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:58.554932 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e983a7f-b74a-4264-9ca8-18b1129d7225 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a281d192f635452f9725190279c26afd)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:58.555141 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccc67da-e82c-48f0-adcf-e0c5f46f05cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:58.555792 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccc67da-e82c-48f0-adcf-e0c5f46f05cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:58.556072 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccc67da-e82c-48f0-adcf-e0c5f46f05cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:58.556343 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccc67da-e82c-48f0-adcf-e0c5f46f05cd admin admin] PATH_INFO: `/v3/projects/5a4e7bcbe40d46fea92c55cf4cfa701e` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:58.556841 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e983a7f-b74a-4264-9ca8-18b1129d7225 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:58.557517 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccc67da-e82c-48f0-adcf-e0c5f46f05cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a4e7bcbe40d46fea92c55cf4cfa701e)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:58.559482 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccc67da-e82c-48f0-adcf-e0c5f46f05cd admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:58.607124 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-8e983a7f-b74a-4264-9ca8-18b1129d7225 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a281d192f635452f9725190279c26afd', 'request_id': 'req-8e983a7f-b74a-4264-9ca8-18b1129d7225'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:58.608646 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-6ccc67da-e82c-48f0-adcf-e0c5f46f05cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a4e7bcbe40d46fea92c55cf4cfa701e', 'request_id': 'req-6ccc67da-e82c-48f0-adcf-e0c5f46f05cd'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:58.613683 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-8e983a7f-b74a-4264-9ca8-18b1129d7225 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a281d192f635452f9725190279c26afd', 'request_id': 'req-8e983a7f-b74a-4264-9ca8-18b1129d7225'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:58.615388 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-6ccc67da-e82c-48f0-adcf-e0c5f46f05cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a4e7bcbe40d46fea92c55cf4cfa701e', 'request_id': 'req-6ccc67da-e82c-48f0-adcf-e0c5f46f05cd'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:58.621243 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-6ccc67da-e82c-48f0-adcf-e0c5f46f05cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a4e7bcbe40d46fea92c55cf4cfa701e', 'request_id': 'req-6ccc67da-e82c-48f0-adcf-e0c5f46f05cd'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:58.621587 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-8e983a7f-b74a-4264-9ca8-18b1129d7225 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a281d192f635452f9725190279c26afd', 'request_id': 'req-8e983a7f-b74a-4264-9ca8-18b1129d7225'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:58.633479 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-8e983a7f-b74a-4264-9ca8-18b1129d7225 admin admin] The token cache is being invalidate because project a281d192f635452f9725190279c26afd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 15:29:58.633654 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-6ccc67da-e82c-48f0-adcf-e0c5f46f05cd admin admin] The token cache is being invalidate because project 5a4e7bcbe40d46fea92c55cf4cfa701e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 15:29:58.633811 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-8e983a7f-b74a-4264-9ca8-18b1129d7225 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:58.633953 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-6ccc67da-e82c-48f0-adcf-e0c5f46f05cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:58.634455 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-8e983a7f-b74a-4264-9ca8-18b1129d7225 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:58.634596 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-6ccc67da-e82c-48f0-adcf-e0c5f46f05cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:58.635975 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1053/2079] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 13 15:29:58 2022] DELETE /identity/v3/projects/a281d192f635452f9725190279c26afd => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:29:58.636120 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1027/2080] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 13 15:29:58 2022] DELETE /identity/v3/projects/5a4e7bcbe40d46fea92c55cf4cfa701e => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:29:58.639051 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b42878b-f278-4974-a1b2-5669a83d154d None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:58.639051 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b42878b-f278-4974-a1b2-5669a83d154d None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:58.639051 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b42878b-f278-4974-a1b2-5669a83d154d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:58.639992 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccc67da-e82c-48f0-adcf-e0c5f46f05cd admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:58.641317 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-6ccc67da-e82c-48f0-adcf-e0c5f46f05cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:58.657689 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-9b42878b-f278-4974-a1b2-5669a83d154d None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:29:58.659455 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-9b42878b-f278-4974-a1b2-5669a83d154d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:58.712121 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccc67da-e82c-48f0-adcf-e0c5f46f05cd admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:58.719863 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cbf46c-0172-4052-9bac-96fbc6edf6a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:58.720400 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cbf46c-0172-4052-9bac-96fbc6edf6a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:58.720684 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cbf46c-0172-4052-9bac-96fbc6edf6a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:58.720964 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cbf46c-0172-4052-9bac-96fbc6edf6a7 admin admin] PATH_INFO: `/v3/users/eeb7c6665d4940328cb1341f7b8fc87b` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:58.723053 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cbf46c-0172-4052-9bac-96fbc6edf6a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eeb7c6665d4940328cb1341f7b8fc87b)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:58.726018 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cbf46c-0172-4052-9bac-96fbc6edf6a7 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:58.734888 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1054/2081] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:29:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:29:58.736475 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b42878b-f278-4974-a1b2-5669a83d154d None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:58.737362 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-9b42878b-f278-4974-a1b2-5669a83d154d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:58.748692 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:INSERT=2,keystone:DELETE=9,keystone:SELECT=89 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:29:58.751349 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b42878b-f278-4974-a1b2-5669a83d154d None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:58.759145 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21c8b01-0410-4f8d-9fc5-d2c2c3fb60a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:58.759923 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21c8b01-0410-4f8d-9fc5-d2c2c3fb60a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:58.760212 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21c8b01-0410-4f8d-9fc5-d2c2c3fb60a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:58.760570 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21c8b01-0410-4f8d-9fc5-d2c2c3fb60a2 admin admin] PATH_INFO: `/v3/users/2905928f5503405e83bf552aafa3de6b` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:58.762813 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21c8b01-0410-4f8d-9fc5-d2c2c3fb60a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2905928f5503405e83bf552aafa3de6b)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:58.764587 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21c8b01-0410-4f8d-9fc5-d2c2c3fb60a2 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:58.785279 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:29:58.820319 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-30cbf46c-0172-4052-9bac-96fbc6edf6a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eeb7c6665d4940328cb1341f7b8fc87b'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:58.822991 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-30cbf46c-0172-4052-9bac-96fbc6edf6a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eeb7c6665d4940328cb1341f7b8fc87b'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:58.823656 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-30cbf46c-0172-4052-9bac-96fbc6edf6a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eeb7c6665d4940328cb1341f7b8fc87b'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:58.832892 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-30cbf46c-0172-4052-9bac-96fbc6edf6a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eeb7c6665d4940328cb1341f7b8fc87b'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:58.848161 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-30cbf46c-0172-4052-9bac-96fbc6edf6a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eeb7c6665d4940328cb1341f7b8fc87b'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:58.871677 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1028/2082] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 13 15:29:58 2022] DELETE /identity/v3/users/eeb7c6665d4940328cb1341f7b8fc87b => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 15:29:58.874803 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cbf46c-0172-4052-9bac-96fbc6edf6a7 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:58.877022 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-e21c8b01-0410-4f8d-9fc5-d2c2c3fb60a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2905928f5503405e83bf552aafa3de6b'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:58.879287 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-e21c8b01-0410-4f8d-9fc5-d2c2c3fb60a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2905928f5503405e83bf552aafa3de6b'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:58.880176 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-e21c8b01-0410-4f8d-9fc5-d2c2c3fb60a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2905928f5503405e83bf552aafa3de6b'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:58.881948 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-30cbf46c-0172-4052-9bac-96fbc6edf6a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:58.890130 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-e21c8b01-0410-4f8d-9fc5-d2c2c3fb60a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2905928f5503405e83bf552aafa3de6b'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:58.905149 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-e21c8b01-0410-4f8d-9fc5-d2c2c3fb60a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2905928f5503405e83bf552aafa3de6b'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:58.931305 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1055/2083] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 13 15:29:58 2022] DELETE /identity/v3/users/2905928f5503405e83bf552aafa3de6b => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:29:58.970306 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cbf46c-0172-4052-9bac-96fbc6edf6a7 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:59.076583 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0314a878-f6b7-4ec7-afd0-de8f6a0daf58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:59.090816 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0314a878-f6b7-4ec7-afd0-de8f6a0daf58 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:59.091081 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0314a878-f6b7-4ec7-afd0-de8f6a0daf58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:59.091371 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0314a878-f6b7-4ec7-afd0-de8f6a0daf58 admin admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:59.094030 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0314a878-f6b7-4ec7-afd0-de8f6a0daf58 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:29:59.094587 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0314a878-f6b7-4ec7-afd0-de8f6a0daf58 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:59.096757 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0314a878-f6b7-4ec7-afd0-de8f6a0daf58 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:59.113188 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1029/2084] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Sep 13 15:29:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:29:59.117778 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21c8b01-0410-4f8d-9fc5-d2c2c3fb60a2 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:59.119429 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-e21c8b01-0410-4f8d-9fc5-d2c2c3fb60a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:59.140097 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21c8b01-0410-4f8d-9fc5-d2c2c3fb60a2 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:59.146248 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e8e6a9-cbb7-4e3c-97af-33d0907045db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:59.147369 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e8e6a9-cbb7-4e3c-97af-33d0907045db admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:59.147872 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e8e6a9-cbb7-4e3c-97af-33d0907045db admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:59.148402 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e8e6a9-cbb7-4e3c-97af-33d0907045db admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:59.149507 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e8e6a9-cbb7-4e3c-97af-33d0907045db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:59.152094 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e8e6a9-cbb7-4e3c-97af-33d0907045db admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:59.213735 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1056/2085] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 13 15:29:59 2022] POST /identity/v3/projects => generated 403 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:29:59.214422 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0314a878-f6b7-4ec7-afd0-de8f6a0daf58 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:59.227202 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0314a878-f6b7-4ec7-afd0-de8f6a0daf58 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:59.293288 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:29:59.342053 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2dd597-c1d4-4f97-be7e-c1eddb974a6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:59.343444 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2dd597-c1d4-4f97-be7e-c1eddb974a6b admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:59.343901 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2dd597-c1d4-4f97-be7e-c1eddb974a6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:59.344020 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2dd597-c1d4-4f97-be7e-c1eddb974a6b admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:59.345581 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2dd597-c1d4-4f97-be7e-c1eddb974a6b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:59.348141 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2dd597-c1d4-4f97-be7e-c1eddb974a6b admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:59.375347 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1030/2086] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 13 15:29:59 2022] POST /identity/v3/users => generated 302 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 15:29:59.379761 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e8e6a9-cbb7-4e3c-97af-33d0907045db admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:59.398189 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e8e6a9-cbb7-4e3c-97af-33d0907045db admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:59.404013 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91ff810-babd-4fd5-8e65-7a3a3f92e713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:59.405037 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91ff810-babd-4fd5-8e65-7a3a3f92e713 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:59.405544 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91ff810-babd-4fd5-8e65-7a3a3f92e713 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:59.406063 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91ff810-babd-4fd5-8e65-7a3a3f92e713 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:59.406943 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91ff810-babd-4fd5-8e65-7a3a3f92e713 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:59.408852 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91ff810-babd-4fd5-8e65-7a3a3f92e713 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:59.431926 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2dd597-c1d4-4f97-be7e-c1eddb974a6b admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:59.432942 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1057/2087] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:29:59 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 15:29:59.451019 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2dd597-c1d4-4f97-be7e-c1eddb974a6b admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:59.459273 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae9e02a-370d-47d8-ab60-c853c4422394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:59.459810 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae9e02a-370d-47d8-ab60-c853c4422394 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:59.460182 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae9e02a-370d-47d8-ab60-c853c4422394 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:59.460650 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae9e02a-370d-47d8-ab60-c853c4422394 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:59.461328 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae9e02a-370d-47d8-ab60-c853c4422394 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:59.464008 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae9e02a-370d-47d8-ab60-c853c4422394 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:59.482966 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1031/2088] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:29:59 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 15:29:59.487852 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91ff810-babd-4fd5-8e65-7a3a3f92e713 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:59.502502 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91ff810-babd-4fd5-8e65-7a3a3f92e713 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:59.509870 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8427e3-2a99-4cea-a99c-9f4693f6404f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:59.510365 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8427e3-2a99-4cea-a99c-9f4693f6404f admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:59.510649 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8427e3-2a99-4cea-a99c-9f4693f6404f admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:59.511027 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8427e3-2a99-4cea-a99c-9f4693f6404f admin admin] PATH_INFO: `/v3/projects/2c71ad778f4b4f91be63013b6407678e/users/183a5b768dbc4c859b8a6b337918b148/roles/3fae3d3a28e147d3b2bede2378ff79ae` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:59.514369 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae9e02a-370d-47d8-ab60-c853c4422394 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:59.517283 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-5ae9e02a-370d-47d8-ab60-c853c4422394 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:59.531056 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8427e3-2a99-4cea-a99c-9f4693f6404f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c71ad778f4b4f91be63013b6407678e, user_id=183a5b768dbc4c859b8a6b337918b148, role_id=3fae3d3a28e147d3b2bede2378ff79ae)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:59.534271 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8427e3-2a99-4cea-a99c-9f4693f6404f admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:59.537643 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae9e02a-370d-47d8-ab60-c853c4422394 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:59.545433 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d88d72-ce7d-446c-9dcf-6ef2b7c18fc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:59.546799 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d88d72-ce7d-446c-9dcf-6ef2b7c18fc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:59.547324 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d88d72-ce7d-446c-9dcf-6ef2b7c18fc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:59.547809 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d88d72-ce7d-446c-9dcf-6ef2b7c18fc8 admin admin] PATH_INFO: `/v3/projects/38fb99ac00ca4406a14119e120e93d6b` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:59.550764 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d88d72-ce7d-446c-9dcf-6ef2b7c18fc8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=38fb99ac00ca4406a14119e120e93d6b)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:59.553187 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d88d72-ce7d-446c-9dcf-6ef2b7c18fc8 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:59.561249 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1058/2089] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 13 15:29:59 2022] PUT /identity/v3/projects/2c71ad778f4b4f91be63013b6407678e/users/183a5b768dbc4c859b8a6b337918b148/roles/3fae3d3a28e147d3b2bede2378ff79ae => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:29:59.562895 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fb472e-381f-4c28-91cb-b816d4680456 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:59.563193 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fb472e-381f-4c28-91cb-b816d4680456 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:59.563468 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fb472e-381f-4c28-91cb-b816d4680456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:59.597278 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-85fb472e-381f-4c28-91cb-b816d4680456 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:29:59.598546 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-85fb472e-381f-4c28-91cb-b816d4680456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:59.653023 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-43d88d72-ce7d-446c-9dcf-6ef2b7c18fc8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38fb99ac00ca4406a14119e120e93d6b', 'request_id': 'req-43d88d72-ce7d-446c-9dcf-6ef2b7c18fc8'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:59.662512 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-43d88d72-ce7d-446c-9dcf-6ef2b7c18fc8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38fb99ac00ca4406a14119e120e93d6b', 'request_id': 'req-43d88d72-ce7d-446c-9dcf-6ef2b7c18fc8'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:59.669596 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-43d88d72-ce7d-446c-9dcf-6ef2b7c18fc8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38fb99ac00ca4406a14119e120e93d6b', 'request_id': 'req-43d88d72-ce7d-446c-9dcf-6ef2b7c18fc8'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:59.681591 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1059/2090] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:29:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:29:59.682603 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fb472e-381f-4c28-91cb-b816d4680456 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:59.683913 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-85fb472e-381f-4c28-91cb-b816d4680456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:59.699563 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-43d88d72-ce7d-446c-9dcf-6ef2b7c18fc8 admin admin] The token cache is being invalidate because project 38fb99ac00ca4406a14119e120e93d6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 15:29:59.699870 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-43d88d72-ce7d-446c-9dcf-6ef2b7c18fc8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:59.700630 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-43d88d72-ce7d-446c-9dcf-6ef2b7c18fc8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:59.706838 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1032/2091] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 13 15:29:59 2022] DELETE /identity/v3/projects/38fb99ac00ca4406a14119e120e93d6b => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 15:29:59.707720 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d88d72-ce7d-446c-9dcf-6ef2b7c18fc8 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:59.711831 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-43d88d72-ce7d-446c-9dcf-6ef2b7c18fc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:59.716579 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fb472e-381f-4c28-91cb-b816d4680456 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:59.759430 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:29:59.791478 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d88d72-ce7d-446c-9dcf-6ef2b7c18fc8 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:59.795122 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c1277d-8745-4740-ba20-6d5fa9fb062a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:59.796187 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c1277d-8745-4740-ba20-6d5fa9fb062a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:59.796187 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c1277d-8745-4740-ba20-6d5fa9fb062a admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:59.796402 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c1277d-8745-4740-ba20-6d5fa9fb062a admin admin] PATH_INFO: `/v3/projects/429e0eafd10e4c4db79106d97b5e0eb9` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:59.797440 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c1277d-8745-4740-ba20-6d5fa9fb062a admin admin] RBAC: Authorizing `identity:delete_project(project_id=429e0eafd10e4c4db79106d97b5e0eb9)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:59.798032 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3943ddc8-fc2b-4191-b311-c0a3e9387ed2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41675154bbba47388040966f75d84c3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:59.798885 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3943ddc8-fc2b-4191-b311-c0a3e9387ed2 service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:59.799441 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c1277d-8745-4740-ba20-6d5fa9fb062a admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:59.799608 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3943ddc8-fc2b-4191-b311-c0a3e9387ed2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:59.800079 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3943ddc8-fc2b-4191-b311-c0a3e9387ed2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:59.802333 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-3943ddc8-fc2b-4191-b311-c0a3e9387ed2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:59.814607 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3943ddc8-fc2b-4191-b311-c0a3e9387ed2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:29:59.816117 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3943ddc8-fc2b-4191-b311-c0a3e9387ed2 service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:29:59.826107 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1033/2092] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:29:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:29:59.827606 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d23aab-9df9-4382-9473-bcb78f633df2 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:59.827898 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d23aab-9df9-4382-9473-bcb78f633df2 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:59.828176 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d23aab-9df9-4382-9473-bcb78f633df2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:59.863872 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-e6c1277d-8745-4740-ba20-6d5fa9fb062a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '429e0eafd10e4c4db79106d97b5e0eb9', 'request_id': 'req-e6c1277d-8745-4740-ba20-6d5fa9fb062a'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:59.864463 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-a2d23aab-9df9-4382-9473-bcb78f633df2 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:29:59.867587 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-a2d23aab-9df9-4382-9473-bcb78f633df2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:59.871735 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-e6c1277d-8745-4740-ba20-6d5fa9fb062a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '429e0eafd10e4c4db79106d97b5e0eb9', 'request_id': 'req-e6c1277d-8745-4740-ba20-6d5fa9fb062a'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:59.884404 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-e6c1277d-8745-4740-ba20-6d5fa9fb062a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '429e0eafd10e4c4db79106d97b5e0eb9', 'request_id': 'req-e6c1277d-8745-4740-ba20-6d5fa9fb062a'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:59.903831 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-e6c1277d-8745-4740-ba20-6d5fa9fb062a admin admin] The token cache is being invalidate because project 429e0eafd10e4c4db79106d97b5e0eb9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 15:29:59.904555 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-e6c1277d-8745-4740-ba20-6d5fa9fb062a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:59.905461 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-e6c1277d-8745-4740-ba20-6d5fa9fb062a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:29:59.907522 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1060/2093] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 13 15:29:59 2022] DELETE /identity/v3/projects/429e0eafd10e4c4db79106d97b5e0eb9 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:29:59.915491 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bce563-f418-4128-aac6-b9218a50a687 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:59.915849 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bce563-f418-4128-aac6-b9218a50a687 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:59.916132 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bce563-f418-4128-aac6-b9218a50a687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:59.938170 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:29:59.940399 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-d1bce563-f418-4128-aac6-b9218a50a687 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:29:59.941651 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-d1bce563-f418-4128-aac6-b9218a50a687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:59.974068 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1034/2094] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:29:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:29:59.975175 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d23aab-9df9-4382-9473-bcb78f633df2 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:29:59.976655 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-a2d23aab-9df9-4382-9473-bcb78f633df2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:29:59.990181 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d23aab-9df9-4382-9473-bcb78f633df2 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:29:59.996304 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292c4f4d-d932-4c91-890a-5ef00ae232c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:29:59.997222 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292c4f4d-d932-4c91-890a-5ef00ae232c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:29:59.997337 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292c4f4d-d932-4c91-890a-5ef00ae232c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:29:59.997618 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292c4f4d-d932-4c91-890a-5ef00ae232c5 admin admin] PATH_INFO: `/v3/users/c703cbe5dafd462aa6cb94621a3372a3` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:29:59.998906 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292c4f4d-d932-4c91-890a-5ef00ae232c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c703cbe5dafd462aa6cb94621a3372a3)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:00.001107 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292c4f4d-d932-4c91-890a-5ef00ae232c5 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:00.034392 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1061/2095] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:29:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 15:30:00.036874 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3354b638-b401-4489-bcfe-abd25adc5fb3 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:00.037257 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3354b638-b401-4489-bcfe-abd25adc5fb3 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:00.037499 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3354b638-b401-4489-bcfe-abd25adc5fb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:00.062120 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-3354b638-b401-4489-bcfe-abd25adc5fb3 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:30:00.062354 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-292c4f4d-d932-4c91-890a-5ef00ae232c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c703cbe5dafd462aa6cb94621a3372a3'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:00.063106 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-292c4f4d-d932-4c91-890a-5ef00ae232c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c703cbe5dafd462aa6cb94621a3372a3'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:00.063347 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-3354b638-b401-4489-bcfe-abd25adc5fb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:00.063456 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-292c4f4d-d932-4c91-890a-5ef00ae232c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c703cbe5dafd462aa6cb94621a3372a3'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:00.072759 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-292c4f4d-d932-4c91-890a-5ef00ae232c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c703cbe5dafd462aa6cb94621a3372a3'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:00.075737 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1062/2096] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:30:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:30:00.077303 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e2d5ef-edde-4067-a603-e7725d63a2c1 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:00.077596 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e2d5ef-edde-4067-a603-e7725d63a2c1 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:00.077900 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e2d5ef-edde-4067-a603-e7725d63a2c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:00.089491 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-292c4f4d-d932-4c91-890a-5ef00ae232c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c703cbe5dafd462aa6cb94621a3372a3'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:00.099556 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-88e2d5ef-edde-4067-a603-e7725d63a2c1 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:30:00.100875 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-88e2d5ef-edde-4067-a603-e7725d63a2c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:00.108720 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1035/2097] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 13 15:29:59 2022] DELETE /identity/v3/users/c703cbe5dafd462aa6cb94621a3372a3 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:30:00.109594 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292c4f4d-d932-4c91-890a-5ef00ae232c5 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:00.114155 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1063/2098] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:30:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:30:00.115503 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41587851-3a42-4a31-99ca-20db33c89fc7 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:00.115792 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41587851-3a42-4a31-99ca-20db33c89fc7 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:00.116070 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41587851-3a42-4a31-99ca-20db33c89fc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:00.136803 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-41587851-3a42-4a31-99ca-20db33c89fc7 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:30:00.138145 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-41587851-3a42-4a31-99ca-20db33c89fc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:00.189794 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:30:00.198296 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292c4f4d-d932-4c91-890a-5ef00ae232c5 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:00.211460 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f7c1f8-1462-40fa-b2d2-d0e71e41a36e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:00.212293 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f7c1f8-1462-40fa-b2d2-d0e71e41a36e admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:00.212697 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f7c1f8-1462-40fa-b2d2-d0e71e41a36e admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:00.213040 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f7c1f8-1462-40fa-b2d2-d0e71e41a36e admin admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:00.213979 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f7c1f8-1462-40fa-b2d2-d0e71e41a36e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:30:00.214508 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f7c1f8-1462-40fa-b2d2-d0e71e41a36e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:00.216140 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1064/2099] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:30:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:30:00.217678 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f7c1f8-1462-40fa-b2d2-d0e71e41a36e admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:00.220421 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41587851-3a42-4a31-99ca-20db33c89fc7 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:00.233463 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41587851-3a42-4a31-99ca-20db33c89fc7 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:00.237813 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1036/2100] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Sep 13 15:30:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:30:00.239326 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f7c1f8-1462-40fa-b2d2-d0e71e41a36e admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:00.241321 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-e8f7c1f8-1462-40fa-b2d2-d0e71e41a36e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:00.242138 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925cd1ee-4ea2-413a-a820-026ae1cc5d33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:00.243215 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925cd1ee-4ea2-413a-a820-026ae1cc5d33 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:00.243722 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925cd1ee-4ea2-413a-a820-026ae1cc5d33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:00.244349 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925cd1ee-4ea2-413a-a820-026ae1cc5d33 admin admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:00.245033 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925cd1ee-4ea2-413a-a820-026ae1cc5d33 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:30:00.245453 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925cd1ee-4ea2-413a-a820-026ae1cc5d33 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:00.247744 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925cd1ee-4ea2-413a-a820-026ae1cc5d33 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:00.274374 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1065/2101] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Sep 13 15:30:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:30:00.280565 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925cd1ee-4ea2-413a-a820-026ae1cc5d33 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:00.302140 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925cd1ee-4ea2-413a-a820-026ae1cc5d33 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:00.322383 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b542b4-18d0-4f78-8ac4-5fe801d71508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:00.323025 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b542b4-18d0-4f78-8ac4-5fe801d71508 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:00.323386 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b542b4-18d0-4f78-8ac4-5fe801d71508 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:00.323590 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b542b4-18d0-4f78-8ac4-5fe801d71508 admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:00.324251 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b542b4-18d0-4f78-8ac4-5fe801d71508 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:00.326246 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b542b4-18d0-4f78-8ac4-5fe801d71508 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:00.336270 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:30:00.357125 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f7c1f8-1462-40fa-b2d2-d0e71e41a36e admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:00.361386 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6a6653-c588-4786-8f5a-e5f7c97d88a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41675154bbba47388040966f75d84c3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:00.362522 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6a6653-c588-4786-8f5a-e5f7c97d88a4 service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:00.362984 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6a6653-c588-4786-8f5a-e5f7c97d88a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:00.363490 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6a6653-c588-4786-8f5a-e5f7c97d88a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:00.378206 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6a6653-c588-4786-8f5a-e5f7c97d88a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:00.382613 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6a6653-c588-4786-8f5a-e5f7c97d88a4 service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:00.386444 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1066/2102] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 13 15:30:00 2022] POST /identity/v3/projects => generated 373 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:30:00.388431 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b542b4-18d0-4f78-8ac4-5fe801d71508 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:00.408100 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1037/2103] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:30:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:30:00.409905 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6a6653-c588-4786-8f5a-e5f7c97d88a4 service neutron] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:00.432568 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6a6653-c588-4786-8f5a-e5f7c97d88a4 service neutron] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:00.559397 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f75b202-021a-45a3-a778-29775af64926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:00.560193 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f75b202-021a-45a3-a778-29775af64926 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:00.560584 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f75b202-021a-45a3-a778-29775af64926 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:00.560961 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f75b202-021a-45a3-a778-29775af64926 admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:00.561736 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f75b202-021a-45a3-a778-29775af64926 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:00.563814 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f75b202-021a-45a3-a778-29775af64926 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:00.579250 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b542b4-18d0-4f78-8ac4-5fe801d71508 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:00.599910 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7847c02-8fb3-48df-845d-cb2908286db7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:00.601279 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7847c02-8fb3-48df-845d-cb2908286db7 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:00.603021 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7847c02-8fb3-48df-845d-cb2908286db7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:00.604178 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7847c02-8fb3-48df-845d-cb2908286db7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:00.606167 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7847c02-8fb3-48df-845d-cb2908286db7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:00.610361 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1038/2104] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 13 15:30:00 2022] POST /identity/v3/users => generated 287 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:30:00.611621 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f75b202-021a-45a3-a778-29775af64926 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:00.617857 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7847c02-8fb3-48df-845d-cb2908286db7 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:00.623742 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f75b202-021a-45a3-a778-29775af64926 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:00.629198 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f45b219-a8bf-4a55-88c8-c0de86a482ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:00.629972 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f45b219-a8bf-4a55-88c8-c0de86a482ad admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:00.630648 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f45b219-a8bf-4a55-88c8-c0de86a482ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:00.631053 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f45b219-a8bf-4a55-88c8-c0de86a482ad admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:00.631812 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f45b219-a8bf-4a55-88c8-c0de86a482ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:00.633752 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f45b219-a8bf-4a55-88c8-c0de86a482ad admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:00.650175 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1039/2105] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:30:00 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 15:30:00.651590 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f45b219-a8bf-4a55-88c8-c0de86a482ad admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:00.663595 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f45b219-a8bf-4a55-88c8-c0de86a482ad admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:00.669315 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e349bb53-a6e7-42e3-949e-df374a1ed7db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:00.670251 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e349bb53-a6e7-42e3-949e-df374a1ed7db admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:00.670703 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e349bb53-a6e7-42e3-949e-df374a1ed7db admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:00.671013 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e349bb53-a6e7-42e3-949e-df374a1ed7db admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:00.671895 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e349bb53-a6e7-42e3-949e-df374a1ed7db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:00.675821 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e349bb53-a6e7-42e3-949e-df374a1ed7db admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:00.677732 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1067/2106] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 13 15:30:00 2022] POST /identity/v3/projects => generated 409 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:30:00.697359 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1040/2107] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:30:00 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 15:30:00.698136 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e349bb53-a6e7-42e3-949e-df374a1ed7db admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:00.698890 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7847c02-8fb3-48df-845d-cb2908286db7 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:00.722110 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e349bb53-a6e7-42e3-949e-df374a1ed7db admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:00.815776 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee936e8b-8bf1-4813-9da4-2b9308263f4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:00.821636 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee936e8b-8bf1-4813-9da4-2b9308263f4e admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:00.821980 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee936e8b-8bf1-4813-9da4-2b9308263f4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:00.822270 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee936e8b-8bf1-4813-9da4-2b9308263f4e admin admin] PATH_INFO: `/v3/projects/df9dc42d166c4a83a1e8ebaf8e1a9130/users/030fdd92f4cb4f64adef769f6dd51249/roles/3fae3d3a28e147d3b2bede2378ff79ae` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:00.826690 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7847c02-8fb3-48df-845d-cb2908286db7 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:00.834609 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d69e1fe-98a2-408d-8475-93b827564234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:00.835955 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d69e1fe-98a2-408d-8475-93b827564234 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:00.836332 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d69e1fe-98a2-408d-8475-93b827564234 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:00.836690 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d69e1fe-98a2-408d-8475-93b827564234 admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:00.837418 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d69e1fe-98a2-408d-8475-93b827564234 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:00.839903 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d69e1fe-98a2-408d-8475-93b827564234 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:00.855963 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee936e8b-8bf1-4813-9da4-2b9308263f4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=df9dc42d166c4a83a1e8ebaf8e1a9130, user_id=030fdd92f4cb4f64adef769f6dd51249, role_id=3fae3d3a28e147d3b2bede2378ff79ae)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:00.858850 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee936e8b-8bf1-4813-9da4-2b9308263f4e admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:00.868121 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1068/2108] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 13 15:30:00 2022] POST /identity/v3/users => generated 305 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:30:00.873076 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d69e1fe-98a2-408d-8475-93b827564234 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:00.893207 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1041/2109] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 13 15:30:00 2022] PUT /identity/v3/projects/df9dc42d166c4a83a1e8ebaf8e1a9130/users/030fdd92f4cb4f64adef769f6dd51249/roles/3fae3d3a28e147d3b2bede2378ff79ae => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 15:30:00.903587 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb397c3b-4b34-4ff5-bdf5-e948f8d3b72b None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:00.903886 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb397c3b-4b34-4ff5-bdf5-e948f8d3b72b None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:00.904204 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb397c3b-4b34-4ff5-bdf5-e948f8d3b72b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:00.919592 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d69e1fe-98a2-408d-8475-93b827564234 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:00.965287 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-eb397c3b-4b34-4ff5-bdf5-e948f8d3b72b None None] MFA Rules not processed for user `030fdd92f4cb4f64adef769f6dd51249`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:30:00.966758 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-eb397c3b-4b34-4ff5-bdf5-e948f8d3b72b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:00.972476 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:30:01.008422 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:30:01.037089 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a257a2-bb5f-4e5f-a930-d3f7b99e09a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:01.037801 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a257a2-bb5f-4e5f-a930-d3f7b99e09a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:01.037995 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a257a2-bb5f-4e5f-a930-d3f7b99e09a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:01.038277 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a257a2-bb5f-4e5f-a930-d3f7b99e09a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:01.040579 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a257a2-bb5f-4e5f-a930-d3f7b99e09a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:01.040864 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a257a2-bb5f-4e5f-a930-d3f7b99e09a6 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:01.056933 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1069/2110] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:30:00 2022] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 15:30:01.058530 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e1116f-c173-40ce-9331-56bce3687cf9 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:01.058824 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e1116f-c173-40ce-9331-56bce3687cf9 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:01.059263 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e1116f-c173-40ce-9331-56bce3687cf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:01.070396 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1042/2111] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:30:00 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:30:01.071712 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb397c3b-4b34-4ff5-bdf5-e948f8d3b72b None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:01.092707 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb397c3b-4b34-4ff5-bdf5-e948f8d3b72b None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:01.104235 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-81e1116f-c173-40ce-9331-56bce3687cf9 None None] MFA Rules not processed for user `183a5b768dbc4c859b8a6b337918b148`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:30:01.105024 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7969e18-e137-4cbf-8f09-da803856afe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:01.106039 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7969e18-e137-4cbf-8f09-da803856afe5 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:01.106204 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-81e1116f-c173-40ce-9331-56bce3687cf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:01.106549 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7969e18-e137-4cbf-8f09-da803856afe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:01.107017 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7969e18-e137-4cbf-8f09-da803856afe5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:01.108850 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7969e18-e137-4cbf-8f09-da803856afe5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:01.112878 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7969e18-e137-4cbf-8f09-da803856afe5 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:01.141750 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1043/2112] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:30:01 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 15:30:01.141750 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7969e18-e137-4cbf-8f09-da803856afe5 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:01.143855 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-e7969e18-e137-4cbf-8f09-da803856afe5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:01.211304 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1070/2113] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:30:01 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:30:01.214742 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e1116f-c173-40ce-9331-56bce3687cf9 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:01.217436 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-81e1116f-c173-40ce-9331-56bce3687cf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:01.219143 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7969e18-e137-4cbf-8f09-da803856afe5 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:01.224633 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e07fb7-652c-4955-aa4f-d9950dbaeff8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97acd23097d54bf7805c3cef60626ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:01.225490 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e07fb7-652c-4955-aa4f-d9950dbaeff8 service cinder] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:01.226047 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e07fb7-652c-4955-aa4f-d9950dbaeff8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:01.226511 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e07fb7-652c-4955-aa4f-d9950dbaeff8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:01.231681 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e1116f-c173-40ce-9331-56bce3687cf9 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:01.236464 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9f6a64-51b6-4f76-96d0-ff9cce89769b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:01.237143 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9f6a64-51b6-4f76-96d0-ff9cce89769b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:01.237571 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9f6a64-51b6-4f76-96d0-ff9cce89769b admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:01.237760 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9f6a64-51b6-4f76-96d0-ff9cce89769b admin admin] PATH_INFO: `/v3/projects/98772690b6b94efa9e9da9dc6010d907` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:01.238881 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9f6a64-51b6-4f76-96d0-ff9cce89769b admin admin] RBAC: Authorizing `identity:delete_project(project_id=98772690b6b94efa9e9da9dc6010d907)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:01.238998 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e07fb7-652c-4955-aa4f-d9950dbaeff8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:01.240484 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e07fb7-652c-4955-aa4f-d9950dbaeff8 service cinder] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:01.240796 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9f6a64-51b6-4f76-96d0-ff9cce89769b admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:01.250090 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1044/2114] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:30:01 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:30:01.250994 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e07fb7-652c-4955-aa4f-d9950dbaeff8 service cinder] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:01.267610 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e07fb7-652c-4955-aa4f-d9950dbaeff8 service cinder] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:01.277041 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4cdb20-40f4-4a27-8bd9-910bd0b20516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:01.278153 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4cdb20-40f4-4a27-8bd9-910bd0b20516 admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:01.278463 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4cdb20-40f4-4a27-8bd9-910bd0b20516 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:01.279644 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4cdb20-40f4-4a27-8bd9-910bd0b20516 admin admin] PATH_INFO: `/v3/projects/8e78b021dc6748d68035268fcdd839b6/users/2bb75f56bea642f6a03ee1d1d8c95ac2/roles/3fae3d3a28e147d3b2bede2378ff79ae` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:01.299055 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4cdb20-40f4-4a27-8bd9-910bd0b20516 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e78b021dc6748d68035268fcdd839b6, user_id=2bb75f56bea642f6a03ee1d1d8c95ac2, role_id=3fae3d3a28e147d3b2bede2378ff79ae)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:01.301674 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4cdb20-40f4-4a27-8bd9-910bd0b20516 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:01.309514 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-6f9f6a64-51b6-4f76-96d0-ff9cce89769b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98772690b6b94efa9e9da9dc6010d907', 'request_id': 'req-6f9f6a64-51b6-4f76-96d0-ff9cce89769b'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:01.317865 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-6f9f6a64-51b6-4f76-96d0-ff9cce89769b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98772690b6b94efa9e9da9dc6010d907', 'request_id': 'req-6f9f6a64-51b6-4f76-96d0-ff9cce89769b'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:01.321081 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1045/2115] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 13 15:30:01 2022] PUT /identity/v3/projects/8e78b021dc6748d68035268fcdd839b6/users/2bb75f56bea642f6a03ee1d1d8c95ac2/roles/3fae3d3a28e147d3b2bede2378ff79ae => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:30:01.322033 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4cdb20-40f4-4a27-8bd9-910bd0b20516 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:01.334061 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-2c4cdb20-40f4-4a27-8bd9-910bd0b20516 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:01.337719 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-6f9f6a64-51b6-4f76-96d0-ff9cce89769b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98772690b6b94efa9e9da9dc6010d907', 'request_id': 'req-6f9f6a64-51b6-4f76-96d0-ff9cce89769b'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:01.350203 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-6f9f6a64-51b6-4f76-96d0-ff9cce89769b admin admin] The token cache is being invalidate because project 98772690b6b94efa9e9da9dc6010d907 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 15:30:01.350562 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-6f9f6a64-51b6-4f76-96d0-ff9cce89769b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:01.351288 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-6f9f6a64-51b6-4f76-96d0-ff9cce89769b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:01.353094 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1071/2116] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 13 15:30:01 2022] DELETE /identity/v3/projects/98772690b6b94efa9e9da9dc6010d907 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:30:01.353967 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9f6a64-51b6-4f76-96d0-ff9cce89769b admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:01.355320 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-6f9f6a64-51b6-4f76-96d0-ff9cce89769b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:01.408444 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:30:01.413843 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4cdb20-40f4-4a27-8bd9-910bd0b20516 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:01.419334 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162f5563-7d4b-4031-a11d-016346e226e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:01.419946 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162f5563-7d4b-4031-a11d-016346e226e4 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:01.420254 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162f5563-7d4b-4031-a11d-016346e226e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:01.420529 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162f5563-7d4b-4031-a11d-016346e226e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:01.421186 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162f5563-7d4b-4031-a11d-016346e226e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:01.423107 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162f5563-7d4b-4031-a11d-016346e226e4 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:01.433901 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9f6a64-51b6-4f76-96d0-ff9cce89769b admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:01.438950 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4acd3e4-e16e-49c4-a1d8-c22cdc4dcc23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:01.439801 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4acd3e4-e16e-49c4-a1d8-c22cdc4dcc23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:01.440185 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4acd3e4-e16e-49c4-a1d8-c22cdc4dcc23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:01.440538 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4acd3e4-e16e-49c4-a1d8-c22cdc4dcc23 admin admin] PATH_INFO: `/v3/users/030fdd92f4cb4f64adef769f6dd51249` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:01.441687 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4acd3e4-e16e-49c4-a1d8-c22cdc4dcc23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=030fdd92f4cb4f64adef769f6dd51249)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:01.443650 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4acd3e4-e16e-49c4-a1d8-c22cdc4dcc23 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:01.450684 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1046/2117] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 13 15:30:01 2022] POST /identity/v3/projects => generated 403 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:30:01.452720 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10520b9c-9cf3-4bcd-82d0-25e6e060db73 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:01.453014 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10520b9c-9cf3-4bcd-82d0-25e6e060db73 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:01.453294 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10520b9c-9cf3-4bcd-82d0-25e6e060db73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:01.485607 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-10520b9c-9cf3-4bcd-82d0-25e6e060db73 None None] MFA Rules not processed for user `2bb75f56bea642f6a03ee1d1d8c95ac2`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:30:01.487043 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-10520b9c-9cf3-4bcd-82d0-25e6e060db73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:01.492350 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-f4acd3e4-e16e-49c4-a1d8-c22cdc4dcc23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '030fdd92f4cb4f64adef769f6dd51249'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:01.493032 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-f4acd3e4-e16e-49c4-a1d8-c22cdc4dcc23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '030fdd92f4cb4f64adef769f6dd51249'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:01.493676 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-f4acd3e4-e16e-49c4-a1d8-c22cdc4dcc23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '030fdd92f4cb4f64adef769f6dd51249'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:01.498384 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:30:01.501212 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-f4acd3e4-e16e-49c4-a1d8-c22cdc4dcc23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '030fdd92f4cb4f64adef769f6dd51249'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:01.514498 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-f4acd3e4-e16e-49c4-a1d8-c22cdc4dcc23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '030fdd92f4cb4f64adef769f6dd51249'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:01.528258 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1072/2118] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 13 15:30:01 2022] DELETE /identity/v3/users/030fdd92f4cb4f64adef769f6dd51249 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:30:01.529080 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4acd3e4-e16e-49c4-a1d8-c22cdc4dcc23 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:01.530603 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-f4acd3e4-e16e-49c4-a1d8-c22cdc4dcc23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:01.558813 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1047/2119] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:30:01 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:30:01.559555 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10520b9c-9cf3-4bcd-82d0-25e6e060db73 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:01.561016 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-10520b9c-9cf3-4bcd-82d0-25e6e060db73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:01.599368 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4acd3e4-e16e-49c4-a1d8-c22cdc4dcc23 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:01.604495 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaa9faa-f82d-4952-939c-49f6341cb25e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:01.605131 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaa9faa-f82d-4952-939c-49f6341cb25e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:01.605414 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaa9faa-f82d-4952-939c-49f6341cb25e admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:01.605692 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaa9faa-f82d-4952-939c-49f6341cb25e admin admin] PATH_INFO: `/v3/users/65cedd1bf5ee47658bff88897bd0f474` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:01.606874 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaa9faa-f82d-4952-939c-49f6341cb25e admin admin] RBAC: Authorizing `identity:delete_user(user_id=65cedd1bf5ee47658bff88897bd0f474)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:01.608826 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaa9faa-f82d-4952-939c-49f6341cb25e admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:01.631911 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10520b9c-9cf3-4bcd-82d0-25e6e060db73 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:01.637624 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32432c9b-ad2b-4690-aa6a-bfc2d3fd3446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:01.637922 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32432c9b-ad2b-4690-aa6a-bfc2d3fd3446 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:01.638209 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32432c9b-ad2b-4690-aa6a-bfc2d3fd3446 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:01.638899 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32432c9b-ad2b-4690-aa6a-bfc2d3fd3446 admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:01.639162 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32432c9b-ad2b-4690-aa6a-bfc2d3fd3446 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:01.641101 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32432c9b-ad2b-4690-aa6a-bfc2d3fd3446 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:01.672623 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1048/2120] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 13 15:30:01 2022] POST /identity/v3/users => generated 308 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:30:01.672623 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69f5bb9-189c-4c83-81d4-e6c563cf08d9 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:01.672623 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69f5bb9-189c-4c83-81d4-e6c563cf08d9 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:01.672623 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69f5bb9-189c-4c83-81d4-e6c563cf08d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:01.674126 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-6eaa9faa-f82d-4952-939c-49f6341cb25e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65cedd1bf5ee47658bff88897bd0f474'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:01.675822 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-6eaa9faa-f82d-4952-939c-49f6341cb25e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65cedd1bf5ee47658bff88897bd0f474'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:01.676732 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-6eaa9faa-f82d-4952-939c-49f6341cb25e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65cedd1bf5ee47658bff88897bd0f474'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:01.685354 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-6eaa9faa-f82d-4952-939c-49f6341cb25e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65cedd1bf5ee47658bff88897bd0f474'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:01.691146 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:30:01.699438 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-d69f5bb9-189c-4c83-81d4-e6c563cf08d9 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:30:01.700746 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-d69f5bb9-189c-4c83-81d4-e6c563cf08d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:01.706777 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-6eaa9faa-f82d-4952-939c-49f6341cb25e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65cedd1bf5ee47658bff88897bd0f474'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:01.714365 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1049/2121] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:30:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:30:01.715528 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69f5bb9-189c-4c83-81d4-e6c563cf08d9 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:01.717012 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-d69f5bb9-189c-4c83-81d4-e6c563cf08d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:01.731640 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69f5bb9-189c-4c83-81d4-e6c563cf08d9 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:01.740970 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1073/2122] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 13 15:30:01 2022] DELETE /identity/v3/users/65cedd1bf5ee47658bff88897bd0f474 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:30:01.741879 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaa9faa-f82d-4952-939c-49f6341cb25e admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:01.750224 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6806a0e-260e-46dd-9b90-1680bec1fa18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:01.750871 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6806a0e-260e-46dd-9b90-1680bec1fa18 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:01.751157 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6806a0e-260e-46dd-9b90-1680bec1fa18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:01.751415 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6806a0e-260e-46dd-9b90-1680bec1fa18 admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:01.752109 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6806a0e-260e-46dd-9b90-1680bec1fa18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:01.754403 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6806a0e-260e-46dd-9b90-1680bec1fa18 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:01.759053 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-6eaa9faa-f82d-4952-939c-49f6341cb25e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:01.809956 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1050/2123] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 13 15:30:01 2022] POST /identity/v3/projects => generated 407 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:30:01.810911 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6806a0e-260e-46dd-9b90-1680bec1fa18 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:01.814428 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-c6806a0e-260e-46dd-9b90-1680bec1fa18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:01.914346 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaa9faa-f82d-4952-939c-49f6341cb25e admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:01.928402 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6806a0e-260e-46dd-9b90-1680bec1fa18 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:01.932390 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24704a2f-41eb-40f5-85ec-ebbbdbe5a686 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41675154bbba47388040966f75d84c3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:01.933013 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24704a2f-41eb-40f5-85ec-ebbbdbe5a686 service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:01.933366 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24704a2f-41eb-40f5-85ec-ebbbdbe5a686 service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:01.933634 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24704a2f-41eb-40f5-85ec-ebbbdbe5a686 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:01.964171 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:30:01.992779 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae85b87-7dff-4fd2-8e99-afe523470069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:01.993463 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae85b87-7dff-4fd2-8e99-afe523470069 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:01.993774 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae85b87-7dff-4fd2-8e99-afe523470069 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:01.994590 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae85b87-7dff-4fd2-8e99-afe523470069 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:01.995300 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae85b87-7dff-4fd2-8e99-afe523470069 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:01.997457 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae85b87-7dff-4fd2-8e99-afe523470069 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:02.012245 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1074/2124] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:30:01 2022] GET /identity/v3/roles => generated 1420 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 15:30:02.013035 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae85b87-7dff-4fd2-8e99-afe523470069 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:02.030177 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae85b87-7dff-4fd2-8e99-afe523470069 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:02.031527 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24704a2f-41eb-40f5-85ec-ebbbdbe5a686 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:02.033221 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24704a2f-41eb-40f5-85ec-ebbbdbe5a686 service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:02.039157 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06d26b9-9028-4689-bac4-6440771c23c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:02.040110 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06d26b9-9028-4689-bac4-6440771c23c4 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:02.040110 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06d26b9-9028-4689-bac4-6440771c23c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:02.040373 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06d26b9-9028-4689-bac4-6440771c23c4 admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:02.041230 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06d26b9-9028-4689-bac4-6440771c23c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:02.043706 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06d26b9-9028-4689-bac4-6440771c23c4 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:02.045824 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1051/2125] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:30:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:30:02.047773 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24704a2f-41eb-40f5-85ec-ebbbdbe5a686 service neutron] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:02.059897 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24704a2f-41eb-40f5-85ec-ebbbdbe5a686 service neutron] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:02.066034 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17c0851-309b-4eca-bbad-44471466ab46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:02.066725 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17c0851-309b-4eca-bbad-44471466ab46 admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:02.067088 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17c0851-309b-4eca-bbad-44471466ab46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:02.067420 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17c0851-309b-4eca-bbad-44471466ab46 admin admin] PATH_INFO: `/v3/projects/269f6530472748c8845f7fdf7bbfcc39/users/e0186eee5415415fa5cfa0c09538cc59/roles/f34412ad29f1478cba775b033129f71f` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:02.091992 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17c0851-309b-4eca-bbad-44471466ab46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=269f6530472748c8845f7fdf7bbfcc39, user_id=e0186eee5415415fa5cfa0c09538cc59, role_id=f34412ad29f1478cba775b033129f71f)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:02.095769 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17c0851-309b-4eca-bbad-44471466ab46 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:02.123170 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1075/2126] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 13 15:30:02 2022] POST /identity/v3/users => generated 310 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:30:02.126733 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06d26b9-9028-4689-bac4-6440771c23c4 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:02.139648 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1052/2127] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 13 15:30:02 2022] PUT /identity/v3/projects/269f6530472748c8845f7fdf7bbfcc39/users/e0186eee5415415fa5cfa0c09538cc59/roles/f34412ad29f1478cba775b033129f71f => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:30:02.146621 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17c0851-309b-4eca-bbad-44471466ab46 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:02.149187 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06d26b9-9028-4689-bac4-6440771c23c4 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:02.247080 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e534e225-40e7-400c-9215-53a0876843ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:02.247714 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e534e225-40e7-400c-9215-53a0876843ae admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:02.248602 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e534e225-40e7-400c-9215-53a0876843ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:02.248602 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e534e225-40e7-400c-9215-53a0876843ae admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:02.249148 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e534e225-40e7-400c-9215-53a0876843ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:02.250966 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e534e225-40e7-400c-9215-53a0876843ae admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:02.264939 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17c0851-309b-4eca-bbad-44471466ab46 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:02.270225 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:30:02.279620 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea819cf-04b1-4731-9712-c831c39834eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:02.280263 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea819cf-04b1-4731-9712-c831c39834eb admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:02.280522 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea819cf-04b1-4731-9712-c831c39834eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:02.280804 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea819cf-04b1-4731-9712-c831c39834eb admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:02.281454 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea819cf-04b1-4731-9712-c831c39834eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:02.286533 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea819cf-04b1-4731-9712-c831c39834eb admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:02.292075 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1076/2128] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:30:02 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 15:30:02.292075 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e534e225-40e7-400c-9215-53a0876843ae admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:02.295827 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-e534e225-40e7-400c-9215-53a0876843ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:02.320207 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1053/2129] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:30:02 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 15:30:02.320207 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea819cf-04b1-4731-9712-c831c39834eb admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:02.323397 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e534e225-40e7-400c-9215-53a0876843ae admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:02.329255 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33230207-e66b-4360-bc58-7ba529123536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:02.329922 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33230207-e66b-4360-bc58-7ba529123536 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:02.330214 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33230207-e66b-4360-bc58-7ba529123536 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:02.330497 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33230207-e66b-4360-bc58-7ba529123536 admin admin] PATH_INFO: `/v3/projects/d8b66b8282e14d52a8da54472c377640` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:02.331470 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea819cf-04b1-4731-9712-c831c39834eb admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:02.331941 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33230207-e66b-4360-bc58-7ba529123536 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8b66b8282e14d52a8da54472c377640)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:02.333918 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33230207-e66b-4360-bc58-7ba529123536 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:02.336447 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c676fec4-649d-4d40-870b-dd5fa6661819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:02.337248 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c676fec4-649d-4d40-870b-dd5fa6661819 admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:02.337535 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c676fec4-649d-4d40-870b-dd5fa6661819 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:02.337848 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c676fec4-649d-4d40-870b-dd5fa6661819 admin admin] PATH_INFO: `/v3/projects/a92691a160e44aa0a0db34b677ade1b6/users/c4af62fe33fb4f0eb1d49a9863998e4a/roles/f34412ad29f1478cba775b033129f71f` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:02.358452 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c676fec4-649d-4d40-870b-dd5fa6661819 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a92691a160e44aa0a0db34b677ade1b6, user_id=c4af62fe33fb4f0eb1d49a9863998e4a, role_id=f34412ad29f1478cba775b033129f71f)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:02.361517 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c676fec4-649d-4d40-870b-dd5fa6661819 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:02.377999 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1054/2130] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 13 15:30:02 2022] PUT /identity/v3/projects/a92691a160e44aa0a0db34b677ade1b6/users/c4af62fe33fb4f0eb1d49a9863998e4a/roles/f34412ad29f1478cba775b033129f71f => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:30:02.381662 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c676fec4-649d-4d40-870b-dd5fa6661819 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:02.400150 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-33230207-e66b-4360-bc58-7ba529123536 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8b66b8282e14d52a8da54472c377640', 'request_id': 'req-33230207-e66b-4360-bc58-7ba529123536'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:02.410297 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-33230207-e66b-4360-bc58-7ba529123536 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8b66b8282e14d52a8da54472c377640', 'request_id': 'req-33230207-e66b-4360-bc58-7ba529123536'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:02.424527 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-33230207-e66b-4360-bc58-7ba529123536 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8b66b8282e14d52a8da54472c377640', 'request_id': 'req-33230207-e66b-4360-bc58-7ba529123536'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:02.437740 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-33230207-e66b-4360-bc58-7ba529123536 admin admin] The token cache is being invalidate because project d8b66b8282e14d52a8da54472c377640 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 15:30:02.438038 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-33230207-e66b-4360-bc58-7ba529123536 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:02.439066 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-33230207-e66b-4360-bc58-7ba529123536 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:02.446148 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1077/2131] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 13 15:30:02 2022] DELETE /identity/v3/projects/d8b66b8282e14d52a8da54472c377640 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:30:02.447043 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33230207-e66b-4360-bc58-7ba529123536 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:02.448496 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-33230207-e66b-4360-bc58-7ba529123536 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:02.462525 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c676fec4-649d-4d40-870b-dd5fa6661819 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:02.478012 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:30:02.522618 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33230207-e66b-4360-bc58-7ba529123536 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:02.526039 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35f9917-b550-49d2-b6c8-7ae714211808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:02.526703 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35f9917-b550-49d2-b6c8-7ae714211808 admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:02.526990 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35f9917-b550-49d2-b6c8-7ae714211808 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:02.527272 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35f9917-b550-49d2-b6c8-7ae714211808 admin admin] PATH_INFO: `/v3/projects/269f6530472748c8845f7fdf7bbfcc39/users/e0186eee5415415fa5cfa0c09538cc59/roles/f34412ad29f1478cba775b033129f71f` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:02.527378 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eeb3a34-93ee-4f2b-bdb3-292bcf4013d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:02.527973 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeb3a34-93ee-4f2b-bdb3-292bcf4013d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:02.528262 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeb3a34-93ee-4f2b-bdb3-292bcf4013d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:02.528540 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeb3a34-93ee-4f2b-bdb3-292bcf4013d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:02.529245 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35f9917-b550-49d2-b6c8-7ae714211808 admin admin] RBAC: Authorizing `identity:create_grant(project_id=269f6530472748c8845f7fdf7bbfcc39, user_id=e0186eee5415415fa5cfa0c09538cc59, role_id=f34412ad29f1478cba775b033129f71f)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:02.529351 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eeb3a34-93ee-4f2b-bdb3-292bcf4013d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:02.531088 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eeb3a34-93ee-4f2b-bdb3-292bcf4013d3 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:02.531930 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35f9917-b550-49d2-b6c8-7ae714211808 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:02.541414 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1078/2132] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:30:02 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 15:30:02.542140 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eeb3a34-93ee-4f2b-bdb3-292bcf4013d3 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:02.542262 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1055/2133] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 13 15:30:02 2022] PUT /identity/v3/projects/269f6530472748c8845f7fdf7bbfcc39/users/e0186eee5415415fa5cfa0c09538cc59/roles/f34412ad29f1478cba775b033129f71f => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:30:02.543466 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec83ffa-e970-44fa-b620-9fdc6e09f307 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:02.543757 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec83ffa-e970-44fa-b620-9fdc6e09f307 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:02.544036 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec83ffa-e970-44fa-b620-9fdc6e09f307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:02.547057 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-0eeb3a34-93ee-4f2b-bdb3-292bcf4013d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:02.559880 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eeb3a34-93ee-4f2b-bdb3-292bcf4013d3 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:02.563569 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-cec83ffa-e970-44fa-b620-9fdc6e09f307 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:30:02.564784 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-cec83ffa-e970-44fa-b620-9fdc6e09f307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:02.624260 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d37dff1-9ac0-491b-8c0b-cdf896bbdbe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:02.624944 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d37dff1-9ac0-491b-8c0b-cdf896bbdbe8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:02.625230 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d37dff1-9ac0-491b-8c0b-cdf896bbdbe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:02.625533 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d37dff1-9ac0-491b-8c0b-cdf896bbdbe8 admin admin] PATH_INFO: `/v3/projects/df9dc42d166c4a83a1e8ebaf8e1a9130` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:02.627089 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d37dff1-9ac0-491b-8c0b-cdf896bbdbe8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df9dc42d166c4a83a1e8ebaf8e1a9130)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:02.628754 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d37dff1-9ac0-491b-8c0b-cdf896bbdbe8 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:02.633908 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1056/2134] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:30:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:30:02.634717 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec83ffa-e970-44fa-b620-9fdc6e09f307 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:02.645952 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec83ffa-e970-44fa-b620-9fdc6e09f307 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:02.653187 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953036af-52a2-45e1-aa4e-834132f995ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:02.653892 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953036af-52a2-45e1-aa4e-834132f995ba admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:02.654174 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953036af-52a2-45e1-aa4e-834132f995ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:02.654449 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953036af-52a2-45e1-aa4e-834132f995ba admin admin] PATH_INFO: `/v3/projects/a92691a160e44aa0a0db34b677ade1b6/users/c4af62fe33fb4f0eb1d49a9863998e4a/roles/f34412ad29f1478cba775b033129f71f` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:02.655256 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:30:02.656372 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953036af-52a2-45e1-aa4e-834132f995ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=a92691a160e44aa0a0db34b677ade1b6, user_id=c4af62fe33fb4f0eb1d49a9863998e4a, role_id=f34412ad29f1478cba775b033129f71f)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:02.659427 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953036af-52a2-45e1-aa4e-834132f995ba admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:02.673860 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1057/2135] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 13 15:30:02 2022] PUT /identity/v3/projects/a92691a160e44aa0a0db34b677ade1b6/users/c4af62fe33fb4f0eb1d49a9863998e4a/roles/f34412ad29f1478cba775b033129f71f => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:30:02.676044 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4923cb7c-c888-431d-ac93-76790288658f None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:02.676329 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4923cb7c-c888-431d-ac93-76790288658f None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:02.676603 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4923cb7c-c888-431d-ac93-76790288658f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:02.693320 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-8d37dff1-9ac0-491b-8c0b-cdf896bbdbe8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df9dc42d166c4a83a1e8ebaf8e1a9130', 'request_id': 'req-8d37dff1-9ac0-491b-8c0b-cdf896bbdbe8'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:02.700294 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-8d37dff1-9ac0-491b-8c0b-cdf896bbdbe8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df9dc42d166c4a83a1e8ebaf8e1a9130', 'request_id': 'req-8d37dff1-9ac0-491b-8c0b-cdf896bbdbe8'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:02.700938 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-4923cb7c-c888-431d-ac93-76790288658f None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:30:02.703366 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-4923cb7c-c888-431d-ac93-76790288658f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:02.716912 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-8d37dff1-9ac0-491b-8c0b-cdf896bbdbe8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df9dc42d166c4a83a1e8ebaf8e1a9130', 'request_id': 'req-8d37dff1-9ac0-491b-8c0b-cdf896bbdbe8'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:02.739209 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-8d37dff1-9ac0-491b-8c0b-cdf896bbdbe8 admin admin] The token cache is being invalidate because project df9dc42d166c4a83a1e8ebaf8e1a9130 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 15:30:02.739534 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-8d37dff1-9ac0-491b-8c0b-cdf896bbdbe8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:02.740677 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-8d37dff1-9ac0-491b-8c0b-cdf896bbdbe8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:02.745876 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1079/2136] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 13 15:30:02 2022] DELETE /identity/v3/projects/df9dc42d166c4a83a1e8ebaf8e1a9130 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:30:02.745876 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd65e2d-df7b-4a97-a3e3-e91cfd439281 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:02.745876 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd65e2d-df7b-4a97-a3e3-e91cfd439281 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:02.745876 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd65e2d-df7b-4a97-a3e3-e91cfd439281 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:02.779799 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-0bd65e2d-df7b-4a97-a3e3-e91cfd439281 None None] MFA Rules not processed for user `c4af62fe33fb4f0eb1d49a9863998e4a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:30:02.781123 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-0bd65e2d-df7b-4a97-a3e3-e91cfd439281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:02.785046 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1058/2137] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:30:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:30:02.786281 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811d97c5-34d9-4a63-98f1-227b04acfc69 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:02.786993 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811d97c5-34d9-4a63-98f1-227b04acfc69 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:02.786993 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811d97c5-34d9-4a63-98f1-227b04acfc69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:02.808049 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-811d97c5-34d9-4a63-98f1-227b04acfc69 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:30:02.809273 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-811d97c5-34d9-4a63-98f1-227b04acfc69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:02.826523 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1059/2138] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:30:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:30:02.827641 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811d97c5-34d9-4a63-98f1-227b04acfc69 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:02.838364 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811d97c5-34d9-4a63-98f1-227b04acfc69 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:02.843555 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e48b3a4-4733-439b-9995-bda4636f4822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:02.844177 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e48b3a4-4733-439b-9995-bda4636f4822 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:02.844679 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e48b3a4-4733-439b-9995-bda4636f4822 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:02.844967 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e48b3a4-4733-439b-9995-bda4636f4822 admin admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:02.845805 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e48b3a4-4733-439b-9995-bda4636f4822 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:30:02.847046 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e48b3a4-4733-439b-9995-bda4636f4822 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:02.848781 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e48b3a4-4733-439b-9995-bda4636f4822 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:02.863585 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1060/2139] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Sep 13 15:30:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:30:02.864990 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3483c1c6-c857-437b-931b-83281604511d None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:02.865284 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3483c1c6-c857-437b-931b-83281604511d None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:02.865624 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3483c1c6-c857-437b-931b-83281604511d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:02.887235 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1080/2140] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:30:02 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:30:02.888284 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd65e2d-df7b-4a97-a3e3-e91cfd439281 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:02.896637 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-3483c1c6-c857-437b-931b-83281604511d None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:30:02.897952 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-3483c1c6-c857-437b-931b-83281604511d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:02.909533 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1061/2141] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:30:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:30:02.910398 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3483c1c6-c857-437b-931b-83281604511d None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:02.912195 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-3483c1c6-c857-437b-931b-83281604511d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:02.924787 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd65e2d-df7b-4a97-a3e3-e91cfd439281 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:02.928599 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:30:02.937132 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae97a63-4d38-4237-91f9-e8bc023d8708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:02.939163 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae97a63-4d38-4237-91f9-e8bc023d8708 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:02.939617 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae97a63-4d38-4237-91f9-e8bc023d8708 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:02.941276 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae97a63-4d38-4237-91f9-e8bc023d8708 admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:02.942290 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae97a63-4d38-4237-91f9-e8bc023d8708 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:02.949325 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae97a63-4d38-4237-91f9-e8bc023d8708 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:02.996919 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3483c1c6-c857-437b-931b-83281604511d None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:03.002166 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d927c2cd-c986-4a2c-94a9-fc5ee8e52b51 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97acd23097d54bf7805c3cef60626ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:03.004086 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d927c2cd-c986-4a2c-94a9-fc5ee8e52b51 service cinder] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:03.004471 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d927c2cd-c986-4a2c-94a9-fc5ee8e52b51 service cinder] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:03.004870 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d927c2cd-c986-4a2c-94a9-fc5ee8e52b51 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:03.015096 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1081/2142] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 13 15:30:02 2022] POST /identity/v3/projects => generated 377 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:30:03.016022 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae97a63-4d38-4237-91f9-e8bc023d8708 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:03.016763 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d927c2cd-c986-4a2c-94a9-fc5ee8e52b51 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:03.018562 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d927c2cd-c986-4a2c-94a9-fc5ee8e52b51 service cinder] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:03.032267 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1062/2143] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:30:02 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:30:03.034683 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d927c2cd-c986-4a2c-94a9-fc5ee8e52b51 service cinder] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:03.046808 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d927c2cd-c986-4a2c-94a9-fc5ee8e52b51 service cinder] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:03.184371 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aa429a-a157-40ec-9a21-4e2c28c04dc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:03.187334 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aa429a-a157-40ec-9a21-4e2c28c04dc2 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:03.187631 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aa429a-a157-40ec-9a21-4e2c28c04dc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:03.187916 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aa429a-a157-40ec-9a21-4e2c28c04dc2 admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:03.188580 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37aa429a-a157-40ec-9a21-4e2c28c04dc2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:03.192993 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37aa429a-a157-40ec-9a21-4e2c28c04dc2 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:03.208143 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae97a63-4d38-4237-91f9-e8bc023d8708 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:03.230740 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412b1ecb-b406-4906-8af6-a88fad1acc0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:03.233624 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412b1ecb-b406-4906-8af6-a88fad1acc0f admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:03.236582 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412b1ecb-b406-4906-8af6-a88fad1acc0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:03.238214 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412b1ecb-b406-4906-8af6-a88fad1acc0f admin admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:03.239887 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412b1ecb-b406-4906-8af6-a88fad1acc0f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:30:03.240375 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412b1ecb-b406-4906-8af6-a88fad1acc0f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:03.245312 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412b1ecb-b406-4906-8af6-a88fad1acc0f admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:03.266435 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1082/2144] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Sep 13 15:30:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:30:03.272015 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1063/2145] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 13 15:30:03 2022] POST /identity/v3/users => generated 289 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:30:03.275947 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412b1ecb-b406-4906-8af6-a88fad1acc0f admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:03.277402 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aa429a-a157-40ec-9a21-4e2c28c04dc2 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:03.291433 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412b1ecb-b406-4906-8af6-a88fad1acc0f admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:03.298351 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b612bd48-bcd8-4209-bbf3-de31bd8eba4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:03.298650 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b612bd48-bcd8-4209-bbf3-de31bd8eba4b admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:03.298939 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b612bd48-bcd8-4209-bbf3-de31bd8eba4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:03.299220 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b612bd48-bcd8-4209-bbf3-de31bd8eba4b admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:03.301079 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b612bd48-bcd8-4209-bbf3-de31bd8eba4b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:03.303528 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b612bd48-bcd8-4209-bbf3-de31bd8eba4b admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:03.310567 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:DELETE=7,keystone:SELECT=91,keystone:INSERT=2 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:30:03.314620 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aa429a-a157-40ec-9a21-4e2c28c04dc2 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:03.325286 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311b7769-7a81-4c8b-a538-18a424bff970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:03.326349 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311b7769-7a81-4c8b-a538-18a424bff970 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:03.326638 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311b7769-7a81-4c8b-a538-18a424bff970 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:03.327222 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311b7769-7a81-4c8b-a538-18a424bff970 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:03.328524 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311b7769-7a81-4c8b-a538-18a424bff970 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:03.331638 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311b7769-7a81-4c8b-a538-18a424bff970 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:03.347949 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1064/2146] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:30:03 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 15:30:03.351888 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311b7769-7a81-4c8b-a538-18a424bff970 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:03.358998 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1083/2147] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 13 15:30:03 2022] POST /identity/v3/projects => generated 359 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:30:03.360331 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b612bd48-bcd8-4209-bbf3-de31bd8eba4b admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:03.368532 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311b7769-7a81-4c8b-a538-18a424bff970 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:03.479308 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd99e71b-56b6-4a31-baa0-d3125c1424d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:03.480134 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd99e71b-56b6-4a31-baa0-d3125c1424d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:03.480441 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd99e71b-56b6-4a31-baa0-d3125c1424d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:03.480610 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd99e71b-56b6-4a31-baa0-d3125c1424d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:03.481337 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd99e71b-56b6-4a31-baa0-d3125c1424d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:03.483348 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd99e71b-56b6-4a31-baa0-d3125c1424d5 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:03.503377 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1065/2148] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:30:03 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 15:30:03.504913 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd99e71b-56b6-4a31-baa0-d3125c1424d5 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:03.506702 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-dd99e71b-56b6-4a31-baa0-d3125c1424d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:03.507624 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b612bd48-bcd8-4209-bbf3-de31bd8eba4b admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:03.513129 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4fae01-8def-44dd-98ee-8a9b63839d00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:03.513782 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4fae01-8def-44dd-98ee-8a9b63839d00 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:03.514071 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4fae01-8def-44dd-98ee-8a9b63839d00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:03.514894 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4fae01-8def-44dd-98ee-8a9b63839d00 admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:03.515643 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4fae01-8def-44dd-98ee-8a9b63839d00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:03.518531 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4fae01-8def-44dd-98ee-8a9b63839d00 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:03.549912 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1084/2149] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 13 15:30:03 2022] POST /identity/v3/users => generated 280 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:30:03.549912 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4fae01-8def-44dd-98ee-8a9b63839d00 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:03.550915 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:30:03.563803 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4fae01-8def-44dd-98ee-8a9b63839d00 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:03.570115 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f427e25-9da2-4b9d-8f12-555cf54476d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:03.570787 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f427e25-9da2-4b9d-8f12-555cf54476d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:03.571069 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f427e25-9da2-4b9d-8f12-555cf54476d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:03.571345 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f427e25-9da2-4b9d-8f12-555cf54476d9 admin admin] PATH_INFO: `/v3/projects/c93fc62f361f43b8a481e52bf2fedd03/users/1f5f0c63988e4a078e4504b87afc6b88/roles/3fae3d3a28e147d3b2bede2378ff79ae` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:03.577521 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd99e71b-56b6-4a31-baa0-d3125c1424d5 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:03.583296 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13eef10-0028-4a70-81b4-9fc63ecb1d82 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97acd23097d54bf7805c3cef60626ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:03.583733 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13eef10-0028-4a70-81b4-9fc63ecb1d82 service cinder] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:03.584118 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13eef10-0028-4a70-81b4-9fc63ecb1d82 service cinder] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:03.584465 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13eef10-0028-4a70-81b4-9fc63ecb1d82 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:03.586579 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-a13eef10-0028-4a70-81b4-9fc63ecb1d82 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:03.603635 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f427e25-9da2-4b9d-8f12-555cf54476d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c93fc62f361f43b8a481e52bf2fedd03, user_id=1f5f0c63988e4a078e4504b87afc6b88, role_id=3fae3d3a28e147d3b2bede2378ff79ae)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:03.607537 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f427e25-9da2-4b9d-8f12-555cf54476d9 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:03.624330 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1085/2150] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 13 15:30:03 2022] PUT /identity/v3/projects/c93fc62f361f43b8a481e52bf2fedd03/users/1f5f0c63988e4a078e4504b87afc6b88/roles/3fae3d3a28e147d3b2bede2378ff79ae => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:30:03.625591 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f427e25-9da2-4b9d-8f12-555cf54476d9 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:03.676217 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13eef10-0028-4a70-81b4-9fc63ecb1d82 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:03.678365 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13eef10-0028-4a70-81b4-9fc63ecb1d82 service cinder] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:03.692211 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1066/2151] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:30:03 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:30:03.693344 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aef4ba3-9144-4033-a584-604c73cd09c9 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:03.693637 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aef4ba3-9144-4033-a584-604c73cd09c9 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:03.693962 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aef4ba3-9144-4033-a584-604c73cd09c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:03.703081 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f427e25-9da2-4b9d-8f12-555cf54476d9 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:03.717375 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5f5bc7-58d1-4b4c-b688-dfd15fe7e279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:03.719987 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5f5bc7-58d1-4b4c-b688-dfd15fe7e279 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:03.721777 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5f5bc7-58d1-4b4c-b688-dfd15fe7e279 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:03.722349 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5f5bc7-58d1-4b4c-b688-dfd15fe7e279 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:03.723520 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5f5bc7-58d1-4b4c-b688-dfd15fe7e279 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:03.725383 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5f5bc7-58d1-4b4c-b688-dfd15fe7e279 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:03.739398 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-1aef4ba3-9144-4033-a584-604c73cd09c9 None None] MFA Rules not processed for user `1f5f0c63988e4a078e4504b87afc6b88`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:30:03.741738 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1086/2152] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:30:03 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 15:30:03.741870 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-1aef4ba3-9144-4033-a584-604c73cd09c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:03.746957 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5f5bc7-58d1-4b4c-b688-dfd15fe7e279 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:03.762943 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5f5bc7-58d1-4b4c-b688-dfd15fe7e279 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:03.791327 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da151b84-65f7-43e9-a4e3-fbbd593f884f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:03.792228 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da151b84-65f7-43e9-a4e3-fbbd593f884f admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:03.792804 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da151b84-65f7-43e9-a4e3-fbbd593f884f admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:03.794099 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da151b84-65f7-43e9-a4e3-fbbd593f884f admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:03.794950 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da151b84-65f7-43e9-a4e3-fbbd593f884f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:03.797683 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da151b84-65f7-43e9-a4e3-fbbd593f884f admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:03.818374 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1087/2153] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:30:03 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 15:30:03.818374 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13752013-c252-4e59-b57d-22298921e927 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:03.818374 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13752013-c252-4e59-b57d-22298921e927 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:03.819827 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13752013-c252-4e59-b57d-22298921e927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:03.829025 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1067/2154] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:30:03 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:30:03.834307 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aef4ba3-9144-4033-a584-604c73cd09c9 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:03.847594 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aef4ba3-9144-4033-a584-604c73cd09c9 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:03.853534 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19de926c-680c-4459-a86b-6ad4243c9cf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:03.854317 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19de926c-680c-4459-a86b-6ad4243c9cf2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:03.854787 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19de926c-680c-4459-a86b-6ad4243c9cf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:03.855161 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19de926c-680c-4459-a86b-6ad4243c9cf2 admin admin] PATH_INFO: `/v3/projects/a9c275776ca6457cb506fd319f3d2429/users/a298cda42d9e4dc0accc1f16aa763b58/roles/3fae3d3a28e147d3b2bede2378ff79ae` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:03.866704 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-13752013-c252-4e59-b57d-22298921e927 None None] MFA Rules not processed for user `e0186eee5415415fa5cfa0c09538cc59`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:30:03.868167 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-13752013-c252-4e59-b57d-22298921e927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:03.873960 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19de926c-680c-4459-a86b-6ad4243c9cf2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9c275776ca6457cb506fd319f3d2429, user_id=a298cda42d9e4dc0accc1f16aa763b58, role_id=3fae3d3a28e147d3b2bede2378ff79ae)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:03.877828 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19de926c-680c-4459-a86b-6ad4243c9cf2 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:03.902844 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:30:03.903510 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1068/2155] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 13 15:30:03 2022] PUT /identity/v3/projects/a9c275776ca6457cb506fd319f3d2429/users/a298cda42d9e4dc0accc1f16aa763b58/roles/3fae3d3a28e147d3b2bede2378ff79ae => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:30:03.904383 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19de926c-680c-4459-a86b-6ad4243c9cf2 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:03.969448 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1088/2156] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:30:03 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:30:03.970921 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df02beef-b7b2-409a-8576-65595ed13f95 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:03.972162 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df02beef-b7b2-409a-8576-65595ed13f95 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:03.972776 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df02beef-b7b2-409a-8576-65595ed13f95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:04.008263 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:30:04.025631 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-df02beef-b7b2-409a-8576-65595ed13f95 None None] MFA Rules not processed for user `a298cda42d9e4dc0accc1f16aa763b58`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:30:04.026361 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19de926c-680c-4459-a86b-6ad4243c9cf2 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:04.026717 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-df02beef-b7b2-409a-8576-65595ed13f95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:04.033465 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52c8944-f0e3-49f8-994b-484670ca0504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:04.035087 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52c8944-f0e3-49f8-994b-484670ca0504 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:04.035446 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52c8944-f0e3-49f8-994b-484670ca0504 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:04.035859 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52c8944-f0e3-49f8-994b-484670ca0504 admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:04.037543 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52c8944-f0e3-49f8-994b-484670ca0504 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:04.040387 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52c8944-f0e3-49f8-994b-484670ca0504 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:04.083073 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1069/2157] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 13 15:30:03 2022] POST /identity/v3/projects => generated 377 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:30:04.087526 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52c8944-f0e3-49f8-994b-484670ca0504 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:04.123266 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1089/2158] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:30:03 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:30:04.173349 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df02beef-b7b2-409a-8576-65595ed13f95 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:04.238817 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52c8944-f0e3-49f8-994b-484670ca0504 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:04.250398 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4586ad86-f7d3-47b5-bae7-a9508b70b769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:04.251494 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4586ad86-f7d3-47b5-bae7-a9508b70b769 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:04.251968 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4586ad86-f7d3-47b5-bae7-a9508b70b769 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:04.253190 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4586ad86-f7d3-47b5-bae7-a9508b70b769 admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:04.254090 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4586ad86-f7d3-47b5-bae7-a9508b70b769 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:04.257130 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4586ad86-f7d3-47b5-bae7-a9508b70b769 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:04.294488 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1070/2159] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 13 15:30:04 2022] POST /identity/v3/users => generated 289 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:30:04.294711 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df02beef-b7b2-409a-8576-65595ed13f95 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:04.295643 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4586ad86-f7d3-47b5-bae7-a9508b70b769 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:04.310783 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4586ad86-f7d3-47b5-bae7-a9508b70b769 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:04.317424 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0f0da2-1e0e-4d22-8d10-7714fb139787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:04.318140 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0f0da2-1e0e-4d22-8d10-7714fb139787 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:04.318527 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0f0da2-1e0e-4d22-8d10-7714fb139787 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:04.318910 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0f0da2-1e0e-4d22-8d10-7714fb139787 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:04.320166 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0f0da2-1e0e-4d22-8d10-7714fb139787 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:04.322916 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0f0da2-1e0e-4d22-8d10-7714fb139787 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:04.341474 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1071/2160] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:30:04 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 15:30:04.345908 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0f0da2-1e0e-4d22-8d10-7714fb139787 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:04.358137 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77c7a3b-0115-47fd-b830-1722300fa64b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97acd23097d54bf7805c3cef60626ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:04.358618 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0f0da2-1e0e-4d22-8d10-7714fb139787 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:04.358914 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77c7a3b-0115-47fd-b830-1722300fa64b service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:04.359263 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77c7a3b-0115-47fd-b830-1722300fa64b service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:04.359606 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77c7a3b-0115-47fd-b830-1722300fa64b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:04.369512 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6486407c-4e71-4914-85f5-778fda435467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:04.370241 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6486407c-4e71-4914-85f5-778fda435467 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:04.370534 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6486407c-4e71-4914-85f5-778fda435467 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:04.370818 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6486407c-4e71-4914-85f5-778fda435467 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:04.372455 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6486407c-4e71-4914-85f5-778fda435467 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:04.374353 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6486407c-4e71-4914-85f5-778fda435467 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:04.383943 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:30:04.387467 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1072/2161] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:30:04 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 15:30:04.394823 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6486407c-4e71-4914-85f5-778fda435467 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:04.405464 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6486407c-4e71-4914-85f5-778fda435467 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:04.411489 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea41d7c-69aa-45c7-9cf2-4dfc352e605b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:04.412164 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea41d7c-69aa-45c7-9cf2-4dfc352e605b admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:04.412455 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea41d7c-69aa-45c7-9cf2-4dfc352e605b admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:04.412735 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea41d7c-69aa-45c7-9cf2-4dfc352e605b admin admin] PATH_INFO: `/v3/projects/3e8142d005184a81a20aed2b405f5e6b/users/2165028b49954fd6a13ced034f196cdd/roles/3fae3d3a28e147d3b2bede2378ff79ae` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:04.429097 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea41d7c-69aa-45c7-9cf2-4dfc352e605b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e8142d005184a81a20aed2b405f5e6b, user_id=2165028b49954fd6a13ced034f196cdd, role_id=3fae3d3a28e147d3b2bede2378ff79ae)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:04.432353 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea41d7c-69aa-45c7-9cf2-4dfc352e605b admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:04.434864 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77c7a3b-0115-47fd-b830-1722300fa64b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:04.436606 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77c7a3b-0115-47fd-b830-1722300fa64b service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:04.448137 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1090/2162] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:30:04 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:30:04.450231 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1073/2163] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 13 15:30:04 2022] PUT /identity/v3/projects/3e8142d005184a81a20aed2b405f5e6b/users/2165028b49954fd6a13ced034f196cdd/roles/3fae3d3a28e147d3b2bede2378ff79ae => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:30:04.462871 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc6d679-8d76-4ba0-ab51-c85f75e9403d None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:04.463159 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc6d679-8d76-4ba0-ab51-c85f75e9403d None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:04.463439 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc6d679-8d76-4ba0-ab51-c85f75e9403d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:04.469033 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea41d7c-69aa-45c7-9cf2-4dfc352e605b admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:04.505532 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-5fc6d679-8d76-4ba0-ab51-c85f75e9403d None None] MFA Rules not processed for user `2165028b49954fd6a13ced034f196cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:30:04.506831 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-5fc6d679-8d76-4ba0-ab51-c85f75e9403d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:04.583691 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea41d7c-69aa-45c7-9cf2-4dfc352e605b admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:04.592859 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e711c3-4260-4b9a-87c9-c82b6d97d011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:04.593932 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e711c3-4260-4b9a-87c9-c82b6d97d011 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:04.594501 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e711c3-4260-4b9a-87c9-c82b6d97d011 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:04.595051 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e711c3-4260-4b9a-87c9-c82b6d97d011 admin admin] PATH_INFO: `/v3/users/a298cda42d9e4dc0accc1f16aa763b58` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:04.597815 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e711c3-4260-4b9a-87c9-c82b6d97d011 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a298cda42d9e4dc0accc1f16aa763b58)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:04.603191 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1091/2164] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:30:04 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:30:04.603669 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e711c3-4260-4b9a-87c9-c82b6d97d011 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:04.604768 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc6d679-8d76-4ba0-ab51-c85f75e9403d None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:04.620708 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc6d679-8d76-4ba0-ab51-c85f75e9403d None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:04.628192 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fa654a-1dff-4937-98f5-274a68ebfa9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:04.630044 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fa654a-1dff-4937-98f5-274a68ebfa9f admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:04.630337 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fa654a-1dff-4937-98f5-274a68ebfa9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:04.630636 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fa654a-1dff-4937-98f5-274a68ebfa9f admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:04.631837 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fa654a-1dff-4937-98f5-274a68ebfa9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:04.643674 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fa654a-1dff-4937-98f5-274a68ebfa9f admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:04.676343 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:30:04.698146 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1092/2165] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 13 15:30:04 2022] POST /identity/v3/projects => generated 377 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:30:04.703471 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fa654a-1dff-4937-98f5-274a68ebfa9f admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:04.735087 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-d4e711c3-4260-4b9a-87c9-c82b6d97d011 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a298cda42d9e4dc0accc1f16aa763b58'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:04.735868 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-d4e711c3-4260-4b9a-87c9-c82b6d97d011 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a298cda42d9e4dc0accc1f16aa763b58'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:04.736721 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-d4e711c3-4260-4b9a-87c9-c82b6d97d011 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a298cda42d9e4dc0accc1f16aa763b58'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:04.748389 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-d4e711c3-4260-4b9a-87c9-c82b6d97d011 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a298cda42d9e4dc0accc1f16aa763b58'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:04.769285 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-d4e711c3-4260-4b9a-87c9-c82b6d97d011 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a298cda42d9e4dc0accc1f16aa763b58'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:04.789741 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1074/2166] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 13 15:30:04 2022] DELETE /identity/v3/users/a298cda42d9e4dc0accc1f16aa763b58 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 15:30:04.797347 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b614d847-4f97-4d2a-9820-ca5699b54cca None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:04.798301 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b614d847-4f97-4d2a-9820-ca5699b54cca None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:04.798650 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b614d847-4f97-4d2a-9820-ca5699b54cca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:04.812018 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fa654a-1dff-4937-98f5-274a68ebfa9f admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:04.830031 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-b614d847-4f97-4d2a-9820-ca5699b54cca None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:30:04.832402 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-b614d847-4f97-4d2a-9820-ca5699b54cca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:04.874981 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:30:04.905589 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef027bb-ae60-461f-b1fc-ac48733d4c4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:04.906240 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef027bb-ae60-461f-b1fc-ac48733d4c4a admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:04.906523 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef027bb-ae60-461f-b1fc-ac48733d4c4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:04.906796 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef027bb-ae60-461f-b1fc-ac48733d4c4a admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:04.907536 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef027bb-ae60-461f-b1fc-ac48733d4c4a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:04.909866 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1075/2167] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:30:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 15:30:04.910546 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef027bb-ae60-461f-b1fc-ac48733d4c4a admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:04.921337 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b614d847-4f97-4d2a-9820-ca5699b54cca None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:04.927588 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-b614d847-4f97-4d2a-9820-ca5699b54cca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:04.943768 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1093/2168] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 13 15:30:04 2022] POST /identity/v3/users => generated 295 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:30:04.944873 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef027bb-ae60-461f-b1fc-ac48733d4c4a admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:04.946605 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-0ef027bb-ae60-461f-b1fc-ac48733d4c4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:04.965914 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef027bb-ae60-461f-b1fc-ac48733d4c4a admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:04.971858 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf6e149-ab05-4d48-8629-832acbd9aec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:04.972728 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf6e149-ab05-4d48-8629-832acbd9aec1 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:04.973084 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf6e149-ab05-4d48-8629-832acbd9aec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:04.973427 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf6e149-ab05-4d48-8629-832acbd9aec1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:04.974183 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf6e149-ab05-4d48-8629-832acbd9aec1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:04.976127 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf6e149-ab05-4d48-8629-832acbd9aec1 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:04.994872 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1094/2169] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:30:04 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 15:30:04.996798 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf6e149-ab05-4d48-8629-832acbd9aec1 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:05.011960 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf6e149-ab05-4d48-8629-832acbd9aec1 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:05.014624 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b614d847-4f97-4d2a-9820-ca5699b54cca None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:05.029959 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b451c6-400a-49f0-920b-fdd2b3bc3ec7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41675154bbba47388040966f75d84c3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:05.030284 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8396bddc-c1c9-4a2a-83ef-39e29bb315c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:05.030393 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b451c6-400a-49f0-920b-fdd2b3bc3ec7 service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:05.030473 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8396bddc-c1c9-4a2a-83ef-39e29bb315c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:05.030544 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b451c6-400a-49f0-920b-fdd2b3bc3ec7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:05.030544 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b451c6-400a-49f0-920b-fdd2b3bc3ec7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:05.030670 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8396bddc-c1c9-4a2a-83ef-39e29bb315c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:05.030670 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8396bddc-c1c9-4a2a-83ef-39e29bb315c3 admin admin] PATH_INFO: `/v3/projects/1cc73de72bf3430b9a08b3fa6783deba/users/e9f25b85641544dbba9bbd4daec5c737/roles/f34412ad29f1478cba775b033129f71f` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:05.031868 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b451c6-400a-49f0-920b-fdd2b3bc3ec7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:05.036977 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b451c6-400a-49f0-920b-fdd2b3bc3ec7 service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:05.040815 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8396bddc-c1c9-4a2a-83ef-39e29bb315c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1cc73de72bf3430b9a08b3fa6783deba, user_id=e9f25b85641544dbba9bbd4daec5c737, role_id=f34412ad29f1478cba775b033129f71f)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:05.043649 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8396bddc-c1c9-4a2a-83ef-39e29bb315c3 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:05.046281 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1076/2170] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:30:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 15:30:05.058606 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1095/2171] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 13 15:30:04 2022] PUT /identity/v3/projects/1cc73de72bf3430b9a08b3fa6783deba/users/e9f25b85641544dbba9bbd4daec5c737/roles/f34412ad29f1478cba775b033129f71f => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:30:05.062914 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b451c6-400a-49f0-920b-fdd2b3bc3ec7 service neutron] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:05.073597 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b451c6-400a-49f0-920b-fdd2b3bc3ec7 service neutron] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:05.115494 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:30:05.134954 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bae7bea-19f2-447d-9487-1cfb2c28d552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:05.135571 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bae7bea-19f2-447d-9487-1cfb2c28d552 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:05.135857 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bae7bea-19f2-447d-9487-1cfb2c28d552 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:05.136134 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bae7bea-19f2-447d-9487-1cfb2c28d552 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:05.136798 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bae7bea-19f2-447d-9487-1cfb2c28d552 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:05.138438 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bae7bea-19f2-447d-9487-1cfb2c28d552 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:05.152669 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1077/2172] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:30:05 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 15:30:05.153963 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8396bddc-c1c9-4a2a-83ef-39e29bb315c3 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:05.164674 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8396bddc-c1c9-4a2a-83ef-39e29bb315c3 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:05.169458 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa346c39-5944-4ed3-bebf-af771fb76c2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:05.170155 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa346c39-5944-4ed3-bebf-af771fb76c2e admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:05.170443 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa346c39-5944-4ed3-bebf-af771fb76c2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:05.170722 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa346c39-5944-4ed3-bebf-af771fb76c2e admin admin] PATH_INFO: `/v3/projects/1cc73de72bf3430b9a08b3fa6783deba/users/e9f25b85641544dbba9bbd4daec5c737/roles/f34412ad29f1478cba775b033129f71f` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:05.172700 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa346c39-5944-4ed3-bebf-af771fb76c2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1cc73de72bf3430b9a08b3fa6783deba, user_id=e9f25b85641544dbba9bbd4daec5c737, role_id=f34412ad29f1478cba775b033129f71f)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:05.176085 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa346c39-5944-4ed3-bebf-af771fb76c2e admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:05.187112 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1096/2173] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 13 15:30:05 2022] PUT /identity/v3/projects/1cc73de72bf3430b9a08b3fa6783deba/users/e9f25b85641544dbba9bbd4daec5c737/roles/f34412ad29f1478cba775b033129f71f => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:30:05.200973 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da05e7d-da43-4e35-85cf-e57cff43e1bb None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:05.201478 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da05e7d-da43-4e35-85cf-e57cff43e1bb None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:05.201782 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da05e7d-da43-4e35-85cf-e57cff43e1bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:05.236199 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-3da05e7d-da43-4e35-85cf-e57cff43e1bb None None] MFA Rules not processed for user `e9f25b85641544dbba9bbd4daec5c737`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:30:05.237901 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-3da05e7d-da43-4e35-85cf-e57cff43e1bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:05.348620 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1078/2174] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:30:05 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:30:05.354029 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa346c39-5944-4ed3-bebf-af771fb76c2e admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:05.357944 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-fa346c39-5944-4ed3-bebf-af771fb76c2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:05.374409 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da05e7d-da43-4e35-85cf-e57cff43e1bb None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:05.380386 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-3da05e7d-da43-4e35-85cf-e57cff43e1bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:05.479699 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da05e7d-da43-4e35-85cf-e57cff43e1bb None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:05.484447 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917f7c68-8178-4608-aa3c-83c379921a83 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97acd23097d54bf7805c3cef60626ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:05.485074 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917f7c68-8178-4608-aa3c-83c379921a83 service cinder] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:05.485365 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917f7c68-8178-4608-aa3c-83c379921a83 service cinder] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:05.485759 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917f7c68-8178-4608-aa3c-83c379921a83 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:05.489073 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-917f7c68-8178-4608-aa3c-83c379921a83 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:05.500319 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa346c39-5944-4ed3-bebf-af771fb76c2e admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:05.508250 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc3118d-3eaa-4c71-a327-0f523d8735d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:05.509140 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc3118d-3eaa-4c71-a327-0f523d8735d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:05.509505 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc3118d-3eaa-4c71-a327-0f523d8735d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:05.510368 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc3118d-3eaa-4c71-a327-0f523d8735d8 admin admin] PATH_INFO: `/v3/users/183a5b768dbc4c859b8a6b337918b148` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:05.513055 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc3118d-3eaa-4c71-a327-0f523d8735d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=183a5b768dbc4c859b8a6b337918b148)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:05.515918 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc3118d-3eaa-4c71-a327-0f523d8735d8 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:05.596101 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-5bc3118d-3eaa-4c71-a327-0f523d8735d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '183a5b768dbc4c859b8a6b337918b148'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:05.598803 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-5bc3118d-3eaa-4c71-a327-0f523d8735d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '183a5b768dbc4c859b8a6b337918b148'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:05.599924 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-5bc3118d-3eaa-4c71-a327-0f523d8735d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '183a5b768dbc4c859b8a6b337918b148'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:05.613291 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917f7c68-8178-4608-aa3c-83c379921a83 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:05.615026 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917f7c68-8178-4608-aa3c-83c379921a83 service cinder] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:05.615415 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-5bc3118d-3eaa-4c71-a327-0f523d8735d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '183a5b768dbc4c859b8a6b337918b148'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:05.633454 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-5bc3118d-3eaa-4c71-a327-0f523d8735d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '183a5b768dbc4c859b8a6b337918b148'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:05.635426 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1079/2175] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:30:05 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:30:05.636345 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917f7c68-8178-4608-aa3c-83c379921a83 service cinder] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:05.639073 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-917f7c68-8178-4608-aa3c-83c379921a83 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:05.650229 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=84,keystone:INSERT=6,keystone:DELETE=10 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:30:05.661841 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917f7c68-8178-4608-aa3c-83c379921a83 service cinder] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:05.668979 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1097/2176] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 13 15:30:05 2022] DELETE /identity/v3/users/183a5b768dbc4c859b8a6b337918b148 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:30:05.671848 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2f0253-5b6e-42c1-b166-f7398d2b7f9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:05.672774 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2f0253-5b6e-42c1-b166-f7398d2b7f9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:05.673479 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2f0253-5b6e-42c1-b166-f7398d2b7f9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:05.673898 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2f0253-5b6e-42c1-b166-f7398d2b7f9a admin admin] PATH_INFO: `/v3/projects/a9c275776ca6457cb506fd319f3d2429` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:05.676011 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2f0253-5b6e-42c1-b166-f7398d2b7f9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9c275776ca6457cb506fd319f3d2429)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:05.678859 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2f0253-5b6e-42c1-b166-f7398d2b7f9a admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:05.729072 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:30:05.782841 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-4d2f0253-5b6e-42c1-b166-f7398d2b7f9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9c275776ca6457cb506fd319f3d2429', 'request_id': 'req-4d2f0253-5b6e-42c1-b166-f7398d2b7f9a'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:05.791303 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-4d2f0253-5b6e-42c1-b166-f7398d2b7f9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9c275776ca6457cb506fd319f3d2429', 'request_id': 'req-4d2f0253-5b6e-42c1-b166-f7398d2b7f9a'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:05.799078 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-4d2f0253-5b6e-42c1-b166-f7398d2b7f9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9c275776ca6457cb506fd319f3d2429', 'request_id': 'req-4d2f0253-5b6e-42c1-b166-f7398d2b7f9a'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:05.820490 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-4d2f0253-5b6e-42c1-b166-f7398d2b7f9a admin admin] The token cache is being invalidate because project a9c275776ca6457cb506fd319f3d2429 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 15:30:05.821258 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-4d2f0253-5b6e-42c1-b166-f7398d2b7f9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:05.822956 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-4d2f0253-5b6e-42c1-b166-f7398d2b7f9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:05.825189 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1080/2177] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 13 15:30:05 2022] DELETE /identity/v3/projects/a9c275776ca6457cb506fd319f3d2429 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:30:05.951187 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc3118d-3eaa-4c71-a327-0f523d8735d8 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:05.959388 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-5bc3118d-3eaa-4c71-a327-0f523d8735d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:06.110040 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc3118d-3eaa-4c71-a327-0f523d8735d8 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:06.184408 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bffa26-bb4d-4dfa-95f3-0a6eda27cc26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:06.184986 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bffa26-bb4d-4dfa-95f3-0a6eda27cc26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:06.185272 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bffa26-bb4d-4dfa-95f3-0a6eda27cc26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:06.185550 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bffa26-bb4d-4dfa-95f3-0a6eda27cc26 admin admin] PATH_INFO: `/v3/projects/2c71ad778f4b4f91be63013b6407678e` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:06.186731 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bffa26-bb4d-4dfa-95f3-0a6eda27cc26 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c71ad778f4b4f91be63013b6407678e)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:06.188661 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bffa26-bb4d-4dfa-95f3-0a6eda27cc26 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:06.244237 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-14bffa26-bb4d-4dfa-95f3-0a6eda27cc26 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c71ad778f4b4f91be63013b6407678e', 'request_id': 'req-14bffa26-bb4d-4dfa-95f3-0a6eda27cc26'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:06.250377 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-14bffa26-bb4d-4dfa-95f3-0a6eda27cc26 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c71ad778f4b4f91be63013b6407678e', 'request_id': 'req-14bffa26-bb4d-4dfa-95f3-0a6eda27cc26'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:06.258971 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-14bffa26-bb4d-4dfa-95f3-0a6eda27cc26 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c71ad778f4b4f91be63013b6407678e', 'request_id': 'req-14bffa26-bb4d-4dfa-95f3-0a6eda27cc26'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:06.270846 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-14bffa26-bb4d-4dfa-95f3-0a6eda27cc26 admin admin] The token cache is being invalidate because project 2c71ad778f4b4f91be63013b6407678e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 15:30:06.271213 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-14bffa26-bb4d-4dfa-95f3-0a6eda27cc26 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:06.271945 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-14bffa26-bb4d-4dfa-95f3-0a6eda27cc26 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:06.273745 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1098/2178] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 13 15:30:05 2022] DELETE /identity/v3/projects/2c71ad778f4b4f91be63013b6407678e => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:30:06.277792 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2f0253-5b6e-42c1-b166-f7398d2b7f9a admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:06.279215 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-4d2f0253-5b6e-42c1-b166-f7398d2b7f9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:06.292847 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2f0253-5b6e-42c1-b166-f7398d2b7f9a admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:06.353816 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4687b9-9864-48b4-a940-6f616521f617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:06.354452 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4687b9-9864-48b4-a940-6f616521f617 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:06.354733 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4687b9-9864-48b4-a940-6f616521f617 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:06.355010 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4687b9-9864-48b4-a940-6f616521f617 admin admin] PATH_INFO: `/v3/users/e0186eee5415415fa5cfa0c09538cc59` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:06.356143 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4687b9-9864-48b4-a940-6f616521f617 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0186eee5415415fa5cfa0c09538cc59)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:06.358104 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4687b9-9864-48b4-a940-6f616521f617 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:06.408380 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-df4687b9-9864-48b4-a940-6f616521f617 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0186eee5415415fa5cfa0c09538cc59'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:06.409225 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-df4687b9-9864-48b4-a940-6f616521f617 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0186eee5415415fa5cfa0c09538cc59'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:06.410047 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-df4687b9-9864-48b4-a940-6f616521f617 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0186eee5415415fa5cfa0c09538cc59'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:06.418491 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-df4687b9-9864-48b4-a940-6f616521f617 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0186eee5415415fa5cfa0c09538cc59'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:06.432138 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-df4687b9-9864-48b4-a940-6f616521f617 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0186eee5415415fa5cfa0c09538cc59'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:06.446517 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1081/2179] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 13 15:30:06 2022] DELETE /identity/v3/users/e0186eee5415415fa5cfa0c09538cc59 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:30:06.626606 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bffa26-bb4d-4dfa-95f3-0a6eda27cc26 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:06.630160 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-14bffa26-bb4d-4dfa-95f3-0a6eda27cc26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:06.648256 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bffa26-bb4d-4dfa-95f3-0a6eda27cc26 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:06.688662 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:30:06.729999 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879dc671-a597-4992-a6de-698108630db5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:06.730645 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879dc671-a597-4992-a6de-698108630db5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:06.730923 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879dc671-a597-4992-a6de-698108630db5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:06.731196 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879dc671-a597-4992-a6de-698108630db5 admin admin] PATH_INFO: `/v3/projects/269f6530472748c8845f7fdf7bbfcc39` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:06.732329 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879dc671-a597-4992-a6de-698108630db5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=269f6530472748c8845f7fdf7bbfcc39)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:06.734428 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879dc671-a597-4992-a6de-698108630db5 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:06.790566 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-879dc671-a597-4992-a6de-698108630db5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '269f6530472748c8845f7fdf7bbfcc39', 'request_id': 'req-879dc671-a597-4992-a6de-698108630db5'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:06.797340 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-879dc671-a597-4992-a6de-698108630db5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '269f6530472748c8845f7fdf7bbfcc39', 'request_id': 'req-879dc671-a597-4992-a6de-698108630db5'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:06.807191 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-879dc671-a597-4992-a6de-698108630db5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '269f6530472748c8845f7fdf7bbfcc39', 'request_id': 'req-879dc671-a597-4992-a6de-698108630db5'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:06.820442 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-879dc671-a597-4992-a6de-698108630db5 admin admin] The token cache is being invalidate because project 269f6530472748c8845f7fdf7bbfcc39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 15:30:06.820890 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-879dc671-a597-4992-a6de-698108630db5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:06.821603 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-879dc671-a597-4992-a6de-698108630db5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:06.823445 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1099/2180] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 13 15:30:06 2022] DELETE /identity/v3/projects/269f6530472748c8845f7fdf7bbfcc39 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:30:06.828761 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce700d3a-fdb8-410f-8240-ec9698b1ea37 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:06.829204 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce700d3a-fdb8-410f-8240-ec9698b1ea37 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:06.829303 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce700d3a-fdb8-410f-8240-ec9698b1ea37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:06.852848 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-ce700d3a-fdb8-410f-8240-ec9698b1ea37 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:30:06.854335 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-ce700d3a-fdb8-410f-8240-ec9698b1ea37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:06.873147 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:30:06.934151 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1082/2181] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:30:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 15:30:06.942112 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7898d53-d7c3-4a24-9538-04796e336b41 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:06.942397 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7898d53-d7c3-4a24-9538-04796e336b41 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:06.942671 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7898d53-d7c3-4a24-9538-04796e336b41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:06.962525 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce700d3a-fdb8-410f-8240-ec9698b1ea37 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:06.964527 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-ce700d3a-fdb8-410f-8240-ec9698b1ea37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:06.976539 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-f7898d53-d7c3-4a24-9538-04796e336b41 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:30:06.978239 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-f7898d53-d7c3-4a24-9538-04796e336b41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:06.981294 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce700d3a-fdb8-410f-8240-ec9698b1ea37 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:06.988753 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1100/2182] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:30:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:30:06.990674 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15d9827-6704-4563-b4c1-86a3512c2fcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:06.991404 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15d9827-6704-4563-b4c1-86a3512c2fcf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:06.991765 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15d9827-6704-4563-b4c1-86a3512c2fcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:06.992112 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15d9827-6704-4563-b4c1-86a3512c2fcf admin admin] PATH_INFO: `/v3/users/9024bfbaba2842ae9dfff62f0c2a1000` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:06.993109 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7898d53-d7c3-4a24-9538-04796e336b41 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:06.993550 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15d9827-6704-4563-b4c1-86a3512c2fcf admin admin] RBAC: Authorizing `identity:delete_user(user_id=9024bfbaba2842ae9dfff62f0c2a1000)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:06.995899 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15d9827-6704-4563-b4c1-86a3512c2fcf admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:07.004583 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7898d53-d7c3-4a24-9538-04796e336b41 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:07.009929 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe9aa22-b1b4-48c1-8991-61ff06de2ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:07.010547 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe9aa22-b1b4-48c1-8991-61ff06de2ad5 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:07.010834 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe9aa22-b1b4-48c1-8991-61ff06de2ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:07.011114 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe9aa22-b1b4-48c1-8991-61ff06de2ad5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:07.011765 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe9aa22-b1b4-48c1-8991-61ff06de2ad5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:30:07.012076 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe9aa22-b1b4-48c1-8991-61ff06de2ad5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:07.013839 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe9aa22-b1b4-48c1-8991-61ff06de2ad5 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:07.032447 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1101/2183] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Sep 13 15:30:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 15:30:07.033546 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe9aa22-b1b4-48c1-8991-61ff06de2ad5 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:07.044746 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe9aa22-b1b4-48c1-8991-61ff06de2ad5 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:07.050879 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80116903-d2f3-47fe-a0f9-88b781a4d95b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:07.052198 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80116903-d2f3-47fe-a0f9-88b781a4d95b admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:07.052198 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80116903-d2f3-47fe-a0f9-88b781a4d95b admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:07.052198 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80116903-d2f3-47fe-a0f9-88b781a4d95b admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:07.053220 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80116903-d2f3-47fe-a0f9-88b781a4d95b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:07.055261 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80116903-d2f3-47fe-a0f9-88b781a4d95b admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:07.059271 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-c15d9827-6704-4563-b4c1-86a3512c2fcf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9024bfbaba2842ae9dfff62f0c2a1000'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:07.060152 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-c15d9827-6704-4563-b4c1-86a3512c2fcf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9024bfbaba2842ae9dfff62f0c2a1000'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:07.060790 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-c15d9827-6704-4563-b4c1-86a3512c2fcf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9024bfbaba2842ae9dfff62f0c2a1000'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:07.070247 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-c15d9827-6704-4563-b4c1-86a3512c2fcf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9024bfbaba2842ae9dfff62f0c2a1000'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:07.085556 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-c15d9827-6704-4563-b4c1-86a3512c2fcf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9024bfbaba2842ae9dfff62f0c2a1000'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:07.087153 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1102/2184] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 13 15:30:07 2022] POST /identity/v3/projects => generated 365 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:30:07.091664 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80116903-d2f3-47fe-a0f9-88b781a4d95b admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:07.094195 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-80116903-d2f3-47fe-a0f9-88b781a4d95b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:07.110793 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1083/2185] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 13 15:30:06 2022] DELETE /identity/v3/users/9024bfbaba2842ae9dfff62f0c2a1000 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 15:30:07.116433 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64015c19-a2ed-4460-9651-ab45202b03d5 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:07.116730 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64015c19-a2ed-4460-9651-ab45202b03d5 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:07.117002 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64015c19-a2ed-4460-9651-ab45202b03d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:07.142713 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-64015c19-a2ed-4460-9651-ab45202b03d5 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:30:07.144308 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-64015c19-a2ed-4460-9651-ab45202b03d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:07.171978 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80116903-d2f3-47fe-a0f9-88b781a4d95b admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:07.200711 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:30:07.226630 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1084/2186] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:30:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:30:07.238815 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64015c19-a2ed-4460-9651-ab45202b03d5 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:07.240501 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-64015c19-a2ed-4460-9651-ab45202b03d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:07.250628 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c6f7f3-93c7-44e6-8022-ef5a48ab794d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:07.251348 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c6f7f3-93c7-44e6-8022-ef5a48ab794d admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:07.251809 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c6f7f3-93c7-44e6-8022-ef5a48ab794d admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:07.251935 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c6f7f3-93c7-44e6-8022-ef5a48ab794d admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:07.253403 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c6f7f3-93c7-44e6-8022-ef5a48ab794d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:07.255717 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c6f7f3-93c7-44e6-8022-ef5a48ab794d admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:07.281459 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1103/2187] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 13 15:30:07 2022] POST /identity/v3/users => generated 283 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:30:07.287055 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c6f7f3-93c7-44e6-8022-ef5a48ab794d admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:07.290463 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:30:07.297456 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c6f7f3-93c7-44e6-8022-ef5a48ab794d admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:07.304152 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c2fe2e-0bcc-4e2f-911f-9db189f62d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:07.304759 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c2fe2e-0bcc-4e2f-911f-9db189f62d45 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:07.305040 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c2fe2e-0bcc-4e2f-911f-9db189f62d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:07.305307 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c2fe2e-0bcc-4e2f-911f-9db189f62d45 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:07.305992 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c2fe2e-0bcc-4e2f-911f-9db189f62d45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:07.307914 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c2fe2e-0bcc-4e2f-911f-9db189f62d45 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:07.321882 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1104/2188] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:30:07 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 15:30:07.324067 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64015c19-a2ed-4460-9651-ab45202b03d5 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:07.326691 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c2fe2e-0bcc-4e2f-911f-9db189f62d45 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:07.328770 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7059220b-8cee-410e-8b0c-15460efb4055 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41675154bbba47388040966f75d84c3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:07.329455 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7059220b-8cee-410e-8b0c-15460efb4055 service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:07.329894 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7059220b-8cee-410e-8b0c-15460efb4055 service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:07.330293 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7059220b-8cee-410e-8b0c-15460efb4055 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:07.337870 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c2fe2e-0bcc-4e2f-911f-9db189f62d45 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:07.342679 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b09d6b-3a8d-4d36-964d-d3b3faca72fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:07.342978 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7059220b-8cee-410e-8b0c-15460efb4055 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:07.343500 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b09d6b-3a8d-4d36-964d-d3b3faca72fc admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:07.343880 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b09d6b-3a8d-4d36-964d-d3b3faca72fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:07.344362 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b09d6b-3a8d-4d36-964d-d3b3faca72fc admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:07.344775 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7059220b-8cee-410e-8b0c-15460efb4055 service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:07.345270 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b09d6b-3a8d-4d36-964d-d3b3faca72fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:07.351605 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b09d6b-3a8d-4d36-964d-d3b3faca72fc admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:07.356463 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1085/2189] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:30:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 15:30:07.360177 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7059220b-8cee-410e-8b0c-15460efb4055 service neutron] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:07.362482 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-7059220b-8cee-410e-8b0c-15460efb4055 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:07.365742 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1105/2190] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:30:07 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 15:30:07.367626 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b09d6b-3a8d-4d36-964d-d3b3faca72fc admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:07.378383 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b09d6b-3a8d-4d36-964d-d3b3faca72fc admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:07.383097 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8302c275-8583-4768-9c31-eccb4c927168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:07.383756 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8302c275-8583-4768-9c31-eccb4c927168 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:07.384036 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8302c275-8583-4768-9c31-eccb4c927168 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:07.384311 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8302c275-8583-4768-9c31-eccb4c927168 admin admin] PATH_INFO: `/v3/projects/4fd0342de8d948629672ce5570257244/users/994fdda77ddc47baa74ab4bdb9d1d128/roles/3fae3d3a28e147d3b2bede2378ff79ae` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:07.400977 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8302c275-8583-4768-9c31-eccb4c927168 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fd0342de8d948629672ce5570257244, user_id=994fdda77ddc47baa74ab4bdb9d1d128, role_id=3fae3d3a28e147d3b2bede2378ff79ae)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:07.404638 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8302c275-8583-4768-9c31-eccb4c927168 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:07.421264 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1106/2191] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 13 15:30:07 2022] PUT /identity/v3/projects/4fd0342de8d948629672ce5570257244/users/994fdda77ddc47baa74ab4bdb9d1d128/roles/3fae3d3a28e147d3b2bede2378ff79ae => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:30:07.431512 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759095ab-207c-41d3-88e8-7dd784562bd3 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:07.431839 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759095ab-207c-41d3-88e8-7dd784562bd3 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:07.432162 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759095ab-207c-41d3-88e8-7dd784562bd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:07.444074 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7059220b-8cee-410e-8b0c-15460efb4055 service neutron] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:07.462760 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-759095ab-207c-41d3-88e8-7dd784562bd3 None None] MFA Rules not processed for user `994fdda77ddc47baa74ab4bdb9d1d128`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:30:07.464597 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-759095ab-207c-41d3-88e8-7dd784562bd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:07.506985 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719127c5-6405-4699-97b7-897e126be9ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97acd23097d54bf7805c3cef60626ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:07.507634 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719127c5-6405-4699-97b7-897e126be9ba service cinder] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:07.508335 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719127c5-6405-4699-97b7-897e126be9ba service cinder] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:07.508615 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719127c5-6405-4699-97b7-897e126be9ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:07.510539 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-719127c5-6405-4699-97b7-897e126be9ba service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:07.543632 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1107/2192] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:30:07 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 15:30:07.548018 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759095ab-207c-41d3-88e8-7dd784562bd3 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:07.583738 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719127c5-6405-4699-97b7-897e126be9ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:07.585332 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719127c5-6405-4699-97b7-897e126be9ba service cinder] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:07.598899 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1086/2193] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:30:07 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 15:30:07.636481 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759095ab-207c-41d3-88e8-7dd784562bd3 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:07.651671 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd87bc4-d0df-4b08-b5fb-b29ecab891a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:07.652349 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd87bc4-d0df-4b08-b5fb-b29ecab891a0 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:07.652633 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd87bc4-d0df-4b08-b5fb-b29ecab891a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:07.652970 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd87bc4-d0df-4b08-b5fb-b29ecab891a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:07.654172 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd87bc4-d0df-4b08-b5fb-b29ecab891a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:07.656599 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd87bc4-d0df-4b08-b5fb-b29ecab891a0 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:07.665944 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719127c5-6405-4699-97b7-897e126be9ba service cinder] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:07.667424 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-719127c5-6405-4699-97b7-897e126be9ba service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:07.669113 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:30:07.703138 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719127c5-6405-4699-97b7-897e126be9ba service cinder] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:07.703706 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1108/2194] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 13 15:30:07 2022] POST /identity/v3/projects => generated 365 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 15:30:07.708307 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd87bc4-d0df-4b08-b5fb-b29ecab891a0 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:07.764053 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:30:07.778421 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d32e00-45dc-46a3-a4f4-27f1c3a2f920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:07.779057 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d32e00-45dc-46a3-a4f4-27f1c3a2f920 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:07.779345 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d32e00-45dc-46a3-a4f4-27f1c3a2f920 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:07.779618 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d32e00-45dc-46a3-a4f4-27f1c3a2f920 admin admin] PATH_INFO: `/v3/projects/b693df38b0d84022a8a463b4f841cdc9` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:07.780977 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d32e00-45dc-46a3-a4f4-27f1c3a2f920 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b693df38b0d84022a8a463b4f841cdc9)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:07.782897 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d32e00-45dc-46a3-a4f4-27f1c3a2f920 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:07.812329 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd87bc4-d0df-4b08-b5fb-b29ecab891a0 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:07.818481 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63aa50f2-5644-4057-801f-a036b5aa463c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:07.819307 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aa50f2-5644-4057-801f-a036b5aa463c admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:07.819550 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aa50f2-5644-4057-801f-a036b5aa463c admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:07.819873 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aa50f2-5644-4057-801f-a036b5aa463c admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:07.820590 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63aa50f2-5644-4057-801f-a036b5aa463c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:07.822700 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63aa50f2-5644-4057-801f-a036b5aa463c admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:07.840490 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-35d32e00-45dc-46a3-a4f4-27f1c3a2f920 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b693df38b0d84022a8a463b4f841cdc9', 'request_id': 'req-35d32e00-45dc-46a3-a4f4-27f1c3a2f920'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:07.853040 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-35d32e00-45dc-46a3-a4f4-27f1c3a2f920 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b693df38b0d84022a8a463b4f841cdc9', 'request_id': 'req-35d32e00-45dc-46a3-a4f4-27f1c3a2f920'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:07.854816 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1109/2195] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 13 15:30:07 2022] POST /identity/v3/users => generated 289 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 15:30:07.858956 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63aa50f2-5644-4057-801f-a036b5aa463c admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:07.862599 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-35d32e00-45dc-46a3-a4f4-27f1c3a2f920 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b693df38b0d84022a8a463b4f841cdc9', 'request_id': 'req-35d32e00-45dc-46a3-a4f4-27f1c3a2f920'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:07.872251 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63aa50f2-5644-4057-801f-a036b5aa463c admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:07.884560 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-35d32e00-45dc-46a3-a4f4-27f1c3a2f920 admin admin] The token cache is being invalidate because project b693df38b0d84022a8a463b4f841cdc9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 15:30:07.884994 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-35d32e00-45dc-46a3-a4f4-27f1c3a2f920 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:07.886196 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-35d32e00-45dc-46a3-a4f4-27f1c3a2f920 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:07.888594 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1087/2196] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 13 15:30:07 2022] DELETE /identity/v3/projects/b693df38b0d84022a8a463b4f841cdc9 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 15:30:07.895679 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9126fc-0b46-49e0-8254-6f3ef1b1a58f None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:07.896159 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9126fc-0b46-49e0-8254-6f3ef1b1a58f None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:07.896851 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9126fc-0b46-49e0-8254-6f3ef1b1a58f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:07.924382 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-3e9126fc-0b46-49e0-8254-6f3ef1b1a58f None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:30:07.925745 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-3e9126fc-0b46-49e0-8254-6f3ef1b1a58f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:07.959508 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f84f38-d87e-4f48-a36b-d7a7f8641885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:07.961171 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f84f38-d87e-4f48-a36b-d7a7f8641885 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:07.961171 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f84f38-d87e-4f48-a36b-d7a7f8641885 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:07.961171 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f84f38-d87e-4f48-a36b-d7a7f8641885 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:07.961574 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f84f38-d87e-4f48-a36b-d7a7f8641885 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:07.963485 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f84f38-d87e-4f48-a36b-d7a7f8641885 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:07.976323 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1110/2197] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:30:07 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 15:30:07.980596 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f84f38-d87e-4f48-a36b-d7a7f8641885 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:07.983362 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-26f84f38-d87e-4f48-a36b-d7a7f8641885 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:08.002538 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f84f38-d87e-4f48-a36b-d7a7f8641885 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:08.009928 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59929a99-2c2d-4262-a667-9122649b7b1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:08.010897 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59929a99-2c2d-4262-a667-9122649b7b1b admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:08.011403 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59929a99-2c2d-4262-a667-9122649b7b1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:08.011756 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59929a99-2c2d-4262-a667-9122649b7b1b admin admin] PATH_INFO: `/v3/projects/05ef63e990b5472fa73b04db8c8e3937/users/872a8629536d4f209ea4d10cc051028b/roles/f34412ad29f1478cba775b033129f71f` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:08.013371 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1088/2198] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:30:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:30:08.014446 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9126fc-0b46-49e0-8254-6f3ef1b1a58f None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:08.015774 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-3e9126fc-0b46-49e0-8254-6f3ef1b1a58f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:08.034504 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59929a99-2c2d-4262-a667-9122649b7b1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=05ef63e990b5472fa73b04db8c8e3937, user_id=872a8629536d4f209ea4d10cc051028b, role_id=f34412ad29f1478cba775b033129f71f)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:08.038958 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59929a99-2c2d-4262-a667-9122649b7b1b admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:08.059442 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1111/2199] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 13 15:30:07 2022] PUT /identity/v3/projects/05ef63e990b5472fa73b04db8c8e3937/users/872a8629536d4f209ea4d10cc051028b/roles/f34412ad29f1478cba775b033129f71f => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 15:30:08.064092 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68edbe36-b508-4de6-b05f-fa2c886ba799 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:08.064380 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68edbe36-b508-4de6-b05f-fa2c886ba799 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:08.064663 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68edbe36-b508-4de6-b05f-fa2c886ba799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:08.087659 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-68edbe36-b508-4de6-b05f-fa2c886ba799 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:30:08.089306 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-68edbe36-b508-4de6-b05f-fa2c886ba799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:08.107453 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9126fc-0b46-49e0-8254-6f3ef1b1a58f None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:08.149104 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:30:08.164488 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:30:08.190373 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1112/2200] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:30:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:30:08.191133 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68edbe36-b508-4de6-b05f-fa2c886ba799 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:08.201069 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3463b508-3eb3-4500-a440-1a59e62a060b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97acd23097d54bf7805c3cef60626ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:08.201642 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68edbe36-b508-4de6-b05f-fa2c886ba799 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:08.202218 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3463b508-3eb3-4500-a440-1a59e62a060b service cinder] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:08.202504 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3463b508-3eb3-4500-a440-1a59e62a060b service cinder] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:08.202917 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3463b508-3eb3-4500-a440-1a59e62a060b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:08.207706 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-3463b508-3eb3-4500-a440-1a59e62a060b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:08.207827 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b0d2a3-5439-4d0c-9c43-bd9c59b5641f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:08.207827 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b0d2a3-5439-4d0c-9c43-bd9c59b5641f admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:08.208083 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b0d2a3-5439-4d0c-9c43-bd9c59b5641f admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:08.208364 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b0d2a3-5439-4d0c-9c43-bd9c59b5641f admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:08.209804 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b0d2a3-5439-4d0c-9c43-bd9c59b5641f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:08.211857 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b0d2a3-5439-4d0c-9c43-bd9c59b5641f admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:08.225045 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1113/2201] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:30:08 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 15:30:08.226207 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b0d2a3-5439-4d0c-9c43-bd9c59b5641f admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:08.237786 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b0d2a3-5439-4d0c-9c43-bd9c59b5641f admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:08.244519 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93c9fa0-c31f-44a6-ac01-3bdf662b8ddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:08.258118 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93c9fa0-c31f-44a6-ac01-3bdf662b8ddd admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:08.258118 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93c9fa0-c31f-44a6-ac01-3bdf662b8ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:08.258118 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93c9fa0-c31f-44a6-ac01-3bdf662b8ddd admin admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:08.258118 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93c9fa0-c31f-44a6-ac01-3bdf662b8ddd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:30:08.258118 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93c9fa0-c31f-44a6-ac01-3bdf662b8ddd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:08.258118 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93c9fa0-c31f-44a6-ac01-3bdf662b8ddd admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:08.262293 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1114/2202] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Sep 13 15:30:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:30:08.262873 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93c9fa0-c31f-44a6-ac01-3bdf662b8ddd admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:08.276624 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93c9fa0-c31f-44a6-ac01-3bdf662b8ddd admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:08.282594 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b076354f-c489-4a7a-a73f-f7a3f4b213a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:08.284347 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b076354f-c489-4a7a-a73f-f7a3f4b213a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:08.284727 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b076354f-c489-4a7a-a73f-f7a3f4b213a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:08.285001 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b076354f-c489-4a7a-a73f-f7a3f4b213a4 admin admin] PATH_INFO: `/v3/projects/05ef63e990b5472fa73b04db8c8e3937/users/872a8629536d4f209ea4d10cc051028b/roles/f34412ad29f1478cba775b033129f71f` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:08.287756 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b076354f-c489-4a7a-a73f-f7a3f4b213a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05ef63e990b5472fa73b04db8c8e3937, user_id=872a8629536d4f209ea4d10cc051028b, role_id=f34412ad29f1478cba775b033129f71f)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:08.290728 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b076354f-c489-4a7a-a73f-f7a3f4b213a4 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:08.299014 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3463b508-3eb3-4500-a440-1a59e62a060b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:08.301255 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3463b508-3eb3-4500-a440-1a59e62a060b service cinder] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:08.302080 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1115/2203] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 13 15:30:08 2022] PUT /identity/v3/projects/05ef63e990b5472fa73b04db8c8e3937/users/872a8629536d4f209ea4d10cc051028b/roles/f34412ad29f1478cba775b033129f71f => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:30:08.306554 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b076354f-c489-4a7a-a73f-f7a3f4b213a4 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:08.313378 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1089/2204] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:30:08 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:30:08.315085 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dafd854-01a4-4d7a-bc94-949af03e6d32 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:08.315377 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dafd854-01a4-4d7a-bc94-949af03e6d32 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:08.315769 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dafd854-01a4-4d7a-bc94-949af03e6d32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:08.361287 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-0dafd854-01a4-4d7a-bc94-949af03e6d32 None None] MFA Rules not processed for user `872a8629536d4f209ea4d10cc051028b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:30:08.363394 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-0dafd854-01a4-4d7a-bc94-949af03e6d32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:08.394437 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b076354f-c489-4a7a-a73f-f7a3f4b213a4 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:08.402769 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6954983-b29b-4955-8d8b-b1b3bea9ec37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:08.406580 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6954983-b29b-4955-8d8b-b1b3bea9ec37 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:08.408229 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6954983-b29b-4955-8d8b-b1b3bea9ec37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:08.410343 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6954983-b29b-4955-8d8b-b1b3bea9ec37 admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:08.411006 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6954983-b29b-4955-8d8b-b1b3bea9ec37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:08.415230 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6954983-b29b-4955-8d8b-b1b3bea9ec37 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:08.468470 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1116/2205] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 13 15:30:08 2022] POST /identity/v3/projects => generated 359 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:30:08.469450 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6954983-b29b-4955-8d8b-b1b3bea9ec37 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:08.473369 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-b6954983-b29b-4955-8d8b-b1b3bea9ec37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:08.483166 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1090/2206] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:30:08 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:30:08.484025 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dafd854-01a4-4d7a-bc94-949af03e6d32 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:08.498848 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dafd854-01a4-4d7a-bc94-949af03e6d32 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:08.542122 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6954983-b29b-4955-8d8b-b1b3bea9ec37 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:08.546223 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c45486-7b93-4e63-8871-1a8360028a06 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97acd23097d54bf7805c3cef60626ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:08.546941 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c45486-7b93-4e63-8871-1a8360028a06 service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:08.547257 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c45486-7b93-4e63-8871-1a8360028a06 service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:08.547530 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c45486-7b93-4e63-8871-1a8360028a06 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:08.550496 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-c3c45486-7b93-4e63-8871-1a8360028a06 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:08.573841 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ffc2bd-5f99-4f94-a316-181100f9bb56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:08.574456 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ffc2bd-5f99-4f94-a316-181100f9bb56 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:08.574750 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ffc2bd-5f99-4f94-a316-181100f9bb56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:08.575027 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ffc2bd-5f99-4f94-a316-181100f9bb56 admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:08.575665 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ffc2bd-5f99-4f94-a316-181100f9bb56 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:08.577901 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ffc2bd-5f99-4f94-a316-181100f9bb56 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:08.596795 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:30:08.604415 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:30:08.605382 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1091/2207] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 13 15:30:08 2022] POST /identity/v3/users => generated 280 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:30:08.606658 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ffc2bd-5f99-4f94-a316-181100f9bb56 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:08.619031 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ffc2bd-5f99-4f94-a316-181100f9bb56 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:08.623582 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06404cd-b792-4442-8d02-ec7927d56db9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97acd23097d54bf7805c3cef60626ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:08.624138 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c45486-7b93-4e63-8871-1a8360028a06 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:08.624243 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06404cd-b792-4442-8d02-ec7927d56db9 service cinder] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:08.624452 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06404cd-b792-4442-8d02-ec7927d56db9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:08.624721 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06404cd-b792-4442-8d02-ec7927d56db9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:08.625634 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c45486-7b93-4e63-8871-1a8360028a06 service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:08.635569 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1117/2208] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:30:08 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:30:08.636407 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c45486-7b93-4e63-8871-1a8360028a06 service cinder] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:08.647005 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c45486-7b93-4e63-8871-1a8360028a06 service cinder] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:08.651889 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbc9018-b04b-42a7-917c-a36c1fe40c7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:08.652409 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbc9018-b04b-42a7-917c-a36c1fe40c7e admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:08.652771 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbc9018-b04b-42a7-917c-a36c1fe40c7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:08.653056 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbc9018-b04b-42a7-917c-a36c1fe40c7e admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:08.653726 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbc9018-b04b-42a7-917c-a36c1fe40c7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:08.655391 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbc9018-b04b-42a7-917c-a36c1fe40c7e admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:08.666249 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1118/2209] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:30:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 15:30:08.670059 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbc9018-b04b-42a7-917c-a36c1fe40c7e admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:08.681123 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbc9018-b04b-42a7-917c-a36c1fe40c7e admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:08.686740 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa4954b-5d7c-46a1-ad5b-401e028e5f36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:08.687345 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa4954b-5d7c-46a1-ad5b-401e028e5f36 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:08.687624 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa4954b-5d7c-46a1-ad5b-401e028e5f36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:08.687907 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa4954b-5d7c-46a1-ad5b-401e028e5f36 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:08.688558 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa4954b-5d7c-46a1-ad5b-401e028e5f36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:08.690407 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa4954b-5d7c-46a1-ad5b-401e028e5f36 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:08.691397 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06404cd-b792-4442-8d02-ec7927d56db9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:08.693053 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06404cd-b792-4442-8d02-ec7927d56db9 service cinder] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:08.705933 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1119/2210] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:30:08 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 15:30:08.710880 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1092/2211] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:30:08 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:30:08.710967 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa4954b-5d7c-46a1-ad5b-401e028e5f36 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:08.723433 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa4954b-5d7c-46a1-ad5b-401e028e5f36 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:08.729223 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599cac7c-4709-4c47-8c06-5ab56ad36d04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:08.730157 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599cac7c-4709-4c47-8c06-5ab56ad36d04 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:08.730391 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599cac7c-4709-4c47-8c06-5ab56ad36d04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:08.730746 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599cac7c-4709-4c47-8c06-5ab56ad36d04 admin admin] PATH_INFO: `/v3/projects/3d7db1894b53440993d0ba99a0a8107d/users/51eb48bdb3d747dd9d59bc1286311675/roles/3fae3d3a28e147d3b2bede2378ff79ae` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:08.747657 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599cac7c-4709-4c47-8c06-5ab56ad36d04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d7db1894b53440993d0ba99a0a8107d, user_id=51eb48bdb3d747dd9d59bc1286311675, role_id=3fae3d3a28e147d3b2bede2378ff79ae)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:08.750618 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599cac7c-4709-4c47-8c06-5ab56ad36d04 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:08.765645 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1120/2212] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 13 15:30:08 2022] PUT /identity/v3/projects/3d7db1894b53440993d0ba99a0a8107d/users/51eb48bdb3d747dd9d59bc1286311675/roles/3fae3d3a28e147d3b2bede2378ff79ae => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:30:08.776464 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6012f74e-0183-4c36-836f-c07a12192616 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:08.776762 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6012f74e-0183-4c36-836f-c07a12192616 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:08.777042 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6012f74e-0183-4c36-836f-c07a12192616 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:08.818847 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-6012f74e-0183-4c36-836f-c07a12192616 None None] MFA Rules not processed for user `51eb48bdb3d747dd9d59bc1286311675`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:30:08.820202 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-6012f74e-0183-4c36-836f-c07a12192616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:08.896971 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1093/2213] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:30:08 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:30:08.913098 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599cac7c-4709-4c47-8c06-5ab56ad36d04 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:08.990610 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599cac7c-4709-4c47-8c06-5ab56ad36d04 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:08.995451 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fe0331-27f5-4a01-92ff-fd8fc0ae11a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97acd23097d54bf7805c3cef60626ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:08.996343 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fe0331-27f5-4a01-92ff-fd8fc0ae11a6 service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:08.996631 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fe0331-27f5-4a01-92ff-fd8fc0ae11a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:08.996931 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fe0331-27f5-4a01-92ff-fd8fc0ae11a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:09.007357 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fe0331-27f5-4a01-92ff-fd8fc0ae11a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:09.008795 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fe0331-27f5-4a01-92ff-fd8fc0ae11a6 service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:09.018400 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1121/2214] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:30:08 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:30:09.433043 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6012f74e-0183-4c36-836f-c07a12192616 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:09.512735 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6012f74e-0183-4c36-836f-c07a12192616 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:09.518501 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65daf21-ad8d-4184-b2e9-58f988436d54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:09.522051 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65daf21-ad8d-4184-b2e9-58f988436d54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:09.522344 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65daf21-ad8d-4184-b2e9-58f988436d54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:09.522583 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65daf21-ad8d-4184-b2e9-58f988436d54 admin admin] PATH_INFO: `/v3/users/994fdda77ddc47baa74ab4bdb9d1d128` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:09.524409 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65daf21-ad8d-4184-b2e9-58f988436d54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=994fdda77ddc47baa74ab4bdb9d1d128)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:09.526599 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65daf21-ad8d-4184-b2e9-58f988436d54 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:09.558157 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:30:09.588673 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-f65daf21-ad8d-4184-b2e9-58f988436d54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '994fdda77ddc47baa74ab4bdb9d1d128'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:09.589330 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-f65daf21-ad8d-4184-b2e9-58f988436d54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '994fdda77ddc47baa74ab4bdb9d1d128'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:09.590050 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-f65daf21-ad8d-4184-b2e9-58f988436d54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '994fdda77ddc47baa74ab4bdb9d1d128'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:09.598915 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-f65daf21-ad8d-4184-b2e9-58f988436d54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '994fdda77ddc47baa74ab4bdb9d1d128'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:09.616193 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-f65daf21-ad8d-4184-b2e9-58f988436d54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '994fdda77ddc47baa74ab4bdb9d1d128'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:09.631541 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1094/2215] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 13 15:30:09 2022] DELETE /identity/v3/users/994fdda77ddc47baa74ab4bdb9d1d128 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:30:09.636516 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4c63b0-f7b9-47df-8d54-eb51f81e6c67 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:09.636836 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4c63b0-f7b9-47df-8d54-eb51f81e6c67 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:09.637226 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4c63b0-f7b9-47df-8d54-eb51f81e6c67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:09.657667 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-fc4c63b0-f7b9-47df-8d54-eb51f81e6c67 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:30:09.658324 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65daf21-ad8d-4184-b2e9-58f988436d54 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:09.659239 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-fc4c63b0-f7b9-47df-8d54-eb51f81e6c67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:09.660080 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-f65daf21-ad8d-4184-b2e9-58f988436d54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:09.728662 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1122/2216] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:30:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:30:09.734910 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65daf21-ad8d-4184-b2e9-58f988436d54 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:09.738441 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4c63b0-f7b9-47df-8d54-eb51f81e6c67 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:09.739786 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7113ad0-fd91-4379-85e8-51fa2b684e58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:09.739920 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-fc4c63b0-f7b9-47df-8d54-eb51f81e6c67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:09.740419 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7113ad0-fd91-4379-85e8-51fa2b684e58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:09.740699 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7113ad0-fd91-4379-85e8-51fa2b684e58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:09.740972 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7113ad0-fd91-4379-85e8-51fa2b684e58 admin admin] PATH_INFO: `/v3/users/2bb75f56bea642f6a03ee1d1d8c95ac2` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:09.742276 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7113ad0-fd91-4379-85e8-51fa2b684e58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2bb75f56bea642f6a03ee1d1d8c95ac2)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:09.744201 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7113ad0-fd91-4379-85e8-51fa2b684e58 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:09.792472 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:30:09.793922 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-a7113ad0-fd91-4379-85e8-51fa2b684e58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2bb75f56bea642f6a03ee1d1d8c95ac2'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:09.794760 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-a7113ad0-fd91-4379-85e8-51fa2b684e58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2bb75f56bea642f6a03ee1d1d8c95ac2'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:09.795540 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-a7113ad0-fd91-4379-85e8-51fa2b684e58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2bb75f56bea642f6a03ee1d1d8c95ac2'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:09.803552 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-a7113ad0-fd91-4379-85e8-51fa2b684e58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2bb75f56bea642f6a03ee1d1d8c95ac2'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:09.805407 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4c63b0-f7b9-47df-8d54-eb51f81e6c67 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:09.809041 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcbc597-7cc4-4e89-8299-ce9d915a73ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41675154bbba47388040966f75d84c3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:09.809652 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcbc597-7cc4-4e89-8299-ce9d915a73ed service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:09.809961 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcbc597-7cc4-4e89-8299-ce9d915a73ed service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:09.810238 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcbc597-7cc4-4e89-8299-ce9d915a73ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:09.811972 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-dfcbc597-7cc4-4e89-8299-ce9d915a73ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:09.816800 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-a7113ad0-fd91-4379-85e8-51fa2b684e58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2bb75f56bea642f6a03ee1d1d8c95ac2'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:09.825446 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcbc597-7cc4-4e89-8299-ce9d915a73ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:09.827330 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcbc597-7cc4-4e89-8299-ce9d915a73ed service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:09.836591 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1095/2217] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 13 15:30:09 2022] DELETE /identity/v3/users/2bb75f56bea642f6a03ee1d1d8c95ac2 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:30:09.841830 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d427fc-5d19-419f-a0b3-e9141d11040b None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:09.842172 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1123/2218] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:30:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 15:30:09.849966 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d427fc-5d19-419f-a0b3-e9141d11040b None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:09.850284 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d427fc-5d19-419f-a0b3-e9141d11040b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:09.872502 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-88d427fc-5d19-419f-a0b3-e9141d11040b None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:30:09.873763 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-88d427fc-5d19-419f-a0b3-e9141d11040b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:09.896548 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:30:09.962704 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1096/2219] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:30:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:30:09.974912 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcbc597-7cc4-4e89-8299-ce9d915a73ed service neutron] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:09.977002 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-dfcbc597-7cc4-4e89-8299-ce9d915a73ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:09.994648 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcbc597-7cc4-4e89-8299-ce9d915a73ed service neutron] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:10.065803 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51edde5d-71bb-4e0d-b580-1f8ab24a2f72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41675154bbba47388040966f75d84c3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:10.066674 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51edde5d-71bb-4e0d-b580-1f8ab24a2f72 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:10.067026 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51edde5d-71bb-4e0d-b580-1f8ab24a2f72 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:10.067373 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51edde5d-71bb-4e0d-b580-1f8ab24a2f72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:10.100105 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51edde5d-71bb-4e0d-b580-1f8ab24a2f72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:10.102456 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51edde5d-71bb-4e0d-b580-1f8ab24a2f72 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:10.116830 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1124/2220] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:30:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:30:10.196765 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d427fc-5d19-419f-a0b3-e9141d11040b None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:10.198555 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-88d427fc-5d19-419f-a0b3-e9141d11040b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:10.213220 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d427fc-5d19-419f-a0b3-e9141d11040b None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:10.226647 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606f8d87-9377-4838-b29d-0a23c8154889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:10.227343 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606f8d87-9377-4838-b29d-0a23c8154889 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:10.228355 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606f8d87-9377-4838-b29d-0a23c8154889 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:10.228648 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606f8d87-9377-4838-b29d-0a23c8154889 admin admin] PATH_INFO: `/v3/projects/4fd0342de8d948629672ce5570257244` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:10.230058 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606f8d87-9377-4838-b29d-0a23c8154889 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4fd0342de8d948629672ce5570257244)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:10.232022 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606f8d87-9377-4838-b29d-0a23c8154889 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:10.284322 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-606f8d87-9377-4838-b29d-0a23c8154889 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4fd0342de8d948629672ce5570257244', 'request_id': 'req-606f8d87-9377-4838-b29d-0a23c8154889'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:10.291455 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-606f8d87-9377-4838-b29d-0a23c8154889 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4fd0342de8d948629672ce5570257244', 'request_id': 'req-606f8d87-9377-4838-b29d-0a23c8154889'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:10.297234 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-606f8d87-9377-4838-b29d-0a23c8154889 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4fd0342de8d948629672ce5570257244', 'request_id': 'req-606f8d87-9377-4838-b29d-0a23c8154889'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:10.316670 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-606f8d87-9377-4838-b29d-0a23c8154889 admin admin] The token cache is being invalidate because project 4fd0342de8d948629672ce5570257244 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 15:30:10.317012 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-606f8d87-9377-4838-b29d-0a23c8154889 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:10.317733 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-606f8d87-9377-4838-b29d-0a23c8154889 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:10.322272 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1097/2221] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 13 15:30:10 2022] DELETE /identity/v3/projects/4fd0342de8d948629672ce5570257244 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:30:10.323573 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51edde5d-71bb-4e0d-b580-1f8ab24a2f72 service neutron] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:10.333877 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51edde5d-71bb-4e0d-b580-1f8ab24a2f72 service neutron] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:10.406645 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bca9a64-a21f-4bbb-9f80-47d64dd4a811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:10.407289 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bca9a64-a21f-4bbb-9f80-47d64dd4a811 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:10.407573 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bca9a64-a21f-4bbb-9f80-47d64dd4a811 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:10.407857 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bca9a64-a21f-4bbb-9f80-47d64dd4a811 admin admin] PATH_INFO: `/v3/users/872a8629536d4f209ea4d10cc051028b` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:10.409104 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bca9a64-a21f-4bbb-9f80-47d64dd4a811 admin admin] RBAC: Authorizing `identity:delete_user(user_id=872a8629536d4f209ea4d10cc051028b)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:10.411147 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bca9a64-a21f-4bbb-9f80-47d64dd4a811 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:10.456290 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606f8d87-9377-4838-b29d-0a23c8154889 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:10.457973 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-606f8d87-9377-4838-b29d-0a23c8154889 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:10.476114 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606f8d87-9377-4838-b29d-0a23c8154889 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:10.484705 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97206d6-fba0-4263-94bb-624e7a42caf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:10.485313 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97206d6-fba0-4263-94bb-624e7a42caf3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:10.485596 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97206d6-fba0-4263-94bb-624e7a42caf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:10.485910 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97206d6-fba0-4263-94bb-624e7a42caf3 admin admin] PATH_INFO: `/v3/projects/8e78b021dc6748d68035268fcdd839b6` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:10.487848 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97206d6-fba0-4263-94bb-624e7a42caf3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e78b021dc6748d68035268fcdd839b6)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:10.488685 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-7bca9a64-a21f-4bbb-9f80-47d64dd4a811 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '872a8629536d4f209ea4d10cc051028b'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:10.489621 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-7bca9a64-a21f-4bbb-9f80-47d64dd4a811 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '872a8629536d4f209ea4d10cc051028b'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:10.489819 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97206d6-fba0-4263-94bb-624e7a42caf3 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:10.490278 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-7bca9a64-a21f-4bbb-9f80-47d64dd4a811 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '872a8629536d4f209ea4d10cc051028b'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:10.504560 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-7bca9a64-a21f-4bbb-9f80-47d64dd4a811 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '872a8629536d4f209ea4d10cc051028b'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:10.527773 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-7bca9a64-a21f-4bbb-9f80-47d64dd4a811 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '872a8629536d4f209ea4d10cc051028b'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:10.543193 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1125/2222] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 13 15:30:10 2022] DELETE /identity/v3/users/872a8629536d4f209ea4d10cc051028b => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:30:10.546712 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-e97206d6-fba0-4263-94bb-624e7a42caf3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e78b021dc6748d68035268fcdd839b6', 'request_id': 'req-e97206d6-fba0-4263-94bb-624e7a42caf3'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:10.554814 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-e97206d6-fba0-4263-94bb-624e7a42caf3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e78b021dc6748d68035268fcdd839b6', 'request_id': 'req-e97206d6-fba0-4263-94bb-624e7a42caf3'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:10.560998 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-e97206d6-fba0-4263-94bb-624e7a42caf3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e78b021dc6748d68035268fcdd839b6', 'request_id': 'req-e97206d6-fba0-4263-94bb-624e7a42caf3'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:10.575337 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-e97206d6-fba0-4263-94bb-624e7a42caf3 admin admin] The token cache is being invalidate because project 8e78b021dc6748d68035268fcdd839b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 15:30:10.575714 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-e97206d6-fba0-4263-94bb-624e7a42caf3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:10.576476 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-e97206d6-fba0-4263-94bb-624e7a42caf3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:10.581945 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1098/2223] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 13 15:30:10 2022] DELETE /identity/v3/projects/8e78b021dc6748d68035268fcdd839b6 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:30:10.583336 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bca9a64-a21f-4bbb-9f80-47d64dd4a811 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:10.586302 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-7bca9a64-a21f-4bbb-9f80-47d64dd4a811 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:10.605893 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:30:10.688711 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bca9a64-a21f-4bbb-9f80-47d64dd4a811 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:10.696612 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b5af91-3533-49e7-a962-b77d5c5876c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:10.697543 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b5af91-3533-49e7-a962-b77d5c5876c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:10.698103 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b5af91-3533-49e7-a962-b77d5c5876c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:10.698534 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b5af91-3533-49e7-a962-b77d5c5876c9 admin admin] PATH_INFO: `/v3/users/c4af62fe33fb4f0eb1d49a9863998e4a` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:10.700115 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b5af91-3533-49e7-a962-b77d5c5876c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4af62fe33fb4f0eb1d49a9863998e4a)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:10.703213 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b5af91-3533-49e7-a962-b77d5c5876c9 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:10.796673 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-43b5af91-3533-49e7-a962-b77d5c5876c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4af62fe33fb4f0eb1d49a9863998e4a'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:10.797671 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-43b5af91-3533-49e7-a962-b77d5c5876c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4af62fe33fb4f0eb1d49a9863998e4a'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:10.798554 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-43b5af91-3533-49e7-a962-b77d5c5876c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4af62fe33fb4f0eb1d49a9863998e4a'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:10.812189 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-43b5af91-3533-49e7-a962-b77d5c5876c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4af62fe33fb4f0eb1d49a9863998e4a'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:10.832433 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-43b5af91-3533-49e7-a962-b77d5c5876c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4af62fe33fb4f0eb1d49a9863998e4a'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:10.872822 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1126/2224] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 13 15:30:10 2022] DELETE /identity/v3/users/c4af62fe33fb4f0eb1d49a9863998e4a => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 15:30:10.881099 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97206d6-fba0-4263-94bb-624e7a42caf3 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:10.882939 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-e97206d6-fba0-4263-94bb-624e7a42caf3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:10.953742 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:30:11.006928 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97206d6-fba0-4263-94bb-624e7a42caf3 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:11.079686 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02debbce-1302-401a-ac0b-1ceeb664276c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:11.081410 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02debbce-1302-401a-ac0b-1ceeb664276c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:11.081795 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02debbce-1302-401a-ac0b-1ceeb664276c admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:11.082140 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02debbce-1302-401a-ac0b-1ceeb664276c admin admin] PATH_INFO: `/v3/projects/05ef63e990b5472fa73b04db8c8e3937` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:11.083809 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02debbce-1302-401a-ac0b-1ceeb664276c admin admin] RBAC: Authorizing `identity:delete_project(project_id=05ef63e990b5472fa73b04db8c8e3937)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:11.085956 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02debbce-1302-401a-ac0b-1ceeb664276c admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:11.162442 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-02debbce-1302-401a-ac0b-1ceeb664276c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05ef63e990b5472fa73b04db8c8e3937', 'request_id': 'req-02debbce-1302-401a-ac0b-1ceeb664276c'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:11.171628 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-02debbce-1302-401a-ac0b-1ceeb664276c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05ef63e990b5472fa73b04db8c8e3937', 'request_id': 'req-02debbce-1302-401a-ac0b-1ceeb664276c'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:11.179092 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-02debbce-1302-401a-ac0b-1ceeb664276c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05ef63e990b5472fa73b04db8c8e3937', 'request_id': 'req-02debbce-1302-401a-ac0b-1ceeb664276c'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:11.200848 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-02debbce-1302-401a-ac0b-1ceeb664276c admin admin] The token cache is being invalidate because project 05ef63e990b5472fa73b04db8c8e3937 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 15:30:11.201567 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-02debbce-1302-401a-ac0b-1ceeb664276c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:11.203035 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-02debbce-1302-401a-ac0b-1ceeb664276c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:11.210214 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1099/2225] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 13 15:30:10 2022] DELETE /identity/v3/projects/05ef63e990b5472fa73b04db8c8e3937 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:30:11.211035 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ef6fba-2944-4ff9-bdf0-1b53cf9c79c3 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:11.211411 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ef6fba-2944-4ff9-bdf0-1b53cf9c79c3 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:11.211762 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ef6fba-2944-4ff9-bdf0-1b53cf9c79c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:11.232915 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-49ef6fba-2944-4ff9-bdf0-1b53cf9c79c3 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:30:11.234256 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-49ef6fba-2944-4ff9-bdf0-1b53cf9c79c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:11.318711 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1127/2226] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:30:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:30:11.320537 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1086312-b8a0-4203-a42b-66489193d986 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:11.320830 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1086312-b8a0-4203-a42b-66489193d986 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:11.321262 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1086312-b8a0-4203-a42b-66489193d986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:11.360130 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-c1086312-b8a0-4203-a42b-66489193d986 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:30:11.361399 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-c1086312-b8a0-4203-a42b-66489193d986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:11.370823 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1100/2227] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:30:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:30:11.375133 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ef6fba-2944-4ff9-bdf0-1b53cf9c79c3 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:11.386816 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ef6fba-2944-4ff9-bdf0-1b53cf9c79c3 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:11.394046 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f871e275-d113-4a68-9d2c-75735bb05f3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:11.394767 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f871e275-d113-4a68-9d2c-75735bb05f3d admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:11.395054 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f871e275-d113-4a68-9d2c-75735bb05f3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:11.395329 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f871e275-d113-4a68-9d2c-75735bb05f3d admin admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:11.396123 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f871e275-d113-4a68-9d2c-75735bb05f3d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:30:11.396435 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f871e275-d113-4a68-9d2c-75735bb05f3d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:11.398265 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f871e275-d113-4a68-9d2c-75735bb05f3d admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:11.431885 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1086312-b8a0-4203-a42b-66489193d986 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:11.437185 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1128/2228] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Sep 13 15:30:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 15:30:11.443944 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1086312-b8a0-4203-a42b-66489193d986 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:11.449244 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f871e275-d113-4a68-9d2c-75735bb05f3d admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:11.451800 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-f871e275-d113-4a68-9d2c-75735bb05f3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:11.455812 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbab502-e130-4982-b19c-ec3a3bb617ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:11.456918 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbab502-e130-4982-b19c-ec3a3bb617ee admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:11.457406 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbab502-e130-4982-b19c-ec3a3bb617ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:11.458011 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbab502-e130-4982-b19c-ec3a3bb617ee admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:11.459024 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbab502-e130-4982-b19c-ec3a3bb617ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:11.461651 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbab502-e130-4982-b19c-ec3a3bb617ee admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:11.470818 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f871e275-d113-4a68-9d2c-75735bb05f3d admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:11.497865 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6f95b1-40a8-4037-9d2f-3e85ad071519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:11.498389 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6f95b1-40a8-4037-9d2f-3e85ad071519 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:11.498669 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6f95b1-40a8-4037-9d2f-3e85ad071519 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:11.499085 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6f95b1-40a8-4037-9d2f-3e85ad071519 admin admin] PATH_INFO: `/v3/projects/a92691a160e44aa0a0db34b677ade1b6` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:11.500606 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6f95b1-40a8-4037-9d2f-3e85ad071519 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a92691a160e44aa0a0db34b677ade1b6)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:11.505522 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6f95b1-40a8-4037-9d2f-3e85ad071519 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:11.520588 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:30:11.531088 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1101/2229] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 13 15:30:11 2022] POST /identity/v3/projects => generated 383 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:30:11.532260 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbab502-e130-4982-b19c-ec3a3bb617ee admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:11.579905 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-6f6f95b1-40a8-4037-9d2f-3e85ad071519 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a92691a160e44aa0a0db34b677ade1b6', 'request_id': 'req-6f6f95b1-40a8-4037-9d2f-3e85ad071519'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:11.591254 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-6f6f95b1-40a8-4037-9d2f-3e85ad071519 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a92691a160e44aa0a0db34b677ade1b6', 'request_id': 'req-6f6f95b1-40a8-4037-9d2f-3e85ad071519'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:11.599717 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:30:11.608727 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-6f6f95b1-40a8-4037-9d2f-3e85ad071519 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a92691a160e44aa0a0db34b677ade1b6', 'request_id': 'req-6f6f95b1-40a8-4037-9d2f-3e85ad071519'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:11.626493 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-6f6f95b1-40a8-4037-9d2f-3e85ad071519 admin admin] The token cache is being invalidate because project a92691a160e44aa0a0db34b677ade1b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 15:30:11.626816 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-6f6f95b1-40a8-4037-9d2f-3e85ad071519 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:11.628412 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-6f6f95b1-40a8-4037-9d2f-3e85ad071519 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:11.637994 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1129/2230] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 13 15:30:11 2022] DELETE /identity/v3/projects/a92691a160e44aa0a0db34b677ade1b6 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 15:30:11.640114 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5c4ad2-7c57-43ea-b476-14d23710d565 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:11.640406 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5c4ad2-7c57-43ea-b476-14d23710d565 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:11.640688 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5c4ad2-7c57-43ea-b476-14d23710d565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:11.655347 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbab502-e130-4982-b19c-ec3a3bb617ee admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:11.671577 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-ef5c4ad2-7c57-43ea-b476-14d23710d565 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:30:11.672804 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-ef5c4ad2-7c57-43ea-b476-14d23710d565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:11.731834 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3be0800-2a82-49b2-9ef2-46ccbfd82998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:11.732681 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3be0800-2a82-49b2-9ef2-46ccbfd82998 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:11.733024 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3be0800-2a82-49b2-9ef2-46ccbfd82998 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:11.733303 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3be0800-2a82-49b2-9ef2-46ccbfd82998 admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:11.734032 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3be0800-2a82-49b2-9ef2-46ccbfd82998 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:11.736639 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3be0800-2a82-49b2-9ef2-46ccbfd82998 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:11.786890 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1130/2231] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:30:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 15:30:11.797084 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1102/2232] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 13 15:30:11 2022] POST /identity/v3/users => generated 292 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:30:11.798129 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3c138f-1659-421d-9cd0-f36b1f8484d5 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:11.798414 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3c138f-1659-421d-9cd0-f36b1f8484d5 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:11.798688 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3c138f-1659-421d-9cd0-f36b1f8484d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:11.802847 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3be0800-2a82-49b2-9ef2-46ccbfd82998 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:11.804666 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-c3be0800-2a82-49b2-9ef2-46ccbfd82998 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:11.817622 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3be0800-2a82-49b2-9ef2-46ccbfd82998 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:11.824769 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a835897f-ae7d-43c6-88d7-521fdcbd2275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:11.826209 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a835897f-ae7d-43c6-88d7-521fdcbd2275 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:11.826209 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a835897f-ae7d-43c6-88d7-521fdcbd2275 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:11.826209 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a835897f-ae7d-43c6-88d7-521fdcbd2275 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:11.826472 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-ac3c138f-1659-421d-9cd0-f36b1f8484d5 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:30:11.827669 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a835897f-ae7d-43c6-88d7-521fdcbd2275 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:11.828086 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-ac3c138f-1659-421d-9cd0-f36b1f8484d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:11.830763 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a835897f-ae7d-43c6-88d7-521fdcbd2275 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:11.839916 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1131/2233] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:30:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:30:11.844114 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3c138f-1659-421d-9cd0-f36b1f8484d5 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:11.844891 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1103/2234] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:30:11 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 15:30:11.849831 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a835897f-ae7d-43c6-88d7-521fdcbd2275 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:11.856860 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3c138f-1659-421d-9cd0-f36b1f8484d5 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:11.863392 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6960ca8-e044-4938-b313-e7563c4f75e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:11.864135 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6960ca8-e044-4938-b313-e7563c4f75e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:11.864465 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a835897f-ae7d-43c6-88d7-521fdcbd2275 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:11.864605 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6960ca8-e044-4938-b313-e7563c4f75e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:11.864768 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6960ca8-e044-4938-b313-e7563c4f75e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:11.865569 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6960ca8-e044-4938-b313-e7563c4f75e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:30:11.866000 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6960ca8-e044-4938-b313-e7563c4f75e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:11.867744 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6960ca8-e044-4938-b313-e7563c4f75e3 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:11.870222 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5460c21-26f0-40a8-9c18-4af1e846e1e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:11.870996 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5460c21-26f0-40a8-9c18-4af1e846e1e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:11.871283 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5460c21-26f0-40a8-9c18-4af1e846e1e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:11.871608 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5460c21-26f0-40a8-9c18-4af1e846e1e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:11.872255 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5460c21-26f0-40a8-9c18-4af1e846e1e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:11.874508 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5460c21-26f0-40a8-9c18-4af1e846e1e1 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:11.886436 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1132/2235] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Sep 13 15:30:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:30:11.889164 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1104/2236] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:30:11 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 15:30:11.891701 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6960ca8-e044-4938-b313-e7563c4f75e3 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:11.895393 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5460c21-26f0-40a8-9c18-4af1e846e1e1 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:11.904205 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6960ca8-e044-4938-b313-e7563c4f75e3 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:11.905447 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5460c21-26f0-40a8-9c18-4af1e846e1e1 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:11.910974 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c0373b-336a-44a5-8404-446cb2e5bb66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:11.911528 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf88bc76-d1ac-4397-a041-aee3d9c6c4ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:11.911686 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c0373b-336a-44a5-8404-446cb2e5bb66 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:11.911914 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c0373b-336a-44a5-8404-446cb2e5bb66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:11.912620 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf88bc76-d1ac-4397-a041-aee3d9c6c4ca admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:11.912729 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf88bc76-d1ac-4397-a041-aee3d9c6c4ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:11.912818 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c0373b-336a-44a5-8404-446cb2e5bb66 admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:11.913016 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf88bc76-d1ac-4397-a041-aee3d9c6c4ca admin admin] PATH_INFO: `/v3/projects/a380a66d56e44992ba5e1333d7dec39a/users/c6d3bbb3f7ae4c81a4c1c36bf89f04c4/roles/3fae3d3a28e147d3b2bede2378ff79ae` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:11.913473 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c0373b-336a-44a5-8404-446cb2e5bb66 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:11.915448 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c0373b-336a-44a5-8404-446cb2e5bb66 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:11.930935 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf88bc76-d1ac-4397-a041-aee3d9c6c4ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=a380a66d56e44992ba5e1333d7dec39a, user_id=c6d3bbb3f7ae4c81a4c1c36bf89f04c4, role_id=3fae3d3a28e147d3b2bede2378ff79ae)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:11.934267 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf88bc76-d1ac-4397-a041-aee3d9c6c4ca admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:11.949727 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1133/2237] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 13 15:30:11 2022] POST /identity/v3/projects => generated 377 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:30:11.950360 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1105/2238] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 13 15:30:11 2022] PUT /identity/v3/projects/a380a66d56e44992ba5e1333d7dec39a/users/c6d3bbb3f7ae4c81a4c1c36bf89f04c4/roles/3fae3d3a28e147d3b2bede2378ff79ae => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:30:11.952358 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c0373b-336a-44a5-8404-446cb2e5bb66 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:11.961451 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f013519b-19fb-4fb4-9168-480283ab6365 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:11.961803 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f013519b-19fb-4fb4-9168-480283ab6365 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:11.962092 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f013519b-19fb-4fb4-9168-480283ab6365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:12.015624 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-f013519b-19fb-4fb4-9168-480283ab6365 None None] MFA Rules not processed for user `c6d3bbb3f7ae4c81a4c1c36bf89f04c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:30:12.017898 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-f013519b-19fb-4fb4-9168-480283ab6365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:12.045407 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:30:12.051130 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c0373b-336a-44a5-8404-446cb2e5bb66 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:12.058998 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91fc2c0-c8d8-42e1-8139-20795879e2e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:12.060207 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91fc2c0-c8d8-42e1-8139-20795879e2e7 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:12.060475 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91fc2c0-c8d8-42e1-8139-20795879e2e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:12.060822 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91fc2c0-c8d8-42e1-8139-20795879e2e7 admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:12.061466 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91fc2c0-c8d8-42e1-8139-20795879e2e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:12.064123 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91fc2c0-c8d8-42e1-8139-20795879e2e7 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:12.094740 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1134/2239] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 13 15:30:11 2022] POST /identity/v3/users => generated 289 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 15:30:12.102906 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91fc2c0-c8d8-42e1-8139-20795879e2e7 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:12.114854 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1106/2240] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:30:11 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:30:12.115605 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91fc2c0-c8d8-42e1-8139-20795879e2e7 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:12.120436 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f013519b-19fb-4fb4-9168-480283ab6365 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:12.123122 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7165e9f-a5e3-4e52-bf52-ec18e1496828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:12.123813 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7165e9f-a5e3-4e52-bf52-ec18e1496828 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:12.124099 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7165e9f-a5e3-4e52-bf52-ec18e1496828 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:12.124376 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7165e9f-a5e3-4e52-bf52-ec18e1496828 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:12.125025 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7165e9f-a5e3-4e52-bf52-ec18e1496828 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:12.126673 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7165e9f-a5e3-4e52-bf52-ec18e1496828 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:12.134188 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f013519b-19fb-4fb4-9168-480283ab6365 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:12.146822 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10199dc-2ac9-42e1-9b18-d59cc6068dc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:12.147541 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10199dc-2ac9-42e1-9b18-d59cc6068dc3 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:12.147830 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10199dc-2ac9-42e1-9b18-d59cc6068dc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:12.148107 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10199dc-2ac9-42e1-9b18-d59cc6068dc3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:12.148755 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10199dc-2ac9-42e1-9b18-d59cc6068dc3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:12.151107 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10199dc-2ac9-42e1-9b18-d59cc6068dc3 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:12.167739 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1135/2241] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:30:12 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 15:30:12.173507 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7165e9f-a5e3-4e52-bf52-ec18e1496828 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:12.173680 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:30:12.194169 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7165e9f-a5e3-4e52-bf52-ec18e1496828 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:12.199051 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb69e58-96ad-478e-bcee-383aab9fdf81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:12.199658 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb69e58-96ad-478e-bcee-383aab9fdf81 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:12.199932 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb69e58-96ad-478e-bcee-383aab9fdf81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:12.200211 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb69e58-96ad-478e-bcee-383aab9fdf81 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:12.213906 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb69e58-96ad-478e-bcee-383aab9fdf81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:12.214013 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1107/2242] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 13 15:30:12 2022] POST /identity/v3/projects => generated 383 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 15:30:12.214132 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb69e58-96ad-478e-bcee-383aab9fdf81 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:12.214225 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10199dc-2ac9-42e1-9b18-d59cc6068dc3 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:12.217847 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1136/2243] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:30:12 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 15:30:12.225133 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb69e58-96ad-478e-bcee-383aab9fdf81 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:12.236303 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb69e58-96ad-478e-bcee-383aab9fdf81 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:12.274864 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10199dc-2ac9-42e1-9b18-d59cc6068dc3 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:12.280957 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b38983-87ad-4524-a9bb-1711742f6803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:12.281585 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b38983-87ad-4524-a9bb-1711742f6803 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:12.281913 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b38983-87ad-4524-a9bb-1711742f6803 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:12.282195 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b38983-87ad-4524-a9bb-1711742f6803 admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:12.282898 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b38983-87ad-4524-a9bb-1711742f6803 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:12.285459 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b38983-87ad-4524-a9bb-1711742f6803 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:12.306789 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1bbbf9-d8f6-48a0-a004-9106259c4a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:12.307455 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1bbbf9-d8f6-48a0-a004-9106259c4a8b admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:12.307734 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1bbbf9-d8f6-48a0-a004-9106259c4a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:12.308010 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1bbbf9-d8f6-48a0-a004-9106259c4a8b admin admin] PATH_INFO: `/v3/projects/5a4619ae55a2400583b28469715c96aa/users/934c6bde65974389a4eb51aefa9f9974/roles/3fae3d3a28e147d3b2bede2378ff79ae` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:12.312217 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1108/2244] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 13 15:30:12 2022] POST /identity/v3/users => generated 298 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 15:30:12.316742 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b38983-87ad-4524-a9bb-1711742f6803 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:12.325415 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1bbbf9-d8f6-48a0-a004-9106259c4a8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a4619ae55a2400583b28469715c96aa, user_id=934c6bde65974389a4eb51aefa9f9974, role_id=3fae3d3a28e147d3b2bede2378ff79ae)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:12.328012 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b38983-87ad-4524-a9bb-1711742f6803 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:12.328597 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1bbbf9-d8f6-48a0-a004-9106259c4a8b admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:12.334337 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b01d537-975c-4375-968e-9402dbdd4bb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:12.335018 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b01d537-975c-4375-968e-9402dbdd4bb3 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:12.335325 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b01d537-975c-4375-968e-9402dbdd4bb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:12.335742 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b01d537-975c-4375-968e-9402dbdd4bb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:12.336415 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b01d537-975c-4375-968e-9402dbdd4bb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:12.338858 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b01d537-975c-4375-968e-9402dbdd4bb3 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:12.347142 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1137/2245] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 13 15:30:12 2022] PUT /identity/v3/projects/5a4619ae55a2400583b28469715c96aa/users/934c6bde65974389a4eb51aefa9f9974/roles/3fae3d3a28e147d3b2bede2378ff79ae => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:30:12.350369 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1109/2246] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:30:12 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 15:30:12.354346 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1bbbf9-d8f6-48a0-a004-9106259c4a8b admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:12.359375 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66732838-555e-4432-abbd-665ad33e2652 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:12.360196 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66732838-555e-4432-abbd-665ad33e2652 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:12.360543 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66732838-555e-4432-abbd-665ad33e2652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:12.395017 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-66732838-555e-4432-abbd-665ad33e2652 None None] MFA Rules not processed for user `934c6bde65974389a4eb51aefa9f9974`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:30:12.396406 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-66732838-555e-4432-abbd-665ad33e2652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:12.429964 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1bbbf9-d8f6-48a0-a004-9106259c4a8b admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:12.435705 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb799157-eabb-4608-8346-ee8bb11985e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:12.436453 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb799157-eabb-4608-8346-ee8bb11985e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:12.436749 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb799157-eabb-4608-8346-ee8bb11985e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:12.437019 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb799157-eabb-4608-8346-ee8bb11985e2 admin admin] PATH_INFO: `/v3/projects/4f87363be50c4bb496d43dafa92a2b0c/users/450b050cbf6d4dd0a4445c9ff8623546/roles/f34412ad29f1478cba775b033129f71f` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:12.453590 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb799157-eabb-4608-8346-ee8bb11985e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f87363be50c4bb496d43dafa92a2b0c, user_id=450b050cbf6d4dd0a4445c9ff8623546, role_id=f34412ad29f1478cba775b033129f71f)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:12.456731 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb799157-eabb-4608-8346-ee8bb11985e2 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:12.468647 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1110/2247] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:30:12 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:30:12.474747 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1138/2248] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 13 15:30:12 2022] PUT /identity/v3/projects/4f87363be50c4bb496d43dafa92a2b0c/users/450b050cbf6d4dd0a4445c9ff8623546/roles/f34412ad29f1478cba775b033129f71f => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 15:30:12.478464 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66732838-555e-4432-abbd-665ad33e2652 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:12.483293 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb799157-eabb-4608-8346-ee8bb11985e2 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:12.485724 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-bb799157-eabb-4608-8346-ee8bb11985e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:12.493526 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66732838-555e-4432-abbd-665ad33e2652 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:12.535570 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:30:12.560471 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9089536-d7c1-4d45-b573-674717038434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:12.561192 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9089536-d7c1-4d45-b573-674717038434 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:12.562162 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9089536-d7c1-4d45-b573-674717038434 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:12.562451 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9089536-d7c1-4d45-b573-674717038434 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:12.563317 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9089536-d7c1-4d45-b573-674717038434 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:12.567399 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9089536-d7c1-4d45-b573-674717038434 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:12.569922 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb799157-eabb-4608-8346-ee8bb11985e2 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:12.570528 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:30:12.574407 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab29d821-df5f-46ef-9d9a-d34548175884 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef26a5203094c83b52f10b930dfc453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:12.575629 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab29d821-df5f-46ef-9d9a-d34548175884 service glance] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:12.576445 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab29d821-df5f-46ef-9d9a-d34548175884 service glance] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:12.577187 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab29d821-df5f-46ef-9d9a-d34548175884 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:12.582210 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1111/2249] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:30:12 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 15:30:12.585811 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9089536-d7c1-4d45-b573-674717038434 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:12.597071 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9089536-d7c1-4d45-b573-674717038434 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:12.601912 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac3fb3d-427d-40da-b1c5-aac780c2ad09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:12.602645 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac3fb3d-427d-40da-b1c5-aac780c2ad09 admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:12.603138 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac3fb3d-427d-40da-b1c5-aac780c2ad09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:12.603366 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac3fb3d-427d-40da-b1c5-aac780c2ad09 admin admin] PATH_INFO: `/v3/projects/4f87363be50c4bb496d43dafa92a2b0c/users/450b050cbf6d4dd0a4445c9ff8623546/roles/f34412ad29f1478cba775b033129f71f` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:12.606014 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac3fb3d-427d-40da-b1c5-aac780c2ad09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f87363be50c4bb496d43dafa92a2b0c, user_id=450b050cbf6d4dd0a4445c9ff8623546, role_id=f34412ad29f1478cba775b033129f71f)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:12.608922 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac3fb3d-427d-40da-b1c5-aac780c2ad09 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:12.620932 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1112/2250] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 13 15:30:12 2022] PUT /identity/v3/projects/4f87363be50c4bb496d43dafa92a2b0c/users/450b050cbf6d4dd0a4445c9ff8623546/roles/f34412ad29f1478cba775b033129f71f => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:30:12.633113 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788834aa-fe8c-4865-b86b-92f495cf6a1c None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:12.633500 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788834aa-fe8c-4865-b86b-92f495cf6a1c None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:12.633889 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788834aa-fe8c-4865-b86b-92f495cf6a1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:12.665187 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab29d821-df5f-46ef-9d9a-d34548175884 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:12.666567 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-788834aa-fe8c-4865-b86b-92f495cf6a1c None None] MFA Rules not processed for user `450b050cbf6d4dd0a4445c9ff8623546`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:30:12.667130 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab29d821-df5f-46ef-9d9a-d34548175884 service glance] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:12.667784 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-788834aa-fe8c-4865-b86b-92f495cf6a1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:12.679678 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1139/2251] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:30:12 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:30:12.741291 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab29d821-df5f-46ef-9d9a-d34548175884 service glance] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:12.742743 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-ab29d821-df5f-46ef-9d9a-d34548175884 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:12.761130 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab29d821-df5f-46ef-9d9a-d34548175884 service glance] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:12.762057 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1113/2252] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:30:12 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:30:12.776160 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788834aa-fe8c-4865-b86b-92f495cf6a1c None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:12.778050 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-788834aa-fe8c-4865-b86b-92f495cf6a1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:12.826848 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c7ab3e-b904-46c7-a362-9dc305484eda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:12.827917 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c7ab3e-b904-46c7-a362-9dc305484eda admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:12.828216 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c7ab3e-b904-46c7-a362-9dc305484eda admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:12.828474 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c7ab3e-b904-46c7-a362-9dc305484eda admin admin] PATH_INFO: `/v3/users/1f5f0c63988e4a078e4504b87afc6b88` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:12.829641 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c7ab3e-b904-46c7-a362-9dc305484eda admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f5f0c63988e4a078e4504b87afc6b88)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:12.832682 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c7ab3e-b904-46c7-a362-9dc305484eda admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:12.844542 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788834aa-fe8c-4865-b86b-92f495cf6a1c None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:12.849616 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59a5663-b96f-42dd-a522-314d9ef7f44e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97acd23097d54bf7805c3cef60626ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:12.850254 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59a5663-b96f-42dd-a522-314d9ef7f44e service cinder] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:12.850509 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59a5663-b96f-42dd-a522-314d9ef7f44e service cinder] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:12.850739 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59a5663-b96f-42dd-a522-314d9ef7f44e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:12.860225 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59a5663-b96f-42dd-a522-314d9ef7f44e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:12.861763 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59a5663-b96f-42dd-a522-314d9ef7f44e service cinder] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:12.872171 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1114/2253] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:30:12 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 15:30:12.900814 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-46c7ab3e-b904-46c7-a362-9dc305484eda admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f5f0c63988e4a078e4504b87afc6b88'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:12.901807 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-46c7ab3e-b904-46c7-a362-9dc305484eda admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f5f0c63988e4a078e4504b87afc6b88'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:12.902376 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-46c7ab3e-b904-46c7-a362-9dc305484eda admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f5f0c63988e4a078e4504b87afc6b88'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:12.911545 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-46c7ab3e-b904-46c7-a362-9dc305484eda admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f5f0c63988e4a078e4504b87afc6b88'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:12.928767 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-46c7ab3e-b904-46c7-a362-9dc305484eda admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f5f0c63988e4a078e4504b87afc6b88'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:12.948242 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1140/2254] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 13 15:30:12 2022] DELETE /identity/v3/users/1f5f0c63988e4a078e4504b87afc6b88 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:30:12.953235 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174f888d-fd17-4302-9d2e-7afc1672a9cb None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:12.953596 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174f888d-fd17-4302-9d2e-7afc1672a9cb None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:12.954540 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174f888d-fd17-4302-9d2e-7afc1672a9cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:12.981368 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-174f888d-fd17-4302-9d2e-7afc1672a9cb None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:30:12.982630 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-174f888d-fd17-4302-9d2e-7afc1672a9cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:12.984501 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c7ab3e-b904-46c7-a362-9dc305484eda admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:12.986200 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-46c7ab3e-b904-46c7-a362-9dc305484eda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:12.995738 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:30:13.060558 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1115/2255] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:30:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:30:13.071388 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174f888d-fd17-4302-9d2e-7afc1672a9cb None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:13.073090 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-174f888d-fd17-4302-9d2e-7afc1672a9cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:13.075105 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c7ab3e-b904-46c7-a362-9dc305484eda admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:13.079161 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8edcb58-3c2e-4f12-a754-f1c1ca8769bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97acd23097d54bf7805c3cef60626ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:13.079850 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8edcb58-3c2e-4f12-a754-f1c1ca8769bd service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:13.080227 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8edcb58-3c2e-4f12-a754-f1c1ca8769bd service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:13.080570 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8edcb58-3c2e-4f12-a754-f1c1ca8769bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:13.082744 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-f8edcb58-3c2e-4f12-a754-f1c1ca8769bd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:13.089960 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:30:13.140775 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174f888d-fd17-4302-9d2e-7afc1672a9cb None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:13.145736 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935c1c97-6e79-46b2-b304-cd9d169a2a18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41675154bbba47388040966f75d84c3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:13.146359 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935c1c97-6e79-46b2-b304-cd9d169a2a18 service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:13.146639 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935c1c97-6e79-46b2-b304-cd9d169a2a18 service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:13.146912 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935c1c97-6e79-46b2-b304-cd9d169a2a18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:13.150685 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8edcb58-3c2e-4f12-a754-f1c1ca8769bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:13.152149 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8edcb58-3c2e-4f12-a754-f1c1ca8769bd service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:13.156762 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935c1c97-6e79-46b2-b304-cd9d169a2a18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:13.158984 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935c1c97-6e79-46b2-b304-cd9d169a2a18 service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:13.164363 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1141/2256] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:30:12 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 15:30:13.187932 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1116/2257] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:30:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:30:13.627862 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8edcb58-3c2e-4f12-a754-f1c1ca8769bd service cinder] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:13.629871 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-f8edcb58-3c2e-4f12-a754-f1c1ca8769bd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:13.653935 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8edcb58-3c2e-4f12-a754-f1c1ca8769bd service cinder] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:13.659996 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fa6acf-8a46-47a0-978c-7155c3ec83e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:13.660720 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fa6acf-8a46-47a0-978c-7155c3ec83e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:13.661080 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fa6acf-8a46-47a0-978c-7155c3ec83e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:13.661429 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fa6acf-8a46-47a0-978c-7155c3ec83e9 admin admin] PATH_INFO: `/v3/projects/c93fc62f361f43b8a481e52bf2fedd03` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:13.662692 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fa6acf-8a46-47a0-978c-7155c3ec83e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c93fc62f361f43b8a481e52bf2fedd03)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:13.664800 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fa6acf-8a46-47a0-978c-7155c3ec83e9 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:13.756256 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-40fa6acf-8a46-47a0-978c-7155c3ec83e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c93fc62f361f43b8a481e52bf2fedd03', 'request_id': 'req-40fa6acf-8a46-47a0-978c-7155c3ec83e9'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:13.763073 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-40fa6acf-8a46-47a0-978c-7155c3ec83e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c93fc62f361f43b8a481e52bf2fedd03', 'request_id': 'req-40fa6acf-8a46-47a0-978c-7155c3ec83e9'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:13.771686 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-40fa6acf-8a46-47a0-978c-7155c3ec83e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c93fc62f361f43b8a481e52bf2fedd03', 'request_id': 'req-40fa6acf-8a46-47a0-978c-7155c3ec83e9'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:13.787571 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-40fa6acf-8a46-47a0-978c-7155c3ec83e9 admin admin] The token cache is being invalidate because project c93fc62f361f43b8a481e52bf2fedd03 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 15:30:13.787997 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-40fa6acf-8a46-47a0-978c-7155c3ec83e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:13.788650 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-40fa6acf-8a46-47a0-978c-7155c3ec83e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:13.794813 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1142/2258] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 13 15:30:13 2022] DELETE /identity/v3/projects/c93fc62f361f43b8a481e52bf2fedd03 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:30:13.795899 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935c1c97-6e79-46b2-b304-cd9d169a2a18 service neutron] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:13.809340 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935c1c97-6e79-46b2-b304-cd9d169a2a18 service neutron] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:13.881963 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec80e74-6b58-4c75-b4e5-6dfeb2534578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:13.882516 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec80e74-6b58-4c75-b4e5-6dfeb2534578 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:13.882798 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec80e74-6b58-4c75-b4e5-6dfeb2534578 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:13.883074 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec80e74-6b58-4c75-b4e5-6dfeb2534578 admin admin] PATH_INFO: `/v3/users/2165028b49954fd6a13ced034f196cdd` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:13.884228 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec80e74-6b58-4c75-b4e5-6dfeb2534578 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2165028b49954fd6a13ced034f196cdd)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:13.886185 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec80e74-6b58-4c75-b4e5-6dfeb2534578 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:13.936894 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-2ec80e74-6b58-4c75-b4e5-6dfeb2534578 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2165028b49954fd6a13ced034f196cdd'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:13.937570 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-2ec80e74-6b58-4c75-b4e5-6dfeb2534578 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2165028b49954fd6a13ced034f196cdd'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:13.938215 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-2ec80e74-6b58-4c75-b4e5-6dfeb2534578 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2165028b49954fd6a13ced034f196cdd'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:13.945203 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-2ec80e74-6b58-4c75-b4e5-6dfeb2534578 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2165028b49954fd6a13ced034f196cdd'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:13.957855 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-2ec80e74-6b58-4c75-b4e5-6dfeb2534578 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2165028b49954fd6a13ced034f196cdd'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:13.970242 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1117/2259] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 13 15:30:13 2022] DELETE /identity/v3/users/2165028b49954fd6a13ced034f196cdd => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:30:14.253874 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fa6acf-8a46-47a0-978c-7155c3ec83e9 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:14.256143 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-40fa6acf-8a46-47a0-978c-7155c3ec83e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:14.270432 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fa6acf-8a46-47a0-978c-7155c3ec83e9 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:14.321073 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:30:14.341274 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb3d8d8-d952-4301-bebd-758aeeedb36a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:14.341987 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb3d8d8-d952-4301-bebd-758aeeedb36a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:14.342286 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb3d8d8-d952-4301-bebd-758aeeedb36a admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:14.342572 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb3d8d8-d952-4301-bebd-758aeeedb36a admin admin] PATH_INFO: `/v3/projects/3e8142d005184a81a20aed2b405f5e6b` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:14.343701 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb3d8d8-d952-4301-bebd-758aeeedb36a admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e8142d005184a81a20aed2b405f5e6b)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:14.345668 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb3d8d8-d952-4301-bebd-758aeeedb36a admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:14.395661 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-9eb3d8d8-d952-4301-bebd-758aeeedb36a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e8142d005184a81a20aed2b405f5e6b', 'request_id': 'req-9eb3d8d8-d952-4301-bebd-758aeeedb36a'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:14.401679 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-9eb3d8d8-d952-4301-bebd-758aeeedb36a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e8142d005184a81a20aed2b405f5e6b', 'request_id': 'req-9eb3d8d8-d952-4301-bebd-758aeeedb36a'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:14.409446 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-9eb3d8d8-d952-4301-bebd-758aeeedb36a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e8142d005184a81a20aed2b405f5e6b', 'request_id': 'req-9eb3d8d8-d952-4301-bebd-758aeeedb36a'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:14.419885 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-9eb3d8d8-d952-4301-bebd-758aeeedb36a admin admin] The token cache is being invalidate because project 3e8142d005184a81a20aed2b405f5e6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 15:30:14.420189 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-9eb3d8d8-d952-4301-bebd-758aeeedb36a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:14.420848 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-9eb3d8d8-d952-4301-bebd-758aeeedb36a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:14.422515 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1143/2260] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 13 15:30:14 2022] DELETE /identity/v3/projects/3e8142d005184a81a20aed2b405f5e6b => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:30:14.427170 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec80e74-6b58-4c75-b4e5-6dfeb2534578 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:14.428804 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-2ec80e74-6b58-4c75-b4e5-6dfeb2534578 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:14.442943 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec80e74-6b58-4c75-b4e5-6dfeb2534578 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:14.479539 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:30:14.506321 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddfde12-ce79-4d71-9464-bf73cb384c34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:14.506963 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddfde12-ce79-4d71-9464-bf73cb384c34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:14.507244 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddfde12-ce79-4d71-9464-bf73cb384c34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:14.507518 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddfde12-ce79-4d71-9464-bf73cb384c34 admin admin] PATH_INFO: `/v3/users/e9f25b85641544dbba9bbd4daec5c737` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:14.508633 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddfde12-ce79-4d71-9464-bf73cb384c34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9f25b85641544dbba9bbd4daec5c737)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:14.510667 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddfde12-ce79-4d71-9464-bf73cb384c34 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:14.564124 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-fddfde12-ce79-4d71-9464-bf73cb384c34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9f25b85641544dbba9bbd4daec5c737'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:14.565478 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-fddfde12-ce79-4d71-9464-bf73cb384c34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9f25b85641544dbba9bbd4daec5c737'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:14.566202 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-fddfde12-ce79-4d71-9464-bf73cb384c34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9f25b85641544dbba9bbd4daec5c737'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:14.573266 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-fddfde12-ce79-4d71-9464-bf73cb384c34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9f25b85641544dbba9bbd4daec5c737'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:14.586165 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-fddfde12-ce79-4d71-9464-bf73cb384c34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9f25b85641544dbba9bbd4daec5c737'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:14.599139 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1118/2261] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 13 15:30:14 2022] DELETE /identity/v3/users/e9f25b85641544dbba9bbd4daec5c737 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:30:14.962597 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb3d8d8-d952-4301-bebd-758aeeedb36a admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:14.970036 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-9eb3d8d8-d952-4301-bebd-758aeeedb36a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:14.988605 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb3d8d8-d952-4301-bebd-758aeeedb36a admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:15.074086 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46d9a5b-512a-4c96-a38c-0c80b9950d60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:15.074815 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46d9a5b-512a-4c96-a38c-0c80b9950d60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:15.075166 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46d9a5b-512a-4c96-a38c-0c80b9950d60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:15.075545 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46d9a5b-512a-4c96-a38c-0c80b9950d60 admin admin] PATH_INFO: `/v3/projects/1cc73de72bf3430b9a08b3fa6783deba` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:15.077368 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46d9a5b-512a-4c96-a38c-0c80b9950d60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1cc73de72bf3430b9a08b3fa6783deba)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:15.080163 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46d9a5b-512a-4c96-a38c-0c80b9950d60 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:15.136299 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-c46d9a5b-512a-4c96-a38c-0c80b9950d60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1cc73de72bf3430b9a08b3fa6783deba', 'request_id': 'req-c46d9a5b-512a-4c96-a38c-0c80b9950d60'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:15.152967 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-c46d9a5b-512a-4c96-a38c-0c80b9950d60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1cc73de72bf3430b9a08b3fa6783deba', 'request_id': 'req-c46d9a5b-512a-4c96-a38c-0c80b9950d60'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:15.172348 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-c46d9a5b-512a-4c96-a38c-0c80b9950d60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1cc73de72bf3430b9a08b3fa6783deba', 'request_id': 'req-c46d9a5b-512a-4c96-a38c-0c80b9950d60'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:15.188531 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-c46d9a5b-512a-4c96-a38c-0c80b9950d60 admin admin] The token cache is being invalidate because project 1cc73de72bf3430b9a08b3fa6783deba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 15:30:15.189042 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-c46d9a5b-512a-4c96-a38c-0c80b9950d60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:15.190643 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-c46d9a5b-512a-4c96-a38c-0c80b9950d60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:15.193668 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1144/2262] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 13 15:30:14 2022] DELETE /identity/v3/projects/1cc73de72bf3430b9a08b3fa6783deba => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:30:15.198726 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398f5742-139c-40c6-b0cc-ad4032f8bb82 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:15.199333 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398f5742-139c-40c6-b0cc-ad4032f8bb82 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:15.199770 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398f5742-139c-40c6-b0cc-ad4032f8bb82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:15.243857 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-398f5742-139c-40c6-b0cc-ad4032f8bb82 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:30:15.245210 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-398f5742-139c-40c6-b0cc-ad4032f8bb82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:15.325298 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1119/2263] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:30:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:30:15.333620 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f39ae2-b675-434d-9d34-f04d9fc6202e None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:15.334117 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f39ae2-b675-434d-9d34-f04d9fc6202e None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:15.334340 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f39ae2-b675-434d-9d34-f04d9fc6202e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:15.342188 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:30:15.356538 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-b2f39ae2-b675-434d-9d34-f04d9fc6202e None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:30:15.357788 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-b2f39ae2-b675-434d-9d34-f04d9fc6202e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:15.367112 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1145/2264] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:30:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 15:30:15.371807 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398f5742-139c-40c6-b0cc-ad4032f8bb82 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:15.381857 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398f5742-139c-40c6-b0cc-ad4032f8bb82 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:15.386781 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3d9306-3215-4d68-9e7a-8fb782d176a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:15.387393 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3d9306-3215-4d68-9e7a-8fb782d176a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:15.387680 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3d9306-3215-4d68-9e7a-8fb782d176a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:15.387955 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3d9306-3215-4d68-9e7a-8fb782d176a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:15.390430 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3d9306-3215-4d68-9e7a-8fb782d176a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:30:15.391076 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3d9306-3215-4d68-9e7a-8fb782d176a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:15.394219 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3d9306-3215-4d68-9e7a-8fb782d176a8 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:15.406884 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1120/2265] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Sep 13 15:30:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:30:15.412166 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f39ae2-b675-434d-9d34-f04d9fc6202e None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:15.421405 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f39ae2-b675-434d-9d34-f04d9fc6202e None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:15.426056 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574ee790-3ef0-461e-ae3e-74d25de9a3bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:15.426849 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574ee790-3ef0-461e-ae3e-74d25de9a3bc admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:15.427135 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574ee790-3ef0-461e-ae3e-74d25de9a3bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:15.427407 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574ee790-3ef0-461e-ae3e-74d25de9a3bc admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:15.428033 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574ee790-3ef0-461e-ae3e-74d25de9a3bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:15.429953 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574ee790-3ef0-461e-ae3e-74d25de9a3bc admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:15.462059 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1146/2266] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 13 15:30:15 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 15:30:15.466662 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3d9306-3215-4d68-9e7a-8fb782d176a8 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:15.477555 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3d9306-3215-4d68-9e7a-8fb782d176a8 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:15.518671 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:30:15.537346 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1c68f3-4de2-4daa-bd8b-fae18bb5a0ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:15.537997 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1c68f3-4de2-4daa-bd8b-fae18bb5a0ac admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:15.538266 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1c68f3-4de2-4daa-bd8b-fae18bb5a0ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:15.538537 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1c68f3-4de2-4daa-bd8b-fae18bb5a0ac admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:15.539166 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1c68f3-4de2-4daa-bd8b-fae18bb5a0ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:15.541094 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1c68f3-4de2-4daa-bd8b-fae18bb5a0ac admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:15.560987 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1121/2267] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 13 15:30:15 2022] POST /identity/v3/users => generated 287 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:30:15.565631 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574ee790-3ef0-461e-ae3e-74d25de9a3bc admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:15.577365 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574ee790-3ef0-461e-ae3e-74d25de9a3bc admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:15.583081 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d4e72d-d089-4632-8686-9a18f57ba423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:15.583680 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d4e72d-d089-4632-8686-9a18f57ba423 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:15.583958 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d4e72d-d089-4632-8686-9a18f57ba423 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:15.584242 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d4e72d-d089-4632-8686-9a18f57ba423 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:15.584936 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d4e72d-d089-4632-8686-9a18f57ba423 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:15.586638 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d4e72d-d089-4632-8686-9a18f57ba423 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:15.597391 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1147/2268] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:30:15 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 15:30:15.601443 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1c68f3-4de2-4daa-bd8b-fae18bb5a0ac admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:15.611813 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1c68f3-4de2-4daa-bd8b-fae18bb5a0ac admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:15.616598 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ea66a0-1be2-498f-9f21-f434cd12ce78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:15.617192 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ea66a0-1be2-498f-9f21-f434cd12ce78 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:15.617503 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ea66a0-1be2-498f-9f21-f434cd12ce78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:15.617802 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ea66a0-1be2-498f-9f21-f434cd12ce78 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:15.618445 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ea66a0-1be2-498f-9f21-f434cd12ce78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:15.620037 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ea66a0-1be2-498f-9f21-f434cd12ce78 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:15.630892 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1122/2269] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:30:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 15:30:15.634860 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d4e72d-d089-4632-8686-9a18f57ba423 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:15.646269 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d4e72d-d089-4632-8686-9a18f57ba423 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:15.651115 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4838d3d3-ba02-449a-9916-ef6e7a0b02f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:15.651777 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4838d3d3-ba02-449a-9916-ef6e7a0b02f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:15.652062 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4838d3d3-ba02-449a-9916-ef6e7a0b02f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:15.652341 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4838d3d3-ba02-449a-9916-ef6e7a0b02f6 admin admin] PATH_INFO: `/v3/projects/4a4c7ab1ee344f81ad36446bd115f863/users/168dd28a0e4546c5a1f65f6b58f7dace/roles/3fae3d3a28e147d3b2bede2378ff79ae` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:15.667808 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4838d3d3-ba02-449a-9916-ef6e7a0b02f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a4c7ab1ee344f81ad36446bd115f863, user_id=168dd28a0e4546c5a1f65f6b58f7dace, role_id=3fae3d3a28e147d3b2bede2378ff79ae)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:15.670519 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4838d3d3-ba02-449a-9916-ef6e7a0b02f6 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:15.683823 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1148/2270] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 13 15:30:15 2022] PUT /identity/v3/projects/4a4c7ab1ee344f81ad36446bd115f863/users/168dd28a0e4546c5a1f65f6b58f7dace/roles/3fae3d3a28e147d3b2bede2378ff79ae => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:30:15.688986 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d60064f-c1f0-4922-a3cf-50bdf471a152 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:15.689288 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d60064f-c1f0-4922-a3cf-50bdf471a152 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:15.689657 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d60064f-c1f0-4922-a3cf-50bdf471a152 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:15.711221 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-3d60064f-c1f0-4922-a3cf-50bdf471a152 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:30:15.712438 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-3d60064f-c1f0-4922-a3cf-50bdf471a152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:15.788797 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1123/2271] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:30:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:30:15.801743 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4838d3d3-ba02-449a-9916-ef6e7a0b02f6 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:15.803539 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-4838d3d3-ba02-449a-9916-ef6e7a0b02f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:15.864310 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4838d3d3-ba02-449a-9916-ef6e7a0b02f6 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:15.868359 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129483f7-0fd8-4063-b598-c4c7c6a75fd5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41675154bbba47388040966f75d84c3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:15.869441 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129483f7-0fd8-4063-b598-c4c7c6a75fd5 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:15.870081 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129483f7-0fd8-4063-b598-c4c7c6a75fd5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:15.870697 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129483f7-0fd8-4063-b598-c4c7c6a75fd5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:15.883886 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129483f7-0fd8-4063-b598-c4c7c6a75fd5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:15.885350 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129483f7-0fd8-4063-b598-c4c7c6a75fd5 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:15.895059 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1149/2272] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:30:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:30:16.179980 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d60064f-c1f0-4922-a3cf-50bdf471a152 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:16.181485 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-3d60064f-c1f0-4922-a3cf-50bdf471a152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:16.194414 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d60064f-c1f0-4922-a3cf-50bdf471a152 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:16.201643 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46747cdc-a533-4816-bdfd-9974cbda0196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:16.202587 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46747cdc-a533-4816-bdfd-9974cbda0196 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:16.203014 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46747cdc-a533-4816-bdfd-9974cbda0196 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:16.203296 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46747cdc-a533-4816-bdfd-9974cbda0196 admin admin] PATH_INFO: `/v3/users/c6d3bbb3f7ae4c81a4c1c36bf89f04c4` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:16.204431 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46747cdc-a533-4816-bdfd-9974cbda0196 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6d3bbb3f7ae4c81a4c1c36bf89f04c4)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:16.206609 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46747cdc-a533-4816-bdfd-9974cbda0196 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:16.271038 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-46747cdc-a533-4816-bdfd-9974cbda0196 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6d3bbb3f7ae4c81a4c1c36bf89f04c4'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:16.271846 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-46747cdc-a533-4816-bdfd-9974cbda0196 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6d3bbb3f7ae4c81a4c1c36bf89f04c4'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:16.272549 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-46747cdc-a533-4816-bdfd-9974cbda0196 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6d3bbb3f7ae4c81a4c1c36bf89f04c4'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:16.282376 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-46747cdc-a533-4816-bdfd-9974cbda0196 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6d3bbb3f7ae4c81a4c1c36bf89f04c4'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:16.312338 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-46747cdc-a533-4816-bdfd-9974cbda0196 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6d3bbb3f7ae4c81a4c1c36bf89f04c4'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:16.342832 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1124/2273] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 13 15:30:16 2022] DELETE /identity/v3/users/c6d3bbb3f7ae4c81a4c1c36bf89f04c4 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:30:16.349151 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6861dc3-6c76-48cd-8bd5-2c57161b2338 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:16.350184 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6861dc3-6c76-48cd-8bd5-2c57161b2338 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:16.350664 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6861dc3-6c76-48cd-8bd5-2c57161b2338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:16.389254 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-b6861dc3-6c76-48cd-8bd5-2c57161b2338 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:30:16.390814 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-b6861dc3-6c76-48cd-8bd5-2c57161b2338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:16.508260 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1150/2274] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:30:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:30:16.526469 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46747cdc-a533-4816-bdfd-9974cbda0196 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:16.528144 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-46747cdc-a533-4816-bdfd-9974cbda0196 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:16.591414 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:30:16.615752 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cceff08-1cd1-4f4c-8889-ce005be65cd7 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:16.616046 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cceff08-1cd1-4f4c-8889-ce005be65cd7 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:16.616359 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cceff08-1cd1-4f4c-8889-ce005be65cd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:16.655349 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46747cdc-a533-4816-bdfd-9974cbda0196 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:16.666343 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecffa6ad-c907-4975-9104-373a85999bae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41675154bbba47388040966f75d84c3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:16.667094 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecffa6ad-c907-4975-9104-373a85999bae service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:16.667738 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecffa6ad-c907-4975-9104-373a85999bae service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:16.668263 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecffa6ad-c907-4975-9104-373a85999bae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:16.680628 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-4cceff08-1cd1-4f4c-8889-ce005be65cd7 None None] MFA Rules not processed for user `168dd28a0e4546c5a1f65f6b58f7dace`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:30:16.682477 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-4cceff08-1cd1-4f4c-8889-ce005be65cd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:16.708101 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecffa6ad-c907-4975-9104-373a85999bae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:16.731532 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecffa6ad-c907-4975-9104-373a85999bae service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:16.748953 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1125/2275] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:30:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:30:16.751316 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:30:16.847026 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1151/2276] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:30:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:30:16.865647 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecffa6ad-c907-4975-9104-373a85999bae service neutron] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:16.869014 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-ecffa6ad-c907-4975-9104-373a85999bae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:16.995824 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecffa6ad-c907-4975-9104-373a85999bae service neutron] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:17.001383 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1f8994-dc67-4321-bb4f-98a1f825d54b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97acd23097d54bf7805c3cef60626ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:17.002557 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1f8994-dc67-4321-bb4f-98a1f825d54b service cinder] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:17.003057 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1f8994-dc67-4321-bb4f-98a1f825d54b service cinder] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:17.003603 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1f8994-dc67-4321-bb4f-98a1f825d54b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:17.017410 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1f8994-dc67-4321-bb4f-98a1f825d54b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:17.019654 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1f8994-dc67-4321-bb4f-98a1f825d54b service cinder] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:17.030556 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1126/2277] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:30:16 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:30:17.204779 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cceff08-1cd1-4f4c-8889-ce005be65cd7 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:17.207545 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-4cceff08-1cd1-4f4c-8889-ce005be65cd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:17.223966 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cceff08-1cd1-4f4c-8889-ce005be65cd7 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:17.228804 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78223787-8118-476d-b737-aae4b81e2aa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:17.229450 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78223787-8118-476d-b737-aae4b81e2aa7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:17.229892 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78223787-8118-476d-b737-aae4b81e2aa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:17.230178 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78223787-8118-476d-b737-aae4b81e2aa7 admin admin] PATH_INFO: `/v3/projects/a380a66d56e44992ba5e1333d7dec39a` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:17.237282 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78223787-8118-476d-b737-aae4b81e2aa7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a380a66d56e44992ba5e1333d7dec39a)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:17.239737 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78223787-8118-476d-b737-aae4b81e2aa7 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:17.295220 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-78223787-8118-476d-b737-aae4b81e2aa7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a380a66d56e44992ba5e1333d7dec39a', 'request_id': 'req-78223787-8118-476d-b737-aae4b81e2aa7'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:17.302024 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-78223787-8118-476d-b737-aae4b81e2aa7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a380a66d56e44992ba5e1333d7dec39a', 'request_id': 'req-78223787-8118-476d-b737-aae4b81e2aa7'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:17.315010 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-78223787-8118-476d-b737-aae4b81e2aa7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a380a66d56e44992ba5e1333d7dec39a', 'request_id': 'req-78223787-8118-476d-b737-aae4b81e2aa7'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:17.328751 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-78223787-8118-476d-b737-aae4b81e2aa7 admin admin] The token cache is being invalidate because project a380a66d56e44992ba5e1333d7dec39a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 15:30:17.328923 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-78223787-8118-476d-b737-aae4b81e2aa7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:17.329649 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-78223787-8118-476d-b737-aae4b81e2aa7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:17.331617 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1152/2278] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 13 15:30:17 2022] DELETE /identity/v3/projects/a380a66d56e44992ba5e1333d7dec39a => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:30:17.335638 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1f8994-dc67-4321-bb4f-98a1f825d54b service cinder] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:17.347778 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1f8994-dc67-4321-bb4f-98a1f825d54b service cinder] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:17.426249 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661264a8-73ba-40cb-b4b4-66def1c5bafd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:17.426930 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661264a8-73ba-40cb-b4b4-66def1c5bafd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:17.427214 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661264a8-73ba-40cb-b4b4-66def1c5bafd admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:17.427493 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661264a8-73ba-40cb-b4b4-66def1c5bafd admin admin] PATH_INFO: `/v3/users/450b050cbf6d4dd0a4445c9ff8623546` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:17.428697 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661264a8-73ba-40cb-b4b4-66def1c5bafd admin admin] RBAC: Authorizing `identity:delete_user(user_id=450b050cbf6d4dd0a4445c9ff8623546)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:17.430732 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661264a8-73ba-40cb-b4b4-66def1c5bafd admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:17.479320 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-661264a8-73ba-40cb-b4b4-66def1c5bafd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '450b050cbf6d4dd0a4445c9ff8623546'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:17.479925 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-661264a8-73ba-40cb-b4b4-66def1c5bafd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '450b050cbf6d4dd0a4445c9ff8623546'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:17.480568 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-661264a8-73ba-40cb-b4b4-66def1c5bafd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '450b050cbf6d4dd0a4445c9ff8623546'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:17.488052 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-661264a8-73ba-40cb-b4b4-66def1c5bafd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '450b050cbf6d4dd0a4445c9ff8623546'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:17.499622 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-661264a8-73ba-40cb-b4b4-66def1c5bafd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '450b050cbf6d4dd0a4445c9ff8623546'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:17.508165 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:30:17.514827 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1127/2279] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 13 15:30:17 2022] DELETE /identity/v3/users/450b050cbf6d4dd0a4445c9ff8623546 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:30:17.788505 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78223787-8118-476d-b737-aae4b81e2aa7 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:17.790059 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-78223787-8118-476d-b737-aae4b81e2aa7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:17.805266 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78223787-8118-476d-b737-aae4b81e2aa7 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:17.872079 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08d4066-43af-425b-843c-a3fc76159365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:17.872917 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08d4066-43af-425b-843c-a3fc76159365 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:17.873337 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08d4066-43af-425b-843c-a3fc76159365 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:17.873680 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08d4066-43af-425b-843c-a3fc76159365 admin admin] PATH_INFO: `/v3/projects/4f87363be50c4bb496d43dafa92a2b0c` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:17.874950 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08d4066-43af-425b-843c-a3fc76159365 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f87363be50c4bb496d43dafa92a2b0c)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:17.877049 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08d4066-43af-425b-843c-a3fc76159365 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:17.929539 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-c08d4066-43af-425b-843c-a3fc76159365 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f87363be50c4bb496d43dafa92a2b0c', 'request_id': 'req-c08d4066-43af-425b-843c-a3fc76159365'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:17.936062 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-c08d4066-43af-425b-843c-a3fc76159365 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f87363be50c4bb496d43dafa92a2b0c', 'request_id': 'req-c08d4066-43af-425b-843c-a3fc76159365'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:17.938935 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:30:17.958400 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-c08d4066-43af-425b-843c-a3fc76159365 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f87363be50c4bb496d43dafa92a2b0c', 'request_id': 'req-c08d4066-43af-425b-843c-a3fc76159365'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:17.972922 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-c08d4066-43af-425b-843c-a3fc76159365 admin admin] The token cache is being invalidate because project 4f87363be50c4bb496d43dafa92a2b0c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 15:30:17.973343 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-c08d4066-43af-425b-843c-a3fc76159365 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:17.974054 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-c08d4066-43af-425b-843c-a3fc76159365 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:17.979343 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1153/2280] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 13 15:30:17 2022] DELETE /identity/v3/projects/4f87363be50c4bb496d43dafa92a2b0c => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:30:17.980635 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da732aff-9bfa-41da-bd14-61f553292513 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:17.981154 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da732aff-9bfa-41da-bd14-61f553292513 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:17.981255 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da732aff-9bfa-41da-bd14-61f553292513 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:18.004691 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-da732aff-9bfa-41da-bd14-61f553292513 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:30:18.006009 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-da732aff-9bfa-41da-bd14-61f553292513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:18.098706 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1128/2281] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:30:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 15:30:18.106607 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7f201c-f281-4cce-b6b9-d6e523ceb92f None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:18.106867 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7f201c-f281-4cce-b6b9-d6e523ceb92f None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:18.107215 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7f201c-f281-4cce-b6b9-d6e523ceb92f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:18.129290 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-fd7f201c-f281-4cce-b6b9-d6e523ceb92f None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:30:18.130702 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-fd7f201c-f281-4cce-b6b9-d6e523ceb92f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:18.157670 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1154/2282] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:30:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:30:18.159584 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da732aff-9bfa-41da-bd14-61f553292513 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:18.176106 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da732aff-9bfa-41da-bd14-61f553292513 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:18.181106 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bf884d-9cab-4245-9fcc-1b30a7adca5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:18.181747 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bf884d-9cab-4245-9fcc-1b30a7adca5a admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:18.182039 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bf884d-9cab-4245-9fcc-1b30a7adca5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:18.182334 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bf884d-9cab-4245-9fcc-1b30a7adca5a admin admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:18.182988 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bf884d-9cab-4245-9fcc-1b30a7adca5a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:30:18.183297 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bf884d-9cab-4245-9fcc-1b30a7adca5a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:18.184917 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bf884d-9cab-4245-9fcc-1b30a7adca5a admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:18.199794 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1129/2283] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Sep 13 15:30:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:30:18.211163 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7f201c-f281-4cce-b6b9-d6e523ceb92f None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:18.221465 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7f201c-f281-4cce-b6b9-d6e523ceb92f None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:18.227129 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfef753a-f84e-47a3-b503-f1acb46a3410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:18.229429 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfef753a-f84e-47a3-b503-f1acb46a3410 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:18.229933 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfef753a-f84e-47a3-b503-f1acb46a3410 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:18.230321 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfef753a-f84e-47a3-b503-f1acb46a3410 admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:18.230991 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfef753a-f84e-47a3-b503-f1acb46a3410 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:18.233216 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfef753a-f84e-47a3-b503-f1acb46a3410 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:18.294171 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1155/2284] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 13 15:30:18 2022] POST /identity/v3/projects => generated 379 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:30:18.295335 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bf884d-9cab-4245-9fcc-1b30a7adca5a admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:18.306893 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bf884d-9cab-4245-9fcc-1b30a7adca5a admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:18.395833 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e13410-3e2c-4f8a-8f24-4cb0c4cdbcf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:18.396508 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e13410-3e2c-4f8a-8f24-4cb0c4cdbcf0 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:18.396798 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e13410-3e2c-4f8a-8f24-4cb0c4cdbcf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:18.397232 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e13410-3e2c-4f8a-8f24-4cb0c4cdbcf0 admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:18.398260 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e13410-3e2c-4f8a-8f24-4cb0c4cdbcf0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:18.401659 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e13410-3e2c-4f8a-8f24-4cb0c4cdbcf0 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:18.432451 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1130/2285] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 13 15:30:18 2022] POST /identity/v3/users => generated 290 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 15:30:18.437167 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfef753a-f84e-47a3-b503-f1acb46a3410 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:18.449127 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2419252-ada3-422d-84ef-327bdfb709c7 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:18.449418 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2419252-ada3-422d-84ef-327bdfb709c7 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:18.449718 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2419252-ada3-422d-84ef-327bdfb709c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:18.451131 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfef753a-f84e-47a3-b503-f1acb46a3410 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:18.457665 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fa2553-974f-49dd-87e5-6ab2a2818899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:18.458374 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fa2553-974f-49dd-87e5-6ab2a2818899 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:18.458958 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fa2553-974f-49dd-87e5-6ab2a2818899 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:18.459166 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fa2553-974f-49dd-87e5-6ab2a2818899 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:18.459783 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fa2553-974f-49dd-87e5-6ab2a2818899 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:18.461575 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fa2553-974f-49dd-87e5-6ab2a2818899 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:18.474140 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1156/2286] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:30:18 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 15:30:18.478399 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fa2553-974f-49dd-87e5-6ab2a2818899 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:18.480377 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-d2419252-ada3-422d-84ef-327bdfb709c7 None None] MFA Rules not processed for user `168dd28a0e4546c5a1f65f6b58f7dace`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:30:18.481634 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-d2419252-ada3-422d-84ef-327bdfb709c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:18.491635 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fa2553-974f-49dd-87e5-6ab2a2818899 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:18.498476 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3887fe9d-2c58-4976-9f0e-9d6c27d35aa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:18.500024 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3887fe9d-2c58-4976-9f0e-9d6c27d35aa7 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:18.500384 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3887fe9d-2c58-4976-9f0e-9d6c27d35aa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:18.500963 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3887fe9d-2c58-4976-9f0e-9d6c27d35aa7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:18.501854 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3887fe9d-2c58-4976-9f0e-9d6c27d35aa7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:18.504323 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3887fe9d-2c58-4976-9f0e-9d6c27d35aa7 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:18.516157 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1157/2287] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:30:18 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 15:30:18.520914 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3887fe9d-2c58-4976-9f0e-9d6c27d35aa7 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:18.534510 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3887fe9d-2c58-4976-9f0e-9d6c27d35aa7 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:18.545313 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a731057-9f26-481e-87f0-2442bac6fc09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:18.546301 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a731057-9f26-481e-87f0-2442bac6fc09 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:18.546920 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a731057-9f26-481e-87f0-2442bac6fc09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:18.547470 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a731057-9f26-481e-87f0-2442bac6fc09 admin admin] PATH_INFO: `/v3/projects/a94a3dbec1274bc4a3346e2fcfe4a3a2/users/db28a0dd81c040cdacba7d9c3019657a/roles/3fae3d3a28e147d3b2bede2378ff79ae` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:18.562491 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1131/2288] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:30:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 15:30:18.566602 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a731057-9f26-481e-87f0-2442bac6fc09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a94a3dbec1274bc4a3346e2fcfe4a3a2, user_id=db28a0dd81c040cdacba7d9c3019657a, role_id=3fae3d3a28e147d3b2bede2378ff79ae)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:18.573887 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a731057-9f26-481e-87f0-2442bac6fc09 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:18.591833 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1158/2289] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 13 15:30:18 2022] PUT /identity/v3/projects/a94a3dbec1274bc4a3346e2fcfe4a3a2/users/db28a0dd81c040cdacba7d9c3019657a/roles/3fae3d3a28e147d3b2bede2378ff79ae => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 15:30:18.603119 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8937f4-da8e-4cbf-83f7-2b82b9e318c6 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:18.603342 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8937f4-da8e-4cbf-83f7-2b82b9e318c6 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:18.603651 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8937f4-da8e-4cbf-83f7-2b82b9e318c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:18.647092 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-de8937f4-da8e-4cbf-83f7-2b82b9e318c6 None None] MFA Rules not processed for user `db28a0dd81c040cdacba7d9c3019657a`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:30:18.648455 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-de8937f4-da8e-4cbf-83f7-2b82b9e318c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:18.659462 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:30:18.733396 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1132/2290] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:30:18 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:30:18.734427 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a731057-9f26-481e-87f0-2442bac6fc09 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:18.809912 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a731057-9f26-481e-87f0-2442bac6fc09 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:18.818929 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410e1ed3-f06b-45b3-873e-6148fde0c674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:18.819596 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410e1ed3-f06b-45b3-873e-6148fde0c674 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:18.819894 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410e1ed3-f06b-45b3-873e-6148fde0c674 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:18.820153 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410e1ed3-f06b-45b3-873e-6148fde0c674 admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:18.820858 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410e1ed3-f06b-45b3-873e-6148fde0c674 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:18.823393 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410e1ed3-f06b-45b3-873e-6148fde0c674 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:18.856755 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1159/2291] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 13 15:30:18 2022] POST /identity/v3/projects => generated 381 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 15:30:18.858035 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8937f4-da8e-4cbf-83f7-2b82b9e318c6 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:18.870880 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8937f4-da8e-4cbf-83f7-2b82b9e318c6 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:18.939749 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d92763-32a3-4cb3-bd60-ec85e44300a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:18.940360 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d92763-32a3-4cb3-bd60-ec85e44300a1 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:18.940647 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d92763-32a3-4cb3-bd60-ec85e44300a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:18.941106 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d92763-32a3-4cb3-bd60-ec85e44300a1 admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:18.941762 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d92763-32a3-4cb3-bd60-ec85e44300a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:18.943725 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d92763-32a3-4cb3-bd60-ec85e44300a1 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:18.965611 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1133/2292] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 13 15:30:18 2022] POST /identity/v3/users => generated 297 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 15:30:18.969613 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410e1ed3-f06b-45b3-873e-6148fde0c674 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:18.985594 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410e1ed3-f06b-45b3-873e-6148fde0c674 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:18.992173 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6b680c-8530-4606-9a18-e6b406908caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:18.992870 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6b680c-8530-4606-9a18-e6b406908caf admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:18.993153 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6b680c-8530-4606-9a18-e6b406908caf admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:18.993429 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6b680c-8530-4606-9a18-e6b406908caf admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:18.994144 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6b680c-8530-4606-9a18-e6b406908caf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:18.995825 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6b680c-8530-4606-9a18-e6b406908caf admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:19.007815 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1160/2293] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:30:18 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 15:30:19.011851 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d92763-32a3-4cb3-bd60-ec85e44300a1 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:19.023170 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d92763-32a3-4cb3-bd60-ec85e44300a1 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:19.028329 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d738c93-c8e7-4bb8-8235-687c521f5916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:19.028935 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d738c93-c8e7-4bb8-8235-687c521f5916 admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:19.029224 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d738c93-c8e7-4bb8-8235-687c521f5916 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:19.029502 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d738c93-c8e7-4bb8-8235-687c521f5916 admin admin] PATH_INFO: `/v3/projects/004260a9737147988ab1947ef221eae8/users/6a1d7d78f73f40dabc8d477595535af3/roles/f34412ad29f1478cba775b033129f71f` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:19.045464 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d738c93-c8e7-4bb8-8235-687c521f5916 admin admin] RBAC: Authorizing `identity:create_grant(project_id=004260a9737147988ab1947ef221eae8, user_id=6a1d7d78f73f40dabc8d477595535af3, role_id=f34412ad29f1478cba775b033129f71f)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:19.048110 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d738c93-c8e7-4bb8-8235-687c521f5916 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:19.061933 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1134/2294] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 13 15:30:19 2022] PUT /identity/v3/projects/004260a9737147988ab1947ef221eae8/users/6a1d7d78f73f40dabc8d477595535af3/roles/f34412ad29f1478cba775b033129f71f => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:30:19.072366 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6b680c-8530-4606-9a18-e6b406908caf admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:19.082791 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6b680c-8530-4606-9a18-e6b406908caf admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:19.128771 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:30:19.176994 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8586c80e-422e-4ff4-83ae-e5c14b45a555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:19.178030 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8586c80e-422e-4ff4-83ae-e5c14b45a555 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:19.178497 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8586c80e-422e-4ff4-83ae-e5c14b45a555 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:19.178957 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8586c80e-422e-4ff4-83ae-e5c14b45a555 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:19.179963 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8586c80e-422e-4ff4-83ae-e5c14b45a555 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:19.182843 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8586c80e-422e-4ff4-83ae-e5c14b45a555 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:19.197820 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1161/2295] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:30:19 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 15:30:19.202470 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d738c93-c8e7-4bb8-8235-687c521f5916 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:19.224567 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d738c93-c8e7-4bb8-8235-687c521f5916 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:19.229983 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c804c3-75f9-4de3-a839-5795c4d8353c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:19.230769 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c804c3-75f9-4de3-a839-5795c4d8353c admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:19.231174 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c804c3-75f9-4de3-a839-5795c4d8353c admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:19.231591 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c804c3-75f9-4de3-a839-5795c4d8353c admin admin] PATH_INFO: `/v3/projects/004260a9737147988ab1947ef221eae8/users/6a1d7d78f73f40dabc8d477595535af3/roles/f34412ad29f1478cba775b033129f71f` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:19.233883 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c804c3-75f9-4de3-a839-5795c4d8353c admin admin] RBAC: Authorizing `identity:create_grant(project_id=004260a9737147988ab1947ef221eae8, user_id=6a1d7d78f73f40dabc8d477595535af3, role_id=f34412ad29f1478cba775b033129f71f)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:19.237098 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c804c3-75f9-4de3-a839-5795c4d8353c admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:19.269799 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1135/2296] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 13 15:30:19 2022] PUT /identity/v3/projects/004260a9737147988ab1947ef221eae8/users/6a1d7d78f73f40dabc8d477595535af3/roles/f34412ad29f1478cba775b033129f71f => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 15:30:19.276651 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78277ca7-36ab-4c49-8d6e-0272ffadbb20 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:19.277320 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78277ca7-36ab-4c49-8d6e-0272ffadbb20 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:19.277846 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78277ca7-36ab-4c49-8d6e-0272ffadbb20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:19.323624 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-78277ca7-36ab-4c49-8d6e-0272ffadbb20 None None] MFA Rules not processed for user `6a1d7d78f73f40dabc8d477595535af3`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:30:19.324862 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-78277ca7-36ab-4c49-8d6e-0272ffadbb20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:19.431489 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1162/2297] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:30:19 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:30:19.444104 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c804c3-75f9-4de3-a839-5795c4d8353c admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:19.446352 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-d5c804c3-75f9-4de3-a839-5795c4d8353c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:19.541271 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c804c3-75f9-4de3-a839-5795c4d8353c admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:19.569220 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65c423b-725f-40f1-96d3-5f0e896432fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97acd23097d54bf7805c3cef60626ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:19.569997 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65c423b-725f-40f1-96d3-5f0e896432fa service cinder] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:19.570175 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65c423b-725f-40f1-96d3-5f0e896432fa service cinder] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:19.570452 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65c423b-725f-40f1-96d3-5f0e896432fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:19.584531 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65c423b-725f-40f1-96d3-5f0e896432fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:19.585871 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65c423b-725f-40f1-96d3-5f0e896432fa service cinder] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:19.614448 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1136/2298] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:30:19 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:30:20.108273 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78277ca7-36ab-4c49-8d6e-0272ffadbb20 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:20.181020 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78277ca7-36ab-4c49-8d6e-0272ffadbb20 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:20.185898 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bca573-90de-4c33-8397-86c04b6209db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:20.186545 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bca573-90de-4c33-8397-86c04b6209db admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:20.186959 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bca573-90de-4c33-8397-86c04b6209db admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:20.187245 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bca573-90de-4c33-8397-86c04b6209db admin admin] PATH_INFO: `/v3/users/db28a0dd81c040cdacba7d9c3019657a` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:20.188382 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bca573-90de-4c33-8397-86c04b6209db admin admin] RBAC: Authorizing `identity:delete_user(user_id=db28a0dd81c040cdacba7d9c3019657a)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:20.191294 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bca573-90de-4c33-8397-86c04b6209db admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:20.238569 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-34bca573-90de-4c33-8397-86c04b6209db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db28a0dd81c040cdacba7d9c3019657a'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:20.239215 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-34bca573-90de-4c33-8397-86c04b6209db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db28a0dd81c040cdacba7d9c3019657a'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:20.239849 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-34bca573-90de-4c33-8397-86c04b6209db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db28a0dd81c040cdacba7d9c3019657a'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:20.247338 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-34bca573-90de-4c33-8397-86c04b6209db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db28a0dd81c040cdacba7d9c3019657a'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:20.255760 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:30:20.260826 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-34bca573-90de-4c33-8397-86c04b6209db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db28a0dd81c040cdacba7d9c3019657a'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:20.274965 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1163/2299] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 13 15:30:20 2022] DELETE /identity/v3/users/db28a0dd81c040cdacba7d9c3019657a => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:30:20.279405 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73477fc-c81e-436a-b559-493dfeae2fbf None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:20.279879 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73477fc-c81e-436a-b559-493dfeae2fbf None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:20.279975 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73477fc-c81e-436a-b559-493dfeae2fbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:20.288945 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:30:20.301534 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-c73477fc-c81e-436a-b559-493dfeae2fbf None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:30:20.302848 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-c73477fc-c81e-436a-b559-493dfeae2fbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:20.372959 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1137/2300] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:30:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:30:20.383050 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bca573-90de-4c33-8397-86c04b6209db admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:20.384533 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-34bca573-90de-4c33-8397-86c04b6209db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:20.449511 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bca573-90de-4c33-8397-86c04b6209db admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:20.454008 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cd0be9-b244-473b-a23e-941f50db4f5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41675154bbba47388040966f75d84c3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:20.454658 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cd0be9-b244-473b-a23e-941f50db4f5b service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:20.455607 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cd0be9-b244-473b-a23e-941f50db4f5b service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:20.455911 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cd0be9-b244-473b-a23e-941f50db4f5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:20.466118 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cd0be9-b244-473b-a23e-941f50db4f5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:20.467752 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cd0be9-b244-473b-a23e-941f50db4f5b service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:20.478276 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1164/2301] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:30:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:30:20.840254 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73477fc-c81e-436a-b559-493dfeae2fbf None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:20.841688 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-c73477fc-c81e-436a-b559-493dfeae2fbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:20.867816 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73477fc-c81e-436a-b559-493dfeae2fbf None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:20.874082 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb9f68f-2533-4c3a-bf2b-1e687be24806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:20.874938 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb9f68f-2533-4c3a-bf2b-1e687be24806 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:20.875425 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb9f68f-2533-4c3a-bf2b-1e687be24806 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:20.875877 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb9f68f-2533-4c3a-bf2b-1e687be24806 admin admin] PATH_INFO: `/v3/projects/a94a3dbec1274bc4a3346e2fcfe4a3a2` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:20.878540 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb9f68f-2533-4c3a-bf2b-1e687be24806 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a94a3dbec1274bc4a3346e2fcfe4a3a2)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:20.880984 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb9f68f-2533-4c3a-bf2b-1e687be24806 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:21.003627 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-bcb9f68f-2533-4c3a-bf2b-1e687be24806 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a94a3dbec1274bc4a3346e2fcfe4a3a2', 'request_id': 'req-bcb9f68f-2533-4c3a-bf2b-1e687be24806'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:21.012439 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-bcb9f68f-2533-4c3a-bf2b-1e687be24806 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a94a3dbec1274bc4a3346e2fcfe4a3a2', 'request_id': 'req-bcb9f68f-2533-4c3a-bf2b-1e687be24806'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:21.021755 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-bcb9f68f-2533-4c3a-bf2b-1e687be24806 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a94a3dbec1274bc4a3346e2fcfe4a3a2', 'request_id': 'req-bcb9f68f-2533-4c3a-bf2b-1e687be24806'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:21.038622 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-bcb9f68f-2533-4c3a-bf2b-1e687be24806 admin admin] The token cache is being invalidate because project a94a3dbec1274bc4a3346e2fcfe4a3a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 15:30:21.038933 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-bcb9f68f-2533-4c3a-bf2b-1e687be24806 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:21.040324 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-bcb9f68f-2533-4c3a-bf2b-1e687be24806 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:21.043534 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1138/2302] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 13 15:30:20 2022] DELETE /identity/v3/projects/a94a3dbec1274bc4a3346e2fcfe4a3a2 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 15:30:21.047424 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cd0be9-b244-473b-a23e-941f50db4f5b service neutron] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:21.065427 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cd0be9-b244-473b-a23e-941f50db4f5b service neutron] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:21.157487 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aab96f0-355d-4ec7-aaeb-cb3babac6673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:21.157487 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aab96f0-355d-4ec7-aaeb-cb3babac6673 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:21.157487 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aab96f0-355d-4ec7-aaeb-cb3babac6673 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:21.157487 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aab96f0-355d-4ec7-aaeb-cb3babac6673 admin admin] PATH_INFO: `/v3/users/6a1d7d78f73f40dabc8d477595535af3` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:21.158789 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aab96f0-355d-4ec7-aaeb-cb3babac6673 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a1d7d78f73f40dabc8d477595535af3)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:21.158789 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aab96f0-355d-4ec7-aaeb-cb3babac6673 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:21.210120 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-2aab96f0-355d-4ec7-aaeb-cb3babac6673 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a1d7d78f73f40dabc8d477595535af3'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:21.210833 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-2aab96f0-355d-4ec7-aaeb-cb3babac6673 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a1d7d78f73f40dabc8d477595535af3'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:21.211504 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-2aab96f0-355d-4ec7-aaeb-cb3babac6673 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a1d7d78f73f40dabc8d477595535af3'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:21.219688 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-2aab96f0-355d-4ec7-aaeb-cb3babac6673 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a1d7d78f73f40dabc8d477595535af3'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:21.232057 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-2aab96f0-355d-4ec7-aaeb-cb3babac6673 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a1d7d78f73f40dabc8d477595535af3'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:21.247293 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1165/2303] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 13 15:30:21 2022] DELETE /identity/v3/users/6a1d7d78f73f40dabc8d477595535af3 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:30:22.002832 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb9f68f-2533-4c3a-bf2b-1e687be24806 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:22.006356 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-bcb9f68f-2533-4c3a-bf2b-1e687be24806 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:22.038866 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb9f68f-2533-4c3a-bf2b-1e687be24806 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:22.125613 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6095ffec-2b6d-4646-8267-471fde399ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:22.126377 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6095ffec-2b6d-4646-8267-471fde399ca5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:22.127477 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6095ffec-2b6d-4646-8267-471fde399ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:22.127875 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6095ffec-2b6d-4646-8267-471fde399ca5 admin admin] PATH_INFO: `/v3/projects/004260a9737147988ab1947ef221eae8` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:22.129224 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6095ffec-2b6d-4646-8267-471fde399ca5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=004260a9737147988ab1947ef221eae8)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:22.131300 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6095ffec-2b6d-4646-8267-471fde399ca5 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:22.180451 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:30:22.209275 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-6095ffec-2b6d-4646-8267-471fde399ca5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '004260a9737147988ab1947ef221eae8', 'request_id': 'req-6095ffec-2b6d-4646-8267-471fde399ca5'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:22.215495 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-6095ffec-2b6d-4646-8267-471fde399ca5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '004260a9737147988ab1947ef221eae8', 'request_id': 'req-6095ffec-2b6d-4646-8267-471fde399ca5'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:22.223690 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-6095ffec-2b6d-4646-8267-471fde399ca5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '004260a9737147988ab1947ef221eae8', 'request_id': 'req-6095ffec-2b6d-4646-8267-471fde399ca5'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:22.261837 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-6095ffec-2b6d-4646-8267-471fde399ca5 admin admin] The token cache is being invalidate because project 004260a9737147988ab1947ef221eae8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 15:30:22.262204 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-6095ffec-2b6d-4646-8267-471fde399ca5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:22.263100 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-6095ffec-2b6d-4646-8267-471fde399ca5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:22.271870 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1139/2304] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 13 15:30:22 2022] DELETE /identity/v3/projects/004260a9737147988ab1947ef221eae8 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:30:22.279467 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a984b693-bcb9-4f21-840f-aa5af5bb4707 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:22.279924 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a984b693-bcb9-4f21-840f-aa5af5bb4707 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:22.280004 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a984b693-bcb9-4f21-840f-aa5af5bb4707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:22.298434 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:30:22.308210 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-a984b693-bcb9-4f21-840f-aa5af5bb4707 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:30:22.310336 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-a984b693-bcb9-4f21-840f-aa5af5bb4707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:22.410590 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1166/2305] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:30:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:30:22.412648 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4796c832-ab6f-452f-aac1-87888a2514ab None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:22.412946 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4796c832-ab6f-452f-aac1-87888a2514ab None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:22.413216 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4796c832-ab6f-452f-aac1-87888a2514ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:22.444796 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-4796c832-ab6f-452f-aac1-87888a2514ab None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:30:22.446242 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-4796c832-ab6f-452f-aac1-87888a2514ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:22.461851 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1140/2306] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:30:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:30:22.462716 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a984b693-bcb9-4f21-840f-aa5af5bb4707 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:22.484171 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a984b693-bcb9-4f21-840f-aa5af5bb4707 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:22.512814 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8de0ffd-8c05-4dbb-992b-a186bfaf3c73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:22.513581 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8de0ffd-8c05-4dbb-992b-a186bfaf3c73 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:22.514029 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8de0ffd-8c05-4dbb-992b-a186bfaf3c73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:22.514303 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8de0ffd-8c05-4dbb-992b-a186bfaf3c73 admin admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:22.515001 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8de0ffd-8c05-4dbb-992b-a186bfaf3c73 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:30:22.515417 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8de0ffd-8c05-4dbb-992b-a186bfaf3c73 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:22.526771 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8de0ffd-8c05-4dbb-992b-a186bfaf3c73 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:22.541684 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1167/2307] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Sep 13 15:30:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:30:22.546305 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4796c832-ab6f-452f-aac1-87888a2514ab None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:22.557530 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4796c832-ab6f-452f-aac1-87888a2514ab None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:22.569399 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296068cd-c843-44af-a017-511a7009522b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:22.569627 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296068cd-c843-44af-a017-511a7009522b admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:22.570059 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296068cd-c843-44af-a017-511a7009522b admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:22.570416 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296068cd-c843-44af-a017-511a7009522b admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:22.571227 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296068cd-c843-44af-a017-511a7009522b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:22.573271 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296068cd-c843-44af-a017-511a7009522b admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:22.609128 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1141/2308] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 13 15:30:22 2022] POST /identity/v3/projects => generated 385 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:30:22.614202 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8de0ffd-8c05-4dbb-992b-a186bfaf3c73 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:22.639810 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8de0ffd-8c05-4dbb-992b-a186bfaf3c73 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:22.775745 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24996507-d1b1-4951-aa95-50facce31a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:22.777117 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24996507-d1b1-4951-aa95-50facce31a86 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:22.777446 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24996507-d1b1-4951-aa95-50facce31a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:22.777674 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24996507-d1b1-4951-aa95-50facce31a86 admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:22.778399 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24996507-d1b1-4951-aa95-50facce31a86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:22.781860 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24996507-d1b1-4951-aa95-50facce31a86 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:22.818942 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1168/2309] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 13 15:30:22 2022] POST /identity/v3/users => generated 293 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 15:30:22.823196 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296068cd-c843-44af-a017-511a7009522b admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:22.838687 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296068cd-c843-44af-a017-511a7009522b admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:22.848402 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de91a57-6530-4324-a231-71f44296c72e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:22.849042 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de91a57-6530-4324-a231-71f44296c72e admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:22.849379 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de91a57-6530-4324-a231-71f44296c72e admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:22.849660 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de91a57-6530-4324-a231-71f44296c72e admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:22.850451 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de91a57-6530-4324-a231-71f44296c72e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:22.852052 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de91a57-6530-4324-a231-71f44296c72e admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:22.864368 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1142/2310] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:30:22 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 15:30:22.868522 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24996507-d1b1-4951-aa95-50facce31a86 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:22.879436 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24996507-d1b1-4951-aa95-50facce31a86 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:22.884119 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28579e01-c84d-4484-85a9-c8b31719b983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:22.884852 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28579e01-c84d-4484-85a9-c8b31719b983 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:22.885200 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28579e01-c84d-4484-85a9-c8b31719b983 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:22.885659 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28579e01-c84d-4484-85a9-c8b31719b983 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:22.886420 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28579e01-c84d-4484-85a9-c8b31719b983 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:22.888302 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28579e01-c84d-4484-85a9-c8b31719b983 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:22.901017 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1169/2311] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:30:22 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 15:30:22.905197 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de91a57-6530-4324-a231-71f44296c72e admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:22.916956 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de91a57-6530-4324-a231-71f44296c72e admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:22.922153 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed845fc-a49e-458e-b650-6b9b4417acb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:22.922805 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed845fc-a49e-458e-b650-6b9b4417acb9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:22.923086 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed845fc-a49e-458e-b650-6b9b4417acb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:22.923362 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed845fc-a49e-458e-b650-6b9b4417acb9 admin admin] PATH_INFO: `/v3/projects/88d87fe9d70a4bf49e737460b139f9bd/users/a502481d192e46ce9ea6ca7a08850702/roles/3fae3d3a28e147d3b2bede2378ff79ae` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:22.938608 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed845fc-a49e-458e-b650-6b9b4417acb9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88d87fe9d70a4bf49e737460b139f9bd, user_id=a502481d192e46ce9ea6ca7a08850702, role_id=3fae3d3a28e147d3b2bede2378ff79ae)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:22.941762 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed845fc-a49e-458e-b650-6b9b4417acb9 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:22.958254 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1143/2312] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 13 15:30:22 2022] PUT /identity/v3/projects/88d87fe9d70a4bf49e737460b139f9bd/users/a502481d192e46ce9ea6ca7a08850702/roles/3fae3d3a28e147d3b2bede2378ff79ae => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:30:22.969417 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1630de47-3a3c-4958-b3c4-bc3567b2c712 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:22.969971 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1630de47-3a3c-4958-b3c4-bc3567b2c712 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:22.969971 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1630de47-3a3c-4958-b3c4-bc3567b2c712 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:23.000976 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-1630de47-3a3c-4958-b3c4-bc3567b2c712 None None] MFA Rules not processed for user `a502481d192e46ce9ea6ca7a08850702`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:30:23.002919 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-1630de47-3a3c-4958-b3c4-bc3567b2c712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:23.110054 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1170/2313] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:30:22 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:30:23.122369 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed845fc-a49e-458e-b650-6b9b4417acb9 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:23.124587 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-aed845fc-a49e-458e-b650-6b9b4417acb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:23.204595 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed845fc-a49e-458e-b650-6b9b4417acb9 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:23.209419 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdec33ec-9904-47eb-a150-4287278a6507 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97acd23097d54bf7805c3cef60626ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:23.210231 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdec33ec-9904-47eb-a150-4287278a6507 service cinder] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:23.210522 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdec33ec-9904-47eb-a150-4287278a6507 service cinder] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:23.210982 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdec33ec-9904-47eb-a150-4287278a6507 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:23.221364 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdec33ec-9904-47eb-a150-4287278a6507 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:23.223086 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdec33ec-9904-47eb-a150-4287278a6507 service cinder] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:23.238397 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1144/2314] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:30:23 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:30:28.736269 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1630de47-3a3c-4958-b3c4-bc3567b2c712 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:28.740577 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:30:28.806796 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1630de47-3a3c-4958-b3c4-bc3567b2c712 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:28.811825 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fbd694-d066-475e-b482-fedc595ae8d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:28.812480 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fbd694-d066-475e-b482-fedc595ae8d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:28.812768 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fbd694-d066-475e-b482-fedc595ae8d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:28.813049 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fbd694-d066-475e-b482-fedc595ae8d0 admin admin] PATH_INFO: `/v3/users/a502481d192e46ce9ea6ca7a08850702` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:28.814218 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fbd694-d066-475e-b482-fedc595ae8d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a502481d192e46ce9ea6ca7a08850702)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:28.816411 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fbd694-d066-475e-b482-fedc595ae8d0 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:28.870150 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-73fbd694-d066-475e-b482-fedc595ae8d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a502481d192e46ce9ea6ca7a08850702'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:28.870883 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-73fbd694-d066-475e-b482-fedc595ae8d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a502481d192e46ce9ea6ca7a08850702'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:28.871753 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-73fbd694-d066-475e-b482-fedc595ae8d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a502481d192e46ce9ea6ca7a08850702'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:28.879758 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-73fbd694-d066-475e-b482-fedc595ae8d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a502481d192e46ce9ea6ca7a08850702'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:28.892816 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-73fbd694-d066-475e-b482-fedc595ae8d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a502481d192e46ce9ea6ca7a08850702'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:28.908050 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1171/2315] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 13 15:30:28 2022] DELETE /identity/v3/users/a502481d192e46ce9ea6ca7a08850702 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:30:28.912988 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d754d112-ee7f-4bfd-b388-d749da7b5a82 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:28.913481 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d754d112-ee7f-4bfd-b388-d749da7b5a82 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:28.913601 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d754d112-ee7f-4bfd-b388-d749da7b5a82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:28.933663 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-d754d112-ee7f-4bfd-b388-d749da7b5a82 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:30:28.935275 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-d754d112-ee7f-4bfd-b388-d749da7b5a82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:28.994244 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:30:29.010057 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1145/2316] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:30:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:30:29.021993 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fbd694-d066-475e-b482-fedc595ae8d0 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:29.024480 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-73fbd694-d066-475e-b482-fedc595ae8d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:29.096894 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fbd694-d066-475e-b482-fedc595ae8d0 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:29.102382 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9bc1ad-a4c7-48dc-842f-355ed32cd077 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41675154bbba47388040966f75d84c3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:29.103104 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9bc1ad-a4c7-48dc-842f-355ed32cd077 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:29.103447 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9bc1ad-a4c7-48dc-842f-355ed32cd077 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:29.103733 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9bc1ad-a4c7-48dc-842f-355ed32cd077 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:29.115433 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9bc1ad-a4c7-48dc-842f-355ed32cd077 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:29.116977 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9bc1ad-a4c7-48dc-842f-355ed32cd077 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:29.129930 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1172/2317] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:30:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:30:29.436444 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d754d112-ee7f-4bfd-b388-d749da7b5a82 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:29.437942 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-d754d112-ee7f-4bfd-b388-d749da7b5a82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:29.457038 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d754d112-ee7f-4bfd-b388-d749da7b5a82 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:29.463062 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57299121-e134-43b9-94d7-3c1cc070bbc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:29.463912 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57299121-e134-43b9-94d7-3c1cc070bbc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:29.464399 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57299121-e134-43b9-94d7-3c1cc070bbc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:29.465104 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57299121-e134-43b9-94d7-3c1cc070bbc2 admin admin] PATH_INFO: `/v3/projects/88d87fe9d70a4bf49e737460b139f9bd` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:29.466390 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57299121-e134-43b9-94d7-3c1cc070bbc2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=88d87fe9d70a4bf49e737460b139f9bd)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:29.468405 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57299121-e134-43b9-94d7-3c1cc070bbc2 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:29.574738 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-57299121-e134-43b9-94d7-3c1cc070bbc2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88d87fe9d70a4bf49e737460b139f9bd', 'request_id': 'req-57299121-e134-43b9-94d7-3c1cc070bbc2'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:29.582446 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-57299121-e134-43b9-94d7-3c1cc070bbc2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88d87fe9d70a4bf49e737460b139f9bd', 'request_id': 'req-57299121-e134-43b9-94d7-3c1cc070bbc2'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:29.588247 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-57299121-e134-43b9-94d7-3c1cc070bbc2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88d87fe9d70a4bf49e737460b139f9bd', 'request_id': 'req-57299121-e134-43b9-94d7-3c1cc070bbc2'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:29.606433 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-57299121-e134-43b9-94d7-3c1cc070bbc2 admin admin] The token cache is being invalidate because project 88d87fe9d70a4bf49e737460b139f9bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 15:30:29.606819 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-57299121-e134-43b9-94d7-3c1cc070bbc2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:29.607541 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-57299121-e134-43b9-94d7-3c1cc070bbc2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:29.609275 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1146/2318] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 13 15:30:29 2022] DELETE /identity/v3/projects/88d87fe9d70a4bf49e737460b139f9bd => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:30:29.616054 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bf238b-4abc-4b15-97d1-9d31d4045679 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:29.616758 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bf238b-4abc-4b15-97d1-9d31d4045679 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:29.616758 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bf238b-4abc-4b15-97d1-9d31d4045679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:29.650659 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-11bf238b-4abc-4b15-97d1-9d31d4045679 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:30:29.651850 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-11bf238b-4abc-4b15-97d1-9d31d4045679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:29.671911 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:30:29.737292 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1173/2319] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:30:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:30:29.745501 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1a24ae-d465-44de-bd25-f01a33603374 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:29.745644 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1a24ae-d465-44de-bd25-f01a33603374 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:29.745936 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1a24ae-d465-44de-bd25-f01a33603374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:29.782712 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-6d1a24ae-d465-44de-bd25-f01a33603374 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:30:29.784743 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-6d1a24ae-d465-44de-bd25-f01a33603374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:29.797988 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1147/2320] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:30:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:30:29.802875 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bf238b-4abc-4b15-97d1-9d31d4045679 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:29.812425 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bf238b-4abc-4b15-97d1-9d31d4045679 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:29.818193 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772f5369-f2a8-4fa4-92ca-26e768cc8f15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:29.818810 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772f5369-f2a8-4fa4-92ca-26e768cc8f15 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:29.819098 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772f5369-f2a8-4fa4-92ca-26e768cc8f15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:29.819378 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772f5369-f2a8-4fa4-92ca-26e768cc8f15 admin admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:29.820040 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772f5369-f2a8-4fa4-92ca-26e768cc8f15 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:30:29.820350 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772f5369-f2a8-4fa4-92ca-26e768cc8f15 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:29.821994 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772f5369-f2a8-4fa4-92ca-26e768cc8f15 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:29.836422 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1174/2321] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Sep 13 15:30:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:30:29.841602 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1a24ae-d465-44de-bd25-f01a33603374 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:29.852532 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1a24ae-d465-44de-bd25-f01a33603374 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:29.857551 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e82fc1b-076f-4c30-b41e-19affc5e8983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:29.858440 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e82fc1b-076f-4c30-b41e-19affc5e8983 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:29.858730 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e82fc1b-076f-4c30-b41e-19affc5e8983 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:29.859011 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e82fc1b-076f-4c30-b41e-19affc5e8983 admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:29.859660 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e82fc1b-076f-4c30-b41e-19affc5e8983 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:29.861667 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e82fc1b-076f-4c30-b41e-19affc5e8983 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:29.893509 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1148/2322] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 13 15:30:29 2022] POST /identity/v3/projects => generated 375 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:30:29.898331 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772f5369-f2a8-4fa4-92ca-26e768cc8f15 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:29.915425 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772f5369-f2a8-4fa4-92ca-26e768cc8f15 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:30.002912 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1454079e-5f31-49ba-b6f8-8e8bb931a2ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:30.003570 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1454079e-5f31-49ba-b6f8-8e8bb931a2ec admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:30.003902 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1454079e-5f31-49ba-b6f8-8e8bb931a2ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:30.004185 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1454079e-5f31-49ba-b6f8-8e8bb931a2ec admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:30.004856 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1454079e-5f31-49ba-b6f8-8e8bb931a2ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:30.006928 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1454079e-5f31-49ba-b6f8-8e8bb931a2ec admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:30.029437 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1175/2323] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 13 15:30:29 2022] POST /identity/v3/users => generated 288 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:30:30.033737 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e82fc1b-076f-4c30-b41e-19affc5e8983 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:30.044283 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e82fc1b-076f-4c30-b41e-19affc5e8983 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:30.049163 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2941ee-fe6c-44f7-bb72-1e053cb0fb57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:30.050489 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2941ee-fe6c-44f7-bb72-1e053cb0fb57 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:30.051086 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2941ee-fe6c-44f7-bb72-1e053cb0fb57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:30.051365 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2941ee-fe6c-44f7-bb72-1e053cb0fb57 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:30.052215 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2941ee-fe6c-44f7-bb72-1e053cb0fb57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:30.053949 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2941ee-fe6c-44f7-bb72-1e053cb0fb57 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:30.066211 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1149/2324] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:30:30 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 15:30:30.070340 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1454079e-5f31-49ba-b6f8-8e8bb931a2ec admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:30.081688 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1454079e-5f31-49ba-b6f8-8e8bb931a2ec admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:30.086404 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d152cf5-7955-4a7f-94f3-d8aafcf37c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:30.087004 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d152cf5-7955-4a7f-94f3-d8aafcf37c50 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:30.087288 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d152cf5-7955-4a7f-94f3-d8aafcf37c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:30.087566 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d152cf5-7955-4a7f-94f3-d8aafcf37c50 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:30.088213 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d152cf5-7955-4a7f-94f3-d8aafcf37c50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:30.090006 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d152cf5-7955-4a7f-94f3-d8aafcf37c50 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:30.100867 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1176/2325] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:30:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 15:30:30.105259 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2941ee-fe6c-44f7-bb72-1e053cb0fb57 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:30.115508 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2941ee-fe6c-44f7-bb72-1e053cb0fb57 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:30.120274 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32935f66-2be3-42ee-9bbc-050d964c4c88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:30.120923 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32935f66-2be3-42ee-9bbc-050d964c4c88 admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:30.121205 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32935f66-2be3-42ee-9bbc-050d964c4c88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:30.121478 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32935f66-2be3-42ee-9bbc-050d964c4c88 admin admin] PATH_INFO: `/v3/projects/8dfb2c4d93f5409dafc44cceff6ac2bc/users/5bf7f6b4f3bf4e49a465e1698b82d15d/roles/3fae3d3a28e147d3b2bede2378ff79ae` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:30.137139 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32935f66-2be3-42ee-9bbc-050d964c4c88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8dfb2c4d93f5409dafc44cceff6ac2bc, user_id=5bf7f6b4f3bf4e49a465e1698b82d15d, role_id=3fae3d3a28e147d3b2bede2378ff79ae)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:30.139866 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32935f66-2be3-42ee-9bbc-050d964c4c88 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:30.156067 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1150/2326] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 13 15:30:30 2022] PUT /identity/v3/projects/8dfb2c4d93f5409dafc44cceff6ac2bc/users/5bf7f6b4f3bf4e49a465e1698b82d15d/roles/3fae3d3a28e147d3b2bede2378ff79ae => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:30:30.169499 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0d7cd9-75f7-473e-ab7f-0f4ee573e11b None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:30.169939 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0d7cd9-75f7-473e-ab7f-0f4ee573e11b None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:30.170226 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0d7cd9-75f7-473e-ab7f-0f4ee573e11b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:30.183371 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7201fe-c822-4fa6-ab0b-95faa180bec5 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:30.183679 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7201fe-c822-4fa6-ab0b-95faa180bec5 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:30.184491 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7201fe-c822-4fa6-ab0b-95faa180bec5 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:30.185877 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1151/2327] 10.222.0.27 () {54 vars in 921 bytes} [Tue Sep 13 15:30:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 15:30:30.202692 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-fd0d7cd9-75f7-473e-ab7f-0f4ee573e11b None None] MFA Rules not processed for user `5bf7f6b4f3bf4e49a465e1698b82d15d`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:30:30.203931 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-fd0d7cd9-75f7-473e-ab7f-0f4ee573e11b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:30.216103 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a376b16d-a5cb-41f3-8fea-3ff8eeec00d1 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:30.216948 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a376b16d-a5cb-41f3-8fea-3ff8eeec00d1 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:30.217352 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a376b16d-a5cb-41f3-8fea-3ff8eeec00d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:30.270215 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-a376b16d-a5cb-41f3-8fea-3ff8eeec00d1 None None] MFA Rules not processed for user `5b56f96cb3184a3ba82c8a0c3427e268`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:30:30.272700 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-a376b16d-a5cb-41f3-8fea-3ff8eeec00d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:30.326434 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1177/2328] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:30:30 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:30:30.328018 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0d7cd9-75f7-473e-ab7f-0f4ee573e11b None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:30.361226 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:30:30.396625 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1152/2329] 10.222.0.27 () {58 vars in 1018 bytes} [Tue Sep 13 15:30:30 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:30:30.416150 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a376b16d-a5cb-41f3-8fea-3ff8eeec00d1 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:30.417446 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-a376b16d-a5cb-41f3-8fea-3ff8eeec00d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:30.418793 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0d7cd9-75f7-473e-ab7f-0f4ee573e11b None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:30.423637 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cd277e-4c02-4395-b057-004dceb57351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:30.424731 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cd277e-4c02-4395-b057-004dceb57351 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:30.425017 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cd277e-4c02-4395-b057-004dceb57351 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:30.425296 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cd277e-4c02-4395-b057-004dceb57351 admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:30.425972 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cd277e-4c02-4395-b057-004dceb57351 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:30.429084 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cd277e-4c02-4395-b057-004dceb57351 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:30.433943 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a376b16d-a5cb-41f3-8fea-3ff8eeec00d1 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:30.439887 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a7b5e5-b940-4240-a247-855aeb57e36b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b56f96cb3184a3ba82c8a0c3427e268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:30.440268 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a7b5e5-b940-4240-a247-855aeb57e36b service placement] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:30.440778 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a7b5e5-b940-4240-a247-855aeb57e36b service placement] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:30.441104 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a7b5e5-b940-4240-a247-855aeb57e36b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:30.451156 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a7b5e5-b940-4240-a247-855aeb57e36b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:30.453039 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a7b5e5-b940-4240-a247-855aeb57e36b service placement] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:30.460924 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:30:30.470276 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1178/2330] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 13 15:30:30 2022] POST /identity/v3/projects => generated 375 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:30:30.471703 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cd277e-4c02-4395-b057-004dceb57351 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:30.472153 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1153/2331] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:30:30 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 15:30:30.603805 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cd277e-4c02-4395-b057-004dceb57351 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:30.608860 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee69aec-02bf-43c2-afe4-ced7cb6d9ada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:30.609484 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee69aec-02bf-43c2-afe4-ced7cb6d9ada admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:30.609783 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee69aec-02bf-43c2-afe4-ced7cb6d9ada admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:30.610055 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee69aec-02bf-43c2-afe4-ced7cb6d9ada admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:30.610682 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee69aec-02bf-43c2-afe4-ced7cb6d9ada admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:30.615563 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee69aec-02bf-43c2-afe4-ced7cb6d9ada admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:30.643857 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1179/2332] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 13 15:30:30 2022] POST /identity/v3/users => generated 294 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 15:30:30.647878 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a7b5e5-b940-4240-a247-855aeb57e36b service placement] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:30.659497 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a7b5e5-b940-4240-a247-855aeb57e36b service placement] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:30.664215 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3759f15-c249-402d-9c96-14aa1ffd7062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:30.664814 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3759f15-c249-402d-9c96-14aa1ffd7062 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:30.665092 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3759f15-c249-402d-9c96-14aa1ffd7062 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:30.665362 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3759f15-c249-402d-9c96-14aa1ffd7062 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:30.666028 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3759f15-c249-402d-9c96-14aa1ffd7062 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:30.667612 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3759f15-c249-402d-9c96-14aa1ffd7062 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:30.684218 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1154/2333] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:30:30 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 15:30:30.685645 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee69aec-02bf-43c2-afe4-ced7cb6d9ada admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:30.697471 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee69aec-02bf-43c2-afe4-ced7cb6d9ada admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:30.703624 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e70d025-eefe-4cf9-844b-1d4bffdd0338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:30.704290 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e70d025-eefe-4cf9-844b-1d4bffdd0338 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:30.704576 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e70d025-eefe-4cf9-844b-1d4bffdd0338 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:30.704845 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e70d025-eefe-4cf9-844b-1d4bffdd0338 admin admin] PATH_INFO: `/v3/projects/67866f8dbf0f45158112ebdb908aff79/users/da79111432e24a838a431ecdade94174/roles/f34412ad29f1478cba775b033129f71f` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:30.724457 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e70d025-eefe-4cf9-844b-1d4bffdd0338 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67866f8dbf0f45158112ebdb908aff79, user_id=da79111432e24a838a431ecdade94174, role_id=f34412ad29f1478cba775b033129f71f)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:30.728376 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e70d025-eefe-4cf9-844b-1d4bffdd0338 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:30.753746 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1180/2334] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 13 15:30:30 2022] PUT /identity/v3/projects/67866f8dbf0f45158112ebdb908aff79/users/da79111432e24a838a431ecdade94174/roles/f34412ad29f1478cba775b033129f71f => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:30:30.758937 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3759f15-c249-402d-9c96-14aa1ffd7062 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:30.770708 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3759f15-c249-402d-9c96-14aa1ffd7062 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:30.857886 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17c8218-ec5b-4577-9a00-6758dc939939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:30.858417 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17c8218-ec5b-4577-9a00-6758dc939939 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:30.858871 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17c8218-ec5b-4577-9a00-6758dc939939 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:30.859080 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17c8218-ec5b-4577-9a00-6758dc939939 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:30.859828 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17c8218-ec5b-4577-9a00-6758dc939939 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:30.862114 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17c8218-ec5b-4577-9a00-6758dc939939 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:30.876862 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1155/2335] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:30:30 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 15:30:30.878582 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e70d025-eefe-4cf9-844b-1d4bffdd0338 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:30.905750 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e70d025-eefe-4cf9-844b-1d4bffdd0338 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:30.914752 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f06ee81-ffb2-4ab5-83ba-0932c5532ffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:30.915544 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f06ee81-ffb2-4ab5-83ba-0932c5532ffa admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:30.915941 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f06ee81-ffb2-4ab5-83ba-0932c5532ffa admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:30.916409 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f06ee81-ffb2-4ab5-83ba-0932c5532ffa admin admin] PATH_INFO: `/v3/projects/67866f8dbf0f45158112ebdb908aff79/users/da79111432e24a838a431ecdade94174/roles/f34412ad29f1478cba775b033129f71f` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:30.919216 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f06ee81-ffb2-4ab5-83ba-0932c5532ffa admin admin] RBAC: Authorizing `identity:create_grant(project_id=67866f8dbf0f45158112ebdb908aff79, user_id=da79111432e24a838a431ecdade94174, role_id=f34412ad29f1478cba775b033129f71f)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:30.922607 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f06ee81-ffb2-4ab5-83ba-0932c5532ffa admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:30.934573 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1181/2336] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 13 15:30:30 2022] PUT /identity/v3/projects/67866f8dbf0f45158112ebdb908aff79/users/da79111432e24a838a431ecdade94174/roles/f34412ad29f1478cba775b033129f71f => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 15:30:30.944836 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa526e2b-3206-49de-8afa-24988f1f4731 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:30.945130 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa526e2b-3206-49de-8afa-24988f1f4731 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:30.945412 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa526e2b-3206-49de-8afa-24988f1f4731 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:30.983204 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-fa526e2b-3206-49de-8afa-24988f1f4731 None None] MFA Rules not processed for user `da79111432e24a838a431ecdade94174`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:30:30.984873 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-fa526e2b-3206-49de-8afa-24988f1f4731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:30.987130 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f06ee81-ffb2-4ab5-83ba-0932c5532ffa admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:30.988798 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-1f06ee81-ffb2-4ab5-83ba-0932c5532ffa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:31.086438 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:30:31.090630 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f06ee81-ffb2-4ab5-83ba-0932c5532ffa admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:31.095945 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1156/2337] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:30:30 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:30:31.100944 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6803586-2ac6-4caa-a0dd-ce0598589c9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:31.102077 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6803586-2ac6-4caa-a0dd-ce0598589c9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:31.102664 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6803586-2ac6-4caa-a0dd-ce0598589c9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:31.102953 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6803586-2ac6-4caa-a0dd-ce0598589c9a admin admin] PATH_INFO: `/v3/users/563945912b194705a0045b7163a6bc81` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:31.107724 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa526e2b-3206-49de-8afa-24988f1f4731 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:31.109236 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-fa526e2b-3206-49de-8afa-24988f1f4731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:31.111270 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6803586-2ac6-4caa-a0dd-ce0598589c9a admin admin] RBAC: Authorizing `identity:delete_user(user_id=563945912b194705a0045b7163a6bc81)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:31.116148 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6803586-2ac6-4caa-a0dd-ce0598589c9a admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:31.179055 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-c6803586-2ac6-4caa-a0dd-ce0598589c9a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '563945912b194705a0045b7163a6bc81'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:31.180145 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-c6803586-2ac6-4caa-a0dd-ce0598589c9a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '563945912b194705a0045b7163a6bc81'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:31.180784 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa526e2b-3206-49de-8afa-24988f1f4731 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:31.180921 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-c6803586-2ac6-4caa-a0dd-ce0598589c9a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '563945912b194705a0045b7163a6bc81'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:31.185302 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b90daf4-f696-4f35-a4e0-9b471e5be0ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97acd23097d54bf7805c3cef60626ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:31.185946 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b90daf4-f696-4f35-a4e0-9b471e5be0ab service cinder] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:31.186233 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b90daf4-f696-4f35-a4e0-9b471e5be0ab service cinder] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:31.186514 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b90daf4-f696-4f35-a4e0-9b471e5be0ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:31.188287 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-5b90daf4-f696-4f35-a4e0-9b471e5be0ab service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:31.188428 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-c6803586-2ac6-4caa-a0dd-ce0598589c9a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '563945912b194705a0045b7163a6bc81'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:31.201635 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-c6803586-2ac6-4caa-a0dd-ce0598589c9a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '563945912b194705a0045b7163a6bc81'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:31.218232 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1182/2338] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 13 15:30:30 2022] DELETE /identity/v3/users/563945912b194705a0045b7163a6bc81 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 15:30:31.223360 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:30:31.266566 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b90daf4-f696-4f35-a4e0-9b471e5be0ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:31.268592 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b90daf4-f696-4f35-a4e0-9b471e5be0ab service cinder] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:31.278401 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1157/2339] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:30:31 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 15:30:31.415349 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6803586-2ac6-4caa-a0dd-ce0598589c9a admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:31.417331 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-c6803586-2ac6-4caa-a0dd-ce0598589c9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:31.522030 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6803586-2ac6-4caa-a0dd-ce0598589c9a admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:31.527253 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163e35ad-f396-49de-92ae-bc7d453331ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:31.528014 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163e35ad-f396-49de-92ae-bc7d453331ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:31.528405 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163e35ad-f396-49de-92ae-bc7d453331ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:31.528750 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163e35ad-f396-49de-92ae-bc7d453331ad admin admin] PATH_INFO: `/v3/projects/fb05e0747a5e4291861b5fb0b727a40a` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:31.530198 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163e35ad-f396-49de-92ae-bc7d453331ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb05e0747a5e4291861b5fb0b727a40a)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:31.532484 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163e35ad-f396-49de-92ae-bc7d453331ad admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:31.637804 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-163e35ad-f396-49de-92ae-bc7d453331ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb05e0747a5e4291861b5fb0b727a40a', 'request_id': 'req-163e35ad-f396-49de-92ae-bc7d453331ad'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:31.650408 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-163e35ad-f396-49de-92ae-bc7d453331ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb05e0747a5e4291861b5fb0b727a40a', 'request_id': 'req-163e35ad-f396-49de-92ae-bc7d453331ad'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:31.667181 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-163e35ad-f396-49de-92ae-bc7d453331ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb05e0747a5e4291861b5fb0b727a40a', 'request_id': 'req-163e35ad-f396-49de-92ae-bc7d453331ad'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:31.694296 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-163e35ad-f396-49de-92ae-bc7d453331ad admin admin] The token cache is being invalidate because project fb05e0747a5e4291861b5fb0b727a40a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 15:30:31.694296 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-163e35ad-f396-49de-92ae-bc7d453331ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:31.694296 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-163e35ad-f396-49de-92ae-bc7d453331ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:31.700673 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1183/2340] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 13 15:30:31 2022] DELETE /identity/v3/projects/fb05e0747a5e4291861b5fb0b727a40a => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:30:31.702257 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b90daf4-f696-4f35-a4e0-9b471e5be0ab service cinder] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:31.716358 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b90daf4-f696-4f35-a4e0-9b471e5be0ab service cinder] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:31.798024 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0f9daf-5dd5-443c-a95d-4f1b4b75080a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:31.798683 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0f9daf-5dd5-443c-a95d-4f1b4b75080a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:31.799774 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0f9daf-5dd5-443c-a95d-4f1b4b75080a admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:31.800068 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0f9daf-5dd5-443c-a95d-4f1b4b75080a admin admin] PATH_INFO: `/v3/users/344e23c65a63430889a20621ff82b9dc` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:31.801520 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0f9daf-5dd5-443c-a95d-4f1b4b75080a admin admin] RBAC: Authorizing `identity:delete_user(user_id=344e23c65a63430889a20621ff82b9dc)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:31.803842 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0f9daf-5dd5-443c-a95d-4f1b4b75080a admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:31.872337 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-9b0f9daf-5dd5-443c-a95d-4f1b4b75080a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '344e23c65a63430889a20621ff82b9dc'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:31.873259 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-9b0f9daf-5dd5-443c-a95d-4f1b4b75080a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '344e23c65a63430889a20621ff82b9dc'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:31.874066 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-9b0f9daf-5dd5-443c-a95d-4f1b4b75080a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '344e23c65a63430889a20621ff82b9dc'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:31.885904 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-9b0f9daf-5dd5-443c-a95d-4f1b4b75080a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '344e23c65a63430889a20621ff82b9dc'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:31.901790 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-9b0f9daf-5dd5-443c-a95d-4f1b4b75080a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '344e23c65a63430889a20621ff82b9dc'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:31.929192 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1158/2341] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 13 15:30:31 2022] DELETE /identity/v3/users/344e23c65a63430889a20621ff82b9dc => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:30:32.148552 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163e35ad-f396-49de-92ae-bc7d453331ad admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:32.150149 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-163e35ad-f396-49de-92ae-bc7d453331ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:32.164465 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163e35ad-f396-49de-92ae-bc7d453331ad admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:32.168460 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:30:32.228455 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a482daf-bc01-46f0-b17d-2dcf1766793d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:32.229016 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a482daf-bc01-46f0-b17d-2dcf1766793d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:32.229299 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a482daf-bc01-46f0-b17d-2dcf1766793d admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:32.229577 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a482daf-bc01-46f0-b17d-2dcf1766793d admin admin] PATH_INFO: `/v3/projects/3392aa9dbe144ec1be2ec91e8fa8f1cf` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:32.230740 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a482daf-bc01-46f0-b17d-2dcf1766793d admin admin] RBAC: Authorizing `identity:delete_project(project_id=3392aa9dbe144ec1be2ec91e8fa8f1cf)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:32.232661 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a482daf-bc01-46f0-b17d-2dcf1766793d admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:32.282011 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-2a482daf-bc01-46f0-b17d-2dcf1766793d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3392aa9dbe144ec1be2ec91e8fa8f1cf', 'request_id': 'req-2a482daf-bc01-46f0-b17d-2dcf1766793d'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:32.288941 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-2a482daf-bc01-46f0-b17d-2dcf1766793d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3392aa9dbe144ec1be2ec91e8fa8f1cf', 'request_id': 'req-2a482daf-bc01-46f0-b17d-2dcf1766793d'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:32.295976 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-2a482daf-bc01-46f0-b17d-2dcf1766793d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3392aa9dbe144ec1be2ec91e8fa8f1cf', 'request_id': 'req-2a482daf-bc01-46f0-b17d-2dcf1766793d'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:32.307273 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-2a482daf-bc01-46f0-b17d-2dcf1766793d admin admin] The token cache is being invalidate because project 3392aa9dbe144ec1be2ec91e8fa8f1cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 15:30:32.307566 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-2a482daf-bc01-46f0-b17d-2dcf1766793d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:32.308254 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-2a482daf-bc01-46f0-b17d-2dcf1766793d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:32.309793 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1184/2342] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 13 15:30:32 2022] DELETE /identity/v3/projects/3392aa9dbe144ec1be2ec91e8fa8f1cf => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:30:32.314797 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d8557c-0cab-48b3-b166-d3399e10f960 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:32.315260 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d8557c-0cab-48b3-b166-d3399e10f960 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:32.315529 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d8557c-0cab-48b3-b166-d3399e10f960 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:32.335440 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-87d8557c-0cab-48b3-b166-d3399e10f960 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:30:32.336650 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-87d8557c-0cab-48b3-b166-d3399e10f960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:32.381204 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:30:32.413818 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1159/2343] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:30:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:30:32.418269 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686f1555-a8be-40cc-b39c-2ac208f7caf7 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:32.418625 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686f1555-a8be-40cc-b39c-2ac208f7caf7 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:32.418977 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686f1555-a8be-40cc-b39c-2ac208f7caf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:32.439633 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-686f1555-a8be-40cc-b39c-2ac208f7caf7 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:30:32.440839 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-686f1555-a8be-40cc-b39c-2ac208f7caf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:32.448764 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1185/2344] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:30:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:30:32.453364 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d8557c-0cab-48b3-b166-d3399e10f960 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:32.463124 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d8557c-0cab-48b3-b166-d3399e10f960 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:32.468972 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2bfc58-f391-44e6-88f1-7c7bf6a0c06d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:32.469763 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2bfc58-f391-44e6-88f1-7c7bf6a0c06d admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:32.470102 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2bfc58-f391-44e6-88f1-7c7bf6a0c06d admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:32.470362 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2bfc58-f391-44e6-88f1-7c7bf6a0c06d admin admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:32.471788 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2bfc58-f391-44e6-88f1-7c7bf6a0c06d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:30:32.472099 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2bfc58-f391-44e6-88f1-7c7bf6a0c06d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:32.473762 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2bfc58-f391-44e6-88f1-7c7bf6a0c06d admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:32.488787 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1160/2345] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Sep 13 15:30:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:30:32.493076 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686f1555-a8be-40cc-b39c-2ac208f7caf7 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:32.502590 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686f1555-a8be-40cc-b39c-2ac208f7caf7 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:32.507468 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ca5813-2118-4904-aa02-d965a80ec024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:32.508070 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ca5813-2118-4904-aa02-d965a80ec024 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:32.508376 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ca5813-2118-4904-aa02-d965a80ec024 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:32.508643 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ca5813-2118-4904-aa02-d965a80ec024 admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:32.509315 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ca5813-2118-4904-aa02-d965a80ec024 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:32.511243 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ca5813-2118-4904-aa02-d965a80ec024 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:32.538384 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1186/2346] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 13 15:30:32 2022] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:30:32.542688 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2bfc58-f391-44e6-88f1-7c7bf6a0c06d admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:32.553658 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2bfc58-f391-44e6-88f1-7c7bf6a0c06d admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:32.613146 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af3a061-379a-4797-ae49-b4ffb2582f19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:32.613643 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af3a061-379a-4797-ae49-b4ffb2582f19 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:32.613959 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af3a061-379a-4797-ae49-b4ffb2582f19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:32.614237 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af3a061-379a-4797-ae49-b4ffb2582f19 admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:32.614884 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af3a061-379a-4797-ae49-b4ffb2582f19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:32.617028 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af3a061-379a-4797-ae49-b4ffb2582f19 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:32.639025 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1161/2347] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 13 15:30:32 2022] POST /identity/v3/users => generated 293 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:30:32.643902 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ca5813-2118-4904-aa02-d965a80ec024 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:32.654358 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ca5813-2118-4904-aa02-d965a80ec024 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:32.659679 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb53c4d7-cd69-4916-91fa-40d79432a483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:32.660352 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb53c4d7-cd69-4916-91fa-40d79432a483 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:32.660704 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb53c4d7-cd69-4916-91fa-40d79432a483 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:32.661055 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb53c4d7-cd69-4916-91fa-40d79432a483 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:32.661805 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb53c4d7-cd69-4916-91fa-40d79432a483 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:32.663486 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb53c4d7-cd69-4916-91fa-40d79432a483 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:32.673884 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1187/2348] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:30:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 15:30:32.678137 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af3a061-379a-4797-ae49-b4ffb2582f19 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:32.688441 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af3a061-379a-4797-ae49-b4ffb2582f19 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:32.693727 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afda6373-1416-40ef-a9cb-c50e8c459cdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:32.694351 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afda6373-1416-40ef-a9cb-c50e8c459cdd admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:32.694636 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afda6373-1416-40ef-a9cb-c50e8c459cdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:32.694911 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afda6373-1416-40ef-a9cb-c50e8c459cdd admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:32.695558 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afda6373-1416-40ef-a9cb-c50e8c459cdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:32.697152 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afda6373-1416-40ef-a9cb-c50e8c459cdd admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:32.714935 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1162/2349] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:30:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 15:30:32.715962 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb53c4d7-cd69-4916-91fa-40d79432a483 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:32.728045 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb53c4d7-cd69-4916-91fa-40d79432a483 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:32.735816 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e55bc4-3633-45d4-8b01-ca6fd65d71db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:32.736633 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e55bc4-3633-45d4-8b01-ca6fd65d71db admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:32.736927 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e55bc4-3633-45d4-8b01-ca6fd65d71db admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:32.737202 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e55bc4-3633-45d4-8b01-ca6fd65d71db admin admin] PATH_INFO: `/v3/projects/c12e7e52c14147a1b01b502c08acce81/users/ddcd8e6a42ac441b99989a441fdceaf9/roles/3fae3d3a28e147d3b2bede2378ff79ae` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:32.754609 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e55bc4-3633-45d4-8b01-ca6fd65d71db admin admin] RBAC: Authorizing `identity:create_grant(project_id=c12e7e52c14147a1b01b502c08acce81, user_id=ddcd8e6a42ac441b99989a441fdceaf9, role_id=3fae3d3a28e147d3b2bede2378ff79ae)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:32.757599 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e55bc4-3633-45d4-8b01-ca6fd65d71db admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:32.784748 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1188/2350] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 13 15:30:32 2022] PUT /identity/v3/projects/c12e7e52c14147a1b01b502c08acce81/users/ddcd8e6a42ac441b99989a441fdceaf9/roles/3fae3d3a28e147d3b2bede2378ff79ae => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:30:32.794885 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e995179d-44ba-45d0-ac40-89fa2fc7969b None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:32.795184 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e995179d-44ba-45d0-ac40-89fa2fc7969b None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:32.795467 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e995179d-44ba-45d0-ac40-89fa2fc7969b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:32.834927 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-e995179d-44ba-45d0-ac40-89fa2fc7969b None None] MFA Rules not processed for user `ddcd8e6a42ac441b99989a441fdceaf9`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:30:32.836316 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-e995179d-44ba-45d0-ac40-89fa2fc7969b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:32.960369 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1163/2351] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:30:32 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:30:32.966012 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e55bc4-3633-45d4-8b01-ca6fd65d71db admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:33.022926 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:30:33.107815 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e55bc4-3633-45d4-8b01-ca6fd65d71db admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:33.113990 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee05f688-9786-4c6f-9dc0-40f6017f41bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:33.114710 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee05f688-9786-4c6f-9dc0-40f6017f41bb admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:33.115309 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee05f688-9786-4c6f-9dc0-40f6017f41bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:33.116038 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee05f688-9786-4c6f-9dc0-40f6017f41bb admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:33.117088 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee05f688-9786-4c6f-9dc0-40f6017f41bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:33.119472 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee05f688-9786-4c6f-9dc0-40f6017f41bb admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:33.157032 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1189/2352] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 13 15:30:32 2022] POST /identity/v3/projects => generated 383 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:30:33.161787 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e995179d-44ba-45d0-ac40-89fa2fc7969b None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:33.177489 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e995179d-44ba-45d0-ac40-89fa2fc7969b None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:33.234625 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:30:33.258595 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636b5c1c-5a8c-450c-8154-f91aefb1ba33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:33.259279 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636b5c1c-5a8c-450c-8154-f91aefb1ba33 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:33.259565 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636b5c1c-5a8c-450c-8154-f91aefb1ba33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:33.259847 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636b5c1c-5a8c-450c-8154-f91aefb1ba33 admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:33.260620 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636b5c1c-5a8c-450c-8154-f91aefb1ba33 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:33.262875 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636b5c1c-5a8c-450c-8154-f91aefb1ba33 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:33.306232 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1164/2353] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 13 15:30:33 2022] POST /identity/v3/users => generated 292 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:30:33.310742 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee05f688-9786-4c6f-9dc0-40f6017f41bb admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:33.324743 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee05f688-9786-4c6f-9dc0-40f6017f41bb admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:33.343308 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20f2135-7b83-4d0d-8b2e-23d898db3eda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:33.344295 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20f2135-7b83-4d0d-8b2e-23d898db3eda admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:33.344726 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20f2135-7b83-4d0d-8b2e-23d898db3eda admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:33.345159 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20f2135-7b83-4d0d-8b2e-23d898db3eda admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:33.347121 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20f2135-7b83-4d0d-8b2e-23d898db3eda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:33.349963 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20f2135-7b83-4d0d-8b2e-23d898db3eda admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:33.364377 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1190/2354] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:30:33 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 15:30:33.377891 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636b5c1c-5a8c-450c-8154-f91aefb1ba33 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:33.391648 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636b5c1c-5a8c-450c-8154-f91aefb1ba33 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:33.400277 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f64614f-8346-4a31-abc9-2e1ff95c571f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:33.401141 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f64614f-8346-4a31-abc9-2e1ff95c571f admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:33.402039 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f64614f-8346-4a31-abc9-2e1ff95c571f admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:33.402494 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f64614f-8346-4a31-abc9-2e1ff95c571f admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:33.403474 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f64614f-8346-4a31-abc9-2e1ff95c571f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:33.406172 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f64614f-8346-4a31-abc9-2e1ff95c571f admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:33.428098 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1165/2355] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:30:33 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 15:30:33.433206 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20f2135-7b83-4d0d-8b2e-23d898db3eda admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:33.454915 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20f2135-7b83-4d0d-8b2e-23d898db3eda admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:33.469308 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a46f86-738e-4e98-aa44-035a4528162c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:33.470194 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a46f86-738e-4e98-aa44-035a4528162c admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:33.471631 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a46f86-738e-4e98-aa44-035a4528162c admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:33.471631 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a46f86-738e-4e98-aa44-035a4528162c admin admin] PATH_INFO: `/v3/projects/9d858b74882d43af883a4bd3d24ab6ab/users/aca9e3131660426b8ce8b84aa4da3e66/roles/3fae3d3a28e147d3b2bede2378ff79ae` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:33.504549 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a46f86-738e-4e98-aa44-035a4528162c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d858b74882d43af883a4bd3d24ab6ab, user_id=aca9e3131660426b8ce8b84aa4da3e66, role_id=3fae3d3a28e147d3b2bede2378ff79ae)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:33.508122 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a46f86-738e-4e98-aa44-035a4528162c admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:33.550078 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1191/2356] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 13 15:30:33 2022] PUT /identity/v3/projects/9d858b74882d43af883a4bd3d24ab6ab/users/aca9e3131660426b8ce8b84aa4da3e66/roles/3fae3d3a28e147d3b2bede2378ff79ae => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:30:33.560964 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ba1952-64fb-4184-ab76-2abcad82d4a0 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:33.561392 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ba1952-64fb-4184-ab76-2abcad82d4a0 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:33.561660 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ba1952-64fb-4184-ab76-2abcad82d4a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:33.608253 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-b1ba1952-64fb-4184-ab76-2abcad82d4a0 None None] MFA Rules not processed for user `aca9e3131660426b8ce8b84aa4da3e66`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:30:33.609539 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-b1ba1952-64fb-4184-ab76-2abcad82d4a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:33.732330 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1166/2357] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:30:33 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:30:33.737912 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a46f86-738e-4e98-aa44-035a4528162c admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:33.854391 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a46f86-738e-4e98-aa44-035a4528162c admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:33.859741 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e1b005-ea57-46a3-ac15-8ac4de30f8d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:33.860508 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e1b005-ea57-46a3-ac15-8ac4de30f8d6 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:33.860887 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e1b005-ea57-46a3-ac15-8ac4de30f8d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:33.861273 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e1b005-ea57-46a3-ac15-8ac4de30f8d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:33.862782 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e1b005-ea57-46a3-ac15-8ac4de30f8d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:33.865125 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e1b005-ea57-46a3-ac15-8ac4de30f8d6 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:33.903119 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1192/2358] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 13 15:30:33 2022] POST /identity/v3/projects => generated 385 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:30:33.907395 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ba1952-64fb-4184-ab76-2abcad82d4a0 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:33.937146 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ba1952-64fb-4184-ab76-2abcad82d4a0 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:34.021986 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c2c4ed-1c60-4b92-9b67-4093a3c50a77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:34.022523 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c2c4ed-1c60-4b92-9b67-4093a3c50a77 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:34.022837 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c2c4ed-1c60-4b92-9b67-4093a3c50a77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:34.023249 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c2c4ed-1c60-4b92-9b67-4093a3c50a77 admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:34.023919 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c2c4ed-1c60-4b92-9b67-4093a3c50a77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:34.026624 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c2c4ed-1c60-4b92-9b67-4093a3c50a77 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:34.056149 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1167/2359] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 13 15:30:33 2022] POST /identity/v3/users => generated 299 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 15:30:34.059621 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e1b005-ea57-46a3-ac15-8ac4de30f8d6 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:34.075206 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e1b005-ea57-46a3-ac15-8ac4de30f8d6 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:34.082447 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3903919-1996-4cb6-acc2-a7c2c2245787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:34.083088 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3903919-1996-4cb6-acc2-a7c2c2245787 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:34.083367 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3903919-1996-4cb6-acc2-a7c2c2245787 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:34.083638 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3903919-1996-4cb6-acc2-a7c2c2245787 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:34.084351 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3903919-1996-4cb6-acc2-a7c2c2245787 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:34.086079 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3903919-1996-4cb6-acc2-a7c2c2245787 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:34.102317 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1193/2360] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:30:34 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 15:30:34.103667 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c2c4ed-1c60-4b92-9b67-4093a3c50a77 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:34.114932 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c2c4ed-1c60-4b92-9b67-4093a3c50a77 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:34.120922 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c1bac8-c8f2-42d7-b23c-ed48cd2a3c7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:34.121670 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c1bac8-c8f2-42d7-b23c-ed48cd2a3c7b admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:34.121925 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c1bac8-c8f2-42d7-b23c-ed48cd2a3c7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:34.122210 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c1bac8-c8f2-42d7-b23c-ed48cd2a3c7b admin admin] PATH_INFO: `/v3/projects/2a1db6345a4d40e5800eafa990d33fc0/users/c6a927c05d3d404ea0fc54f554336cf0/roles/f34412ad29f1478cba775b033129f71f` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:34.139672 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c1bac8-c8f2-42d7-b23c-ed48cd2a3c7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a1db6345a4d40e5800eafa990d33fc0, user_id=c6a927c05d3d404ea0fc54f554336cf0, role_id=f34412ad29f1478cba775b033129f71f)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:34.144461 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c1bac8-c8f2-42d7-b23c-ed48cd2a3c7b admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:34.172405 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1168/2361] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 13 15:30:34 2022] PUT /identity/v3/projects/2a1db6345a4d40e5800eafa990d33fc0/users/c6a927c05d3d404ea0fc54f554336cf0/roles/f34412ad29f1478cba775b033129f71f => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:30:34.176931 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3903919-1996-4cb6-acc2-a7c2c2245787 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:34.191176 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3903919-1996-4cb6-acc2-a7c2c2245787 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:34.192930 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c1bac8-c8f2-42d7-b23c-ed48cd2a3c7b admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:34.194789 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-38c1bac8-c8f2-42d7-b23c-ed48cd2a3c7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:34.217158 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:30:34.292097 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:30:34.300460 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c1bac8-c8f2-42d7-b23c-ed48cd2a3c7b admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:34.305991 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1634bd7-76e2-4fe8-993d-f4a53fbb0521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:34.306663 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1634bd7-76e2-4fe8-993d-f4a53fbb0521 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:34.306807 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be45dd5-6206-43a6-b182-939882979f52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:34.307044 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1634bd7-76e2-4fe8-993d-f4a53fbb0521 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:34.307273 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1634bd7-76e2-4fe8-993d-f4a53fbb0521 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:34.307678 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be45dd5-6206-43a6-b182-939882979f52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:34.307854 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1634bd7-76e2-4fe8-993d-f4a53fbb0521 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:34.308153 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be45dd5-6206-43a6-b182-939882979f52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:34.308518 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be45dd5-6206-43a6-b182-939882979f52 admin admin] PATH_INFO: `/v3/users/5bf7f6b4f3bf4e49a465e1698b82d15d` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:34.310032 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1634bd7-76e2-4fe8-993d-f4a53fbb0521 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:34.310154 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be45dd5-6206-43a6-b182-939882979f52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5bf7f6b4f3bf4e49a465e1698b82d15d)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:34.312441 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be45dd5-6206-43a6-b182-939882979f52 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:34.324884 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1194/2362] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:30:34 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 15:30:34.325951 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1634bd7-76e2-4fe8-993d-f4a53fbb0521 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:34.339642 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1634bd7-76e2-4fe8-993d-f4a53fbb0521 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:34.345279 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed6696a-1e48-4ecd-b03a-2975dba85e31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:34.346039 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed6696a-1e48-4ecd-b03a-2975dba85e31 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:34.346512 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed6696a-1e48-4ecd-b03a-2975dba85e31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:34.347095 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed6696a-1e48-4ecd-b03a-2975dba85e31 admin admin] PATH_INFO: `/v3/projects/2a1db6345a4d40e5800eafa990d33fc0/users/c6a927c05d3d404ea0fc54f554336cf0/roles/f34412ad29f1478cba775b033129f71f` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:34.349247 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed6696a-1e48-4ecd-b03a-2975dba85e31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a1db6345a4d40e5800eafa990d33fc0, user_id=c6a927c05d3d404ea0fc54f554336cf0, role_id=f34412ad29f1478cba775b033129f71f)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:34.352130 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed6696a-1e48-4ecd-b03a-2975dba85e31 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:34.365066 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1195/2363] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 13 15:30:34 2022] PUT /identity/v3/projects/2a1db6345a4d40e5800eafa990d33fc0/users/c6a927c05d3d404ea0fc54f554336cf0/roles/f34412ad29f1478cba775b033129f71f => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:30:34.382406 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a732a5-0540-424c-970d-56bb3b058219 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:34.383165 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a732a5-0540-424c-970d-56bb3b058219 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:34.383559 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a732a5-0540-424c-970d-56bb3b058219 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:34.400356 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-0be45dd5-6206-43a6-b182-939882979f52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5bf7f6b4f3bf4e49a465e1698b82d15d'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:34.401215 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-0be45dd5-6206-43a6-b182-939882979f52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5bf7f6b4f3bf4e49a465e1698b82d15d'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:34.402034 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-0be45dd5-6206-43a6-b182-939882979f52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5bf7f6b4f3bf4e49a465e1698b82d15d'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:34.415454 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-72a732a5-0540-424c-970d-56bb3b058219 None None] MFA Rules not processed for user `c6a927c05d3d404ea0fc54f554336cf0`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:30:34.416679 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-72a732a5-0540-424c-970d-56bb3b058219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:34.418459 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-0be45dd5-6206-43a6-b182-939882979f52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5bf7f6b4f3bf4e49a465e1698b82d15d'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:34.433906 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-0be45dd5-6206-43a6-b182-939882979f52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5bf7f6b4f3bf4e49a465e1698b82d15d'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:34.450083 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1169/2364] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 13 15:30:34 2022] DELETE /identity/v3/users/5bf7f6b4f3bf4e49a465e1698b82d15d => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 15:30:34.456077 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b064882-67c0-4ac5-89d9-4bc5887a9d29 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:34.457129 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b064882-67c0-4ac5-89d9-4bc5887a9d29 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:34.457129 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b064882-67c0-4ac5-89d9-4bc5887a9d29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:34.482031 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-0b064882-67c0-4ac5-89d9-4bc5887a9d29 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:30:34.483242 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-0b064882-67c0-4ac5-89d9-4bc5887a9d29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:34.501365 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1196/2365] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:30:34 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 15:30:34.514180 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a732a5-0540-424c-970d-56bb3b058219 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:34.515639 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-72a732a5-0540-424c-970d-56bb3b058219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:34.564375 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1170/2366] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:30:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 15:30:34.575555 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b064882-67c0-4ac5-89d9-4bc5887a9d29 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:34.577539 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-0b064882-67c0-4ac5-89d9-4bc5887a9d29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:34.584321 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a732a5-0540-424c-970d-56bb3b058219 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:34.618699 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:30:34.652218 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b064882-67c0-4ac5-89d9-4bc5887a9d29 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:34.656069 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8727ae88-9748-4f12-8255-bccbb80ea05a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41675154bbba47388040966f75d84c3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:34.656761 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8727ae88-9748-4f12-8255-bccbb80ea05a service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:34.657119 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8727ae88-9748-4f12-8255-bccbb80ea05a service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:34.657473 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8727ae88-9748-4f12-8255-bccbb80ea05a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:34.664525 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5aeeb04-d067-40d6-87e3-e0e69a7c1008 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97acd23097d54bf7805c3cef60626ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:34.666151 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aeeb04-d067-40d6-87e3-e0e69a7c1008 service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:34.666151 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aeeb04-d067-40d6-87e3-e0e69a7c1008 service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:34.666431 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aeeb04-d067-40d6-87e3-e0e69a7c1008 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:34.668185 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-b5aeeb04-d067-40d6-87e3-e0e69a7c1008 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:34.668304 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8727ae88-9748-4f12-8255-bccbb80ea05a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:34.669888 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8727ae88-9748-4f12-8255-bccbb80ea05a service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:34.681917 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1171/2367] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:30:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 15:30:34.682851 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8727ae88-9748-4f12-8255-bccbb80ea05a service neutron] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:34.685612 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-8727ae88-9748-4f12-8255-bccbb80ea05a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:34.700985 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8727ae88-9748-4f12-8255-bccbb80ea05a service neutron] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:34.707018 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1638d21-0252-42ec-92a6-4cab3a6ef25d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:34.707895 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1638d21-0252-42ec-92a6-4cab3a6ef25d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:34.709816 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1638d21-0252-42ec-92a6-4cab3a6ef25d admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:34.709816 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1638d21-0252-42ec-92a6-4cab3a6ef25d admin admin] PATH_INFO: `/v3/users/934c6bde65974389a4eb51aefa9f9974` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:34.712230 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1638d21-0252-42ec-92a6-4cab3a6ef25d admin admin] RBAC: Authorizing `identity:delete_user(user_id=934c6bde65974389a4eb51aefa9f9974)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:34.717649 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1638d21-0252-42ec-92a6-4cab3a6ef25d admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:34.727892 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:30:34.779189 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5aeeb04-d067-40d6-87e3-e0e69a7c1008 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:34.782029 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5aeeb04-d067-40d6-87e3-e0e69a7c1008 service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:34.812679 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1197/2368] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:30:34 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:30:34.826041 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-d1638d21-0252-42ec-92a6-4cab3a6ef25d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '934c6bde65974389a4eb51aefa9f9974'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:34.826041 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-d1638d21-0252-42ec-92a6-4cab3a6ef25d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '934c6bde65974389a4eb51aefa9f9974'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:34.826793 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-d1638d21-0252-42ec-92a6-4cab3a6ef25d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '934c6bde65974389a4eb51aefa9f9974'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:34.837427 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-d1638d21-0252-42ec-92a6-4cab3a6ef25d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '934c6bde65974389a4eb51aefa9f9974'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:34.870721 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-d1638d21-0252-42ec-92a6-4cab3a6ef25d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '934c6bde65974389a4eb51aefa9f9974'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:34.901728 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1172/2369] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 13 15:30:34 2022] DELETE /identity/v3/users/934c6bde65974389a4eb51aefa9f9974 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:30:34.903543 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3c60e2-58f9-45db-a268-5ac9055d0254 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:34.904063 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3c60e2-58f9-45db-a268-5ac9055d0254 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:34.904767 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3c60e2-58f9-45db-a268-5ac9055d0254 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:34.929850 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-9a3c60e2-58f9-45db-a268-5ac9055d0254 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:30:34.931579 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-9a3c60e2-58f9-45db-a268-5ac9055d0254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:35.033177 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1198/2370] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:30:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 15:30:35.087498 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1638d21-0252-42ec-92a6-4cab3a6ef25d admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:35.088907 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-d1638d21-0252-42ec-92a6-4cab3a6ef25d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:35.250068 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1638d21-0252-42ec-92a6-4cab3a6ef25d admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:35.255937 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2efe0e-3a2c-4500-a26f-5d4df1e1d81e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41675154bbba47388040966f75d84c3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:35.256558 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2efe0e-3a2c-4500-a26f-5d4df1e1d81e service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:35.256837 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2efe0e-3a2c-4500-a26f-5d4df1e1d81e service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:35.257241 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2efe0e-3a2c-4500-a26f-5d4df1e1d81e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:35.275209 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2efe0e-3a2c-4500-a26f-5d4df1e1d81e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:35.277077 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2efe0e-3a2c-4500-a26f-5d4df1e1d81e service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:35.292361 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1173/2371] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:30:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:30:35.404480 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3c60e2-58f9-45db-a268-5ac9055d0254 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:35.406920 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-9a3c60e2-58f9-45db-a268-5ac9055d0254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:35.440753 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3c60e2-58f9-45db-a268-5ac9055d0254 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:35.447835 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dc0d58-801f-4206-b7f9-8dd68b965b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:35.448493 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dc0d58-801f-4206-b7f9-8dd68b965b05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:35.448773 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dc0d58-801f-4206-b7f9-8dd68b965b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:35.449045 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dc0d58-801f-4206-b7f9-8dd68b965b05 admin admin] PATH_INFO: `/v3/projects/8dfb2c4d93f5409dafc44cceff6ac2bc` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:35.450278 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dc0d58-801f-4206-b7f9-8dd68b965b05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8dfb2c4d93f5409dafc44cceff6ac2bc)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:35.452706 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dc0d58-801f-4206-b7f9-8dd68b965b05 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:35.518457 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-c5dc0d58-801f-4206-b7f9-8dd68b965b05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8dfb2c4d93f5409dafc44cceff6ac2bc', 'request_id': 'req-c5dc0d58-801f-4206-b7f9-8dd68b965b05'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:35.538480 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81e42c8-9fb6-40a4-86f3-ae00fddbbda2 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:35.539024 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81e42c8-9fb6-40a4-86f3-ae00fddbbda2 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:35.539024 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81e42c8-9fb6-40a4-86f3-ae00fddbbda2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:35.543567 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-c5dc0d58-801f-4206-b7f9-8dd68b965b05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8dfb2c4d93f5409dafc44cceff6ac2bc', 'request_id': 'req-c5dc0d58-801f-4206-b7f9-8dd68b965b05'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:35.553488 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-c5dc0d58-801f-4206-b7f9-8dd68b965b05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8dfb2c4d93f5409dafc44cceff6ac2bc', 'request_id': 'req-c5dc0d58-801f-4206-b7f9-8dd68b965b05'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:35.561921 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-f81e42c8-9fb6-40a4-86f3-ae00fddbbda2 None None] MFA Rules not processed for user `7fe1e310cd5b4506bc6e10a2f5742cbb`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:30:35.563240 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-f81e42c8-9fb6-40a4-86f3-ae00fddbbda2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:35.574818 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-c5dc0d58-801f-4206-b7f9-8dd68b965b05 admin admin] The token cache is being invalidate because project 8dfb2c4d93f5409dafc44cceff6ac2bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 15:30:35.575124 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-c5dc0d58-801f-4206-b7f9-8dd68b965b05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:35.575779 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-c5dc0d58-801f-4206-b7f9-8dd68b965b05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:35.578213 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1199/2372] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 13 15:30:35 2022] DELETE /identity/v3/projects/8dfb2c4d93f5409dafc44cceff6ac2bc => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:30:35.582591 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dc0d58-801f-4206-b7f9-8dd68b965b05 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:35.584070 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-c5dc0d58-801f-4206-b7f9-8dd68b965b05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:35.624174 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:30:35.646065 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1174/2373] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:30:35 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:30:35.669447 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dc0d58-801f-4206-b7f9-8dd68b965b05 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:35.679286 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833c3344-6442-48ff-bf6d-0e3dac1a0eee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:35.680181 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833c3344-6442-48ff-bf6d-0e3dac1a0eee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:35.680365 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833c3344-6442-48ff-bf6d-0e3dac1a0eee admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:35.680760 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833c3344-6442-48ff-bf6d-0e3dac1a0eee admin admin] PATH_INFO: `/v3/users/da79111432e24a838a431ecdade94174` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:35.682146 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833c3344-6442-48ff-bf6d-0e3dac1a0eee admin admin] RBAC: Authorizing `identity:delete_user(user_id=da79111432e24a838a431ecdade94174)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:35.684198 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833c3344-6442-48ff-bf6d-0e3dac1a0eee admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:35.690537 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:30:35.760551 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-833c3344-6442-48ff-bf6d-0e3dac1a0eee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da79111432e24a838a431ecdade94174'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:35.761216 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-833c3344-6442-48ff-bf6d-0e3dac1a0eee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da79111432e24a838a431ecdade94174'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:35.761871 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-833c3344-6442-48ff-bf6d-0e3dac1a0eee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da79111432e24a838a431ecdade94174'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:35.768915 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-833c3344-6442-48ff-bf6d-0e3dac1a0eee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da79111432e24a838a431ecdade94174'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:35.780968 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-833c3344-6442-48ff-bf6d-0e3dac1a0eee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da79111432e24a838a431ecdade94174'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:35.801738 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1200/2374] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 13 15:30:35 2022] DELETE /identity/v3/users/da79111432e24a838a431ecdade94174 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 15:30:36.060458 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81e42c8-9fb6-40a4-86f3-ae00fddbbda2 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:36.062833 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-f81e42c8-9fb6-40a4-86f3-ae00fddbbda2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:36.084956 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81e42c8-9fb6-40a4-86f3-ae00fddbbda2 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:36.166953 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a081cde-badc-4718-a1f7-bb70acaa2bc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:36.167600 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a081cde-badc-4718-a1f7-bb70acaa2bc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:36.167885 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a081cde-badc-4718-a1f7-bb70acaa2bc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:36.168163 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a081cde-badc-4718-a1f7-bb70acaa2bc0 admin admin] PATH_INFO: `/v3/projects/5a4619ae55a2400583b28469715c96aa` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:36.169333 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a081cde-badc-4718-a1f7-bb70acaa2bc0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a4619ae55a2400583b28469715c96aa)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:36.171306 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a081cde-badc-4718-a1f7-bb70acaa2bc0 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:36.229350 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-8a081cde-badc-4718-a1f7-bb70acaa2bc0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a4619ae55a2400583b28469715c96aa', 'request_id': 'req-8a081cde-badc-4718-a1f7-bb70acaa2bc0'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:36.253673 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-8a081cde-badc-4718-a1f7-bb70acaa2bc0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a4619ae55a2400583b28469715c96aa', 'request_id': 'req-8a081cde-badc-4718-a1f7-bb70acaa2bc0'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:36.267130 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-8a081cde-badc-4718-a1f7-bb70acaa2bc0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a4619ae55a2400583b28469715c96aa', 'request_id': 'req-8a081cde-badc-4718-a1f7-bb70acaa2bc0'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:36.273567 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833c3344-6442-48ff-bf6d-0e3dac1a0eee admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:36.276344 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-833c3344-6442-48ff-bf6d-0e3dac1a0eee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:36.292998 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833c3344-6442-48ff-bf6d-0e3dac1a0eee admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:36.301183 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-8a081cde-badc-4718-a1f7-bb70acaa2bc0 admin admin] The token cache is being invalidate because project 5a4619ae55a2400583b28469715c96aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 15:30:36.301849 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-8a081cde-badc-4718-a1f7-bb70acaa2bc0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:36.304085 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-8a081cde-badc-4718-a1f7-bb70acaa2bc0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:36.308271 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1175/2375] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 13 15:30:36 2022] DELETE /identity/v3/projects/5a4619ae55a2400583b28469715c96aa => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:30:36.313152 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee690d5e-f5e0-4fa4-94bd-5e66381bef80 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:36.313538 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee690d5e-f5e0-4fa4-94bd-5e66381bef80 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:36.313932 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee690d5e-f5e0-4fa4-94bd-5e66381bef80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:36.357486 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-ee690d5e-f5e0-4fa4-94bd-5e66381bef80 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:30:36.360057 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-ee690d5e-f5e0-4fa4-94bd-5e66381bef80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:36.411543 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28837e9c-8125-4154-b169-47fb3557734a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:36.412336 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28837e9c-8125-4154-b169-47fb3557734a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:36.412530 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28837e9c-8125-4154-b169-47fb3557734a admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:36.412793 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28837e9c-8125-4154-b169-47fb3557734a admin admin] PATH_INFO: `/v3/projects/67866f8dbf0f45158112ebdb908aff79` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:36.414211 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28837e9c-8125-4154-b169-47fb3557734a admin admin] RBAC: Authorizing `identity:delete_project(project_id=67866f8dbf0f45158112ebdb908aff79)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:36.419502 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28837e9c-8125-4154-b169-47fb3557734a admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:36.446722 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1176/2376] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:30:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:30:36.455691 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2279de-141a-4a34-8c78-07954f404811 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:36.456124 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2279de-141a-4a34-8c78-07954f404811 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:36.456438 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2279de-141a-4a34-8c78-07954f404811 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:36.499932 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-2a2279de-141a-4a34-8c78-07954f404811 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:30:36.501485 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-2a2279de-141a-4a34-8c78-07954f404811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:36.506887 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-28837e9c-8125-4154-b169-47fb3557734a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67866f8dbf0f45158112ebdb908aff79', 'request_id': 'req-28837e9c-8125-4154-b169-47fb3557734a'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:36.515856 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-28837e9c-8125-4154-b169-47fb3557734a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67866f8dbf0f45158112ebdb908aff79', 'request_id': 'req-28837e9c-8125-4154-b169-47fb3557734a'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:36.538848 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:30:36.539433 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-28837e9c-8125-4154-b169-47fb3557734a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67866f8dbf0f45158112ebdb908aff79', 'request_id': 'req-28837e9c-8125-4154-b169-47fb3557734a'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:36.558882 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-28837e9c-8125-4154-b169-47fb3557734a admin admin] The token cache is being invalidate because project 67866f8dbf0f45158112ebdb908aff79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 15:30:36.559263 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-28837e9c-8125-4154-b169-47fb3557734a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:36.562536 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-28837e9c-8125-4154-b169-47fb3557734a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:36.566275 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1201/2377] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 13 15:30:36 2022] DELETE /identity/v3/projects/67866f8dbf0f45158112ebdb908aff79 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:30:36.591302 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bd2198-7b50-479a-8ab4-4d2ad0bf32de None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:36.599204 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bd2198-7b50-479a-8ab4-4d2ad0bf32de None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:36.599204 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bd2198-7b50-479a-8ab4-4d2ad0bf32de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:36.605261 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1177/2378] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:30:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 15:30:36.610166 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2279de-141a-4a34-8c78-07954f404811 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:36.621015 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2279de-141a-4a34-8c78-07954f404811 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:36.625951 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00e815e-0f8b-4f36-a562-7c6e399ac32d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:36.626555 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00e815e-0f8b-4f36-a562-7c6e399ac32d admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:36.626885 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00e815e-0f8b-4f36-a562-7c6e399ac32d admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:36.627703 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00e815e-0f8b-4f36-a562-7c6e399ac32d admin admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:36.628227 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-22bd2198-7b50-479a-8ab4-4d2ad0bf32de None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:30:36.628367 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00e815e-0f8b-4f36-a562-7c6e399ac32d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:30:36.628651 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00e815e-0f8b-4f36-a562-7c6e399ac32d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:36.629868 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-22bd2198-7b50-479a-8ab4-4d2ad0bf32de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:36.630578 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00e815e-0f8b-4f36-a562-7c6e399ac32d admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:36.647924 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1202/2379] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:30:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:30:36.647924 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bd2198-7b50-479a-8ab4-4d2ad0bf32de None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:36.650141 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-22bd2198-7b50-479a-8ab4-4d2ad0bf32de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:36.656529 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:30:36.658416 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1178/2380] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Sep 13 15:30:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:30:36.659394 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00e815e-0f8b-4f36-a562-7c6e399ac32d admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:36.681543 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00e815e-0f8b-4f36-a562-7c6e399ac32d admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:36.687806 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b9bf9a-d9df-41a6-ba4d-5c881367483f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:36.688753 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b9bf9a-d9df-41a6-ba4d-5c881367483f admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:36.689248 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b9bf9a-d9df-41a6-ba4d-5c881367483f admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:36.690329 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b9bf9a-d9df-41a6-ba4d-5c881367483f admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:36.691518 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b9bf9a-d9df-41a6-ba4d-5c881367483f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:36.693871 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b9bf9a-d9df-41a6-ba4d-5c881367483f admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:36.739276 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1179/2381] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 13 15:30:36 2022] POST /identity/v3/projects => generated 375 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:30:36.740717 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55801bb0-f078-460a-8359-736c273a5a0c None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:36.741016 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55801bb0-f078-460a-8359-736c273a5a0c None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:36.741299 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55801bb0-f078-460a-8359-736c273a5a0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:36.775216 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-55801bb0-f078-460a-8359-736c273a5a0c None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:30:36.777416 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-55801bb0-f078-460a-8359-736c273a5a0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:36.785630 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bd2198-7b50-479a-8ab4-4d2ad0bf32de None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:36.898541 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1180/2382] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:30:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:30:36.900076 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55801bb0-f078-460a-8359-736c273a5a0c None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:36.904162 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c382a3-156d-4057-bd2d-1da6d5566ba1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97acd23097d54bf7805c3cef60626ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:36.904853 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c382a3-156d-4057-bd2d-1da6d5566ba1 service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:36.905139 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c382a3-156d-4057-bd2d-1da6d5566ba1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:36.905413 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c382a3-156d-4057-bd2d-1da6d5566ba1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:36.913691 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55801bb0-f078-460a-8359-736c273a5a0c None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:36.919209 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e125acd-956b-4aa9-9675-65e8b80c7541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:36.920014 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e125acd-956b-4aa9-9675-65e8b80c7541 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:36.920459 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e125acd-956b-4aa9-9675-65e8b80c7541 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:36.920905 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e125acd-956b-4aa9-9675-65e8b80c7541 admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:36.921692 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e125acd-956b-4aa9-9675-65e8b80c7541 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:36.922590 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-90c382a3-156d-4057-bd2d-1da6d5566ba1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:36.939040 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e125acd-956b-4aa9-9675-65e8b80c7541 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:36.974225 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1181/2383] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 13 15:30:36 2022] POST /identity/v3/users => generated 288 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:30:36.974225 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e125acd-956b-4aa9-9675-65e8b80c7541 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:36.983582 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e125acd-956b-4aa9-9675-65e8b80c7541 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:36.989731 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a41e616-0afb-40fc-8269-e6fd091e4baf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:36.990390 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a41e616-0afb-40fc-8269-e6fd091e4baf admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:36.990647 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a41e616-0afb-40fc-8269-e6fd091e4baf admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:36.990930 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a41e616-0afb-40fc-8269-e6fd091e4baf admin admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:36.991692 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a41e616-0afb-40fc-8269-e6fd091e4baf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:30:36.992005 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a41e616-0afb-40fc-8269-e6fd091e4baf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:36.993806 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a41e616-0afb-40fc-8269-e6fd091e4baf admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:37.022379 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1182/2384] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Sep 13 15:30:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:30:37.023303 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a41e616-0afb-40fc-8269-e6fd091e4baf admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:37.035331 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a41e616-0afb-40fc-8269-e6fd091e4baf admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:37.040260 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c8ac46-d4b8-46a3-9f8d-899308da5ffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:37.040978 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c8ac46-d4b8-46a3-9f8d-899308da5ffb admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:37.041140 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c8ac46-d4b8-46a3-9f8d-899308da5ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:37.041497 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c8ac46-d4b8-46a3-9f8d-899308da5ffb admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:37.042144 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c8ac46-d4b8-46a3-9f8d-899308da5ffb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:37.044082 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c8ac46-d4b8-46a3-9f8d-899308da5ffb admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:37.046909 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c382a3-156d-4057-bd2d-1da6d5566ba1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:37.048586 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c382a3-156d-4057-bd2d-1da6d5566ba1 service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:37.071408 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1203/2385] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:30:36 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:30:37.072384 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c382a3-156d-4057-bd2d-1da6d5566ba1 service cinder] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:37.083543 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1183/2386] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:30:37 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 15:30:37.085007 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c8ac46-d4b8-46a3-9f8d-899308da5ffb admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:37.088566 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c382a3-156d-4057-bd2d-1da6d5566ba1 service cinder] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:37.095166 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b5f9f6-6a18-4043-bdec-db45b868541a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:37.096506 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b5f9f6-6a18-4043-bdec-db45b868541a admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:37.096804 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b5f9f6-6a18-4043-bdec-db45b868541a admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:37.097177 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b5f9f6-6a18-4043-bdec-db45b868541a admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:37.097784 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b5f9f6-6a18-4043-bdec-db45b868541a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:37.099747 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b5f9f6-6a18-4043-bdec-db45b868541a admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:37.101860 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c8ac46-d4b8-46a3-9f8d-899308da5ffb admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:37.108211 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42c4aac-fa6e-4fc7-afcd-213a6cb52c55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:37.108943 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42c4aac-fa6e-4fc7-afcd-213a6cb52c55 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:37.109735 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42c4aac-fa6e-4fc7-afcd-213a6cb52c55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:37.110044 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42c4aac-fa6e-4fc7-afcd-213a6cb52c55 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:37.110952 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42c4aac-fa6e-4fc7-afcd-213a6cb52c55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:37.113536 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42c4aac-fa6e-4fc7-afcd-213a6cb52c55 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:37.128739 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1184/2387] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:30:37 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 15:30:37.132796 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42c4aac-fa6e-4fc7-afcd-213a6cb52c55 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:37.144802 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1204/2388] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 13 15:30:37 2022] POST /identity/v3/projects => generated 369 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:30:37.145970 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42c4aac-fa6e-4fc7-afcd-213a6cb52c55 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:37.150626 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b5f9f6-6a18-4043-bdec-db45b868541a admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:37.211303 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:30:37.238197 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b5bfe5-cdf8-41ff-928b-d23b2d553555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:37.238992 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b5bfe5-cdf8-41ff-928b-d23b2d553555 admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:37.239401 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b5bfe5-cdf8-41ff-928b-d23b2d553555 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:37.239682 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b5bfe5-cdf8-41ff-928b-d23b2d553555 admin admin] PATH_INFO: `/v3/projects/e29705b1f11f40538db7a7f9a88a406b/users/b1c4b0faa3704f3b945be942292f409b/roles/3fae3d3a28e147d3b2bede2378ff79ae` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:37.243902 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:30:37.260464 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b5f9f6-6a18-4043-bdec-db45b868541a admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:37.270625 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93651f3-f241-4666-988c-66678ae6b2f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:37.271516 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93651f3-f241-4666-988c-66678ae6b2f4 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:37.273802 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93651f3-f241-4666-988c-66678ae6b2f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:37.274125 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93651f3-f241-4666-988c-66678ae6b2f4 admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:37.274868 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93651f3-f241-4666-988c-66678ae6b2f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:37.277539 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93651f3-f241-4666-988c-66678ae6b2f4 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:37.285650 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b5bfe5-cdf8-41ff-928b-d23b2d553555 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e29705b1f11f40538db7a7f9a88a406b, user_id=b1c4b0faa3704f3b945be942292f409b, role_id=3fae3d3a28e147d3b2bede2378ff79ae)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:37.293302 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b5bfe5-cdf8-41ff-928b-d23b2d553555 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:37.315709 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1205/2389] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 13 15:30:37 2022] POST /identity/v3/users => generated 285 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:30:37.321778 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93651f3-f241-4666-988c-66678ae6b2f4 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:37.329284 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1185/2390] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 13 15:30:37 2022] PUT /identity/v3/projects/e29705b1f11f40538db7a7f9a88a406b/users/b1c4b0faa3704f3b945be942292f409b/roles/3fae3d3a28e147d3b2bede2378ff79ae => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:30:37.334618 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93651f3-f241-4666-988c-66678ae6b2f4 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:37.341904 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e987f3c0-63fb-4e7c-8fda-9890279266b9 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:37.342270 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e987f3c0-63fb-4e7c-8fda-9890279266b9 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:37.342561 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e987f3c0-63fb-4e7c-8fda-9890279266b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:37.391459 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-e987f3c0-63fb-4e7c-8fda-9890279266b9 None None] MFA Rules not processed for user `b1c4b0faa3704f3b945be942292f409b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:30:37.394103 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-e987f3c0-63fb-4e7c-8fda-9890279266b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:37.449305 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e6ef09-c55c-4b25-9f60-4e7f5d46e4e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:37.453832 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e6ef09-c55c-4b25-9f60-4e7f5d46e4e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:37.454193 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e6ef09-c55c-4b25-9f60-4e7f5d46e4e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:37.454468 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e6ef09-c55c-4b25-9f60-4e7f5d46e4e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:37.458378 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e6ef09-c55c-4b25-9f60-4e7f5d46e4e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:37.461982 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e6ef09-c55c-4b25-9f60-4e7f5d46e4e1 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:37.486430 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1206/2391] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:30:37 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 15:30:37.491024 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e6ef09-c55c-4b25-9f60-4e7f5d46e4e1 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:37.507356 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e6ef09-c55c-4b25-9f60-4e7f5d46e4e1 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:37.516980 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382b8161-9aaa-49fc-9802-cb8306f90f35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:37.519524 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382b8161-9aaa-49fc-9802-cb8306f90f35 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:37.519902 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382b8161-9aaa-49fc-9802-cb8306f90f35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:37.520364 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382b8161-9aaa-49fc-9802-cb8306f90f35 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:37.521379 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382b8161-9aaa-49fc-9802-cb8306f90f35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:37.524003 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382b8161-9aaa-49fc-9802-cb8306f90f35 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:37.537518 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1207/2392] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:30:37 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 15:30:37.544226 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382b8161-9aaa-49fc-9802-cb8306f90f35 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:37.547459 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1186/2393] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:30:37 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 15:30:37.556867 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382b8161-9aaa-49fc-9802-cb8306f90f35 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:37.563286 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abe4c59-b395-422c-a425-dad9609a41ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:37.564313 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abe4c59-b395-422c-a425-dad9609a41ba admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:37.565369 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abe4c59-b395-422c-a425-dad9609a41ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:37.565760 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abe4c59-b395-422c-a425-dad9609a41ba admin admin] PATH_INFO: `/v3/projects/142f39a5605f445a97146e3e810d520e/users/74a7adf27152438eb13a729b8afec0e4/roles/3fae3d3a28e147d3b2bede2378ff79ae` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:37.565957 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e987f3c0-63fb-4e7c-8fda-9890279266b9 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:37.568419 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-e987f3c0-63fb-4e7c-8fda-9890279266b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:37.590351 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abe4c59-b395-422c-a425-dad9609a41ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=142f39a5605f445a97146e3e810d520e, user_id=74a7adf27152438eb13a729b8afec0e4, role_id=3fae3d3a28e147d3b2bede2378ff79ae)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:37.593497 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abe4c59-b395-422c-a425-dad9609a41ba admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:37.613382 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1208/2394] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 13 15:30:37 2022] PUT /identity/v3/projects/142f39a5605f445a97146e3e810d520e/users/74a7adf27152438eb13a729b8afec0e4/roles/3fae3d3a28e147d3b2bede2378ff79ae => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 15:30:37.627985 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ae4f4d-f22a-4778-af56-e04053219bc1 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:37.628753 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ae4f4d-f22a-4778-af56-e04053219bc1 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:37.630045 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ae4f4d-f22a-4778-af56-e04053219bc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:37.695942 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e987f3c0-63fb-4e7c-8fda-9890279266b9 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:37.700835 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-73ae4f4d-f22a-4778-af56-e04053219bc1 None None] MFA Rules not processed for user `74a7adf27152438eb13a729b8afec0e4`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:30:37.703676 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-73ae4f4d-f22a-4778-af56-e04053219bc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:37.786652 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa16bd2-fe57-4098-9307-77e08aefea7f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97acd23097d54bf7805c3cef60626ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:37.787426 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa16bd2-fe57-4098-9307-77e08aefea7f service cinder] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:37.787717 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa16bd2-fe57-4098-9307-77e08aefea7f service cinder] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:37.787986 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa16bd2-fe57-4098-9307-77e08aefea7f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:37.813011 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1209/2395] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:30:37 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:30:37.814458 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:30:37.827393 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ae4f4d-f22a-4778-af56-e04053219bc1 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:37.829133 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-73ae4f4d-f22a-4778-af56-e04053219bc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:37.866026 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa16bd2-fe57-4098-9307-77e08aefea7f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:37.868129 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa16bd2-fe57-4098-9307-77e08aefea7f service cinder] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:37.880700 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1187/2396] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:30:37 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:30:37.922806 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:30:37.955697 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3855b93a-b75c-44e2-a322-7c83bd77df5a None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:37.956753 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3855b93a-b75c-44e2-a322-7c83bd77df5a None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:37.957245 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3855b93a-b75c-44e2-a322-7c83bd77df5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:37.981198 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ae4f4d-f22a-4778-af56-e04053219bc1 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:37.981788 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-3855b93a-b75c-44e2-a322-7c83bd77df5a None None] MFA Rules not processed for user `168dd28a0e4546c5a1f65f6b58f7dace`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:30:37.983555 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-3855b93a-b75c-44e2-a322-7c83bd77df5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:37.987207 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e711542-4bc3-4df3-889f-194deb608ba6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef26a5203094c83b52f10b930dfc453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:37.987900 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e711542-4bc3-4df3-889f-194deb608ba6 service glance] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:37.988188 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e711542-4bc3-4df3-889f-194deb608ba6 service glance] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:37.988468 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e711542-4bc3-4df3-889f-194deb608ba6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:38.006118 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e711542-4bc3-4df3-889f-194deb608ba6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:38.007575 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e711542-4bc3-4df3-889f-194deb608ba6 service glance] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:38.020751 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1210/2397] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:30:37 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 15:30:38.021903 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e711542-4bc3-4df3-889f-194deb608ba6 service glance] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:38.037038 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e711542-4bc3-4df3-889f-194deb608ba6 service glance] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:38.040982 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9394ead-af1b-46b8-bcc0-ab90d57e2a91 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97acd23097d54bf7805c3cef60626ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:38.041688 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9394ead-af1b-46b8-bcc0-ab90d57e2a91 service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:38.042095 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9394ead-af1b-46b8-bcc0-ab90d57e2a91 service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:38.042938 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9394ead-af1b-46b8-bcc0-ab90d57e2a91 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:38.045478 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-b9394ead-af1b-46b8-bcc0-ab90d57e2a91 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:38.084541 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1188/2398] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:30:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:30:38.139715 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9394ead-af1b-46b8-bcc0-ab90d57e2a91 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:38.141562 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9394ead-af1b-46b8-bcc0-ab90d57e2a91 service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:38.152750 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1211/2399] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:30:38 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:30:42.544690 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3855b93a-b75c-44e2-a322-7c83bd77df5a None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:42.546160 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-3855b93a-b75c-44e2-a322-7c83bd77df5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:42.624532 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3855b93a-b75c-44e2-a322-7c83bd77df5a None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:42.629184 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb085917-7bb4-47d4-99eb-ea5c31f8e229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:42.629866 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb085917-7bb4-47d4-99eb-ea5c31f8e229 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:42.630152 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb085917-7bb4-47d4-99eb-ea5c31f8e229 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:42.630486 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb085917-7bb4-47d4-99eb-ea5c31f8e229 admin admin] PATH_INFO: `/v3/users/ddcd8e6a42ac441b99989a441fdceaf9` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:42.631737 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb085917-7bb4-47d4-99eb-ea5c31f8e229 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ddcd8e6a42ac441b99989a441fdceaf9)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:42.633706 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb085917-7bb4-47d4-99eb-ea5c31f8e229 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:42.682592 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-cb085917-7bb4-47d4-99eb-ea5c31f8e229 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ddcd8e6a42ac441b99989a441fdceaf9'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:42.683309 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-cb085917-7bb4-47d4-99eb-ea5c31f8e229 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ddcd8e6a42ac441b99989a441fdceaf9'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:42.684287 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-cb085917-7bb4-47d4-99eb-ea5c31f8e229 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ddcd8e6a42ac441b99989a441fdceaf9'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:42.692241 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-cb085917-7bb4-47d4-99eb-ea5c31f8e229 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ddcd8e6a42ac441b99989a441fdceaf9'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:42.707036 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:30:42.723759 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-cb085917-7bb4-47d4-99eb-ea5c31f8e229 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ddcd8e6a42ac441b99989a441fdceaf9'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:42.737945 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1189/2400] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 13 15:30:42 2022] DELETE /identity/v3/users/ddcd8e6a42ac441b99989a441fdceaf9 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:30:42.742425 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bc3fe5-0655-4bca-9091-8770109bea07 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:42.742884 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bc3fe5-0655-4bca-9091-8770109bea07 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:42.742964 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bc3fe5-0655-4bca-9091-8770109bea07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:42.766778 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-a8bc3fe5-0655-4bca-9091-8770109bea07 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:30:42.768710 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-a8bc3fe5-0655-4bca-9091-8770109bea07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:42.836875 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1212/2401] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:30:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:30:42.848791 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb085917-7bb4-47d4-99eb-ea5c31f8e229 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:42.850294 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-cb085917-7bb4-47d4-99eb-ea5c31f8e229 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:42.929503 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb085917-7bb4-47d4-99eb-ea5c31f8e229 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:42.933609 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dff6883-a3a4-4b07-ad8e-34de96ae80d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41675154bbba47388040966f75d84c3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:42.935054 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dff6883-a3a4-4b07-ad8e-34de96ae80d4 service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:42.935618 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dff6883-a3a4-4b07-ad8e-34de96ae80d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:42.936091 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dff6883-a3a4-4b07-ad8e-34de96ae80d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:42.948561 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dff6883-a3a4-4b07-ad8e-34de96ae80d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:42.950346 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dff6883-a3a4-4b07-ad8e-34de96ae80d4 service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:42.966169 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1190/2402] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:30:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:30:43.406295 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bc3fe5-0655-4bca-9091-8770109bea07 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:43.407814 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-a8bc3fe5-0655-4bca-9091-8770109bea07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:43.452480 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bc3fe5-0655-4bca-9091-8770109bea07 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:43.460677 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334fb013-fcee-42c0-addb-c173f91e103a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:43.461201 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334fb013-fcee-42c0-addb-c173f91e103a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:43.461488 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334fb013-fcee-42c0-addb-c173f91e103a admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:43.461874 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334fb013-fcee-42c0-addb-c173f91e103a admin admin] PATH_INFO: `/v3/projects/c12e7e52c14147a1b01b502c08acce81` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:43.463072 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334fb013-fcee-42c0-addb-c173f91e103a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c12e7e52c14147a1b01b502c08acce81)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:43.465343 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334fb013-fcee-42c0-addb-c173f91e103a admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:43.552992 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-334fb013-fcee-42c0-addb-c173f91e103a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c12e7e52c14147a1b01b502c08acce81', 'request_id': 'req-334fb013-fcee-42c0-addb-c173f91e103a'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:43.566844 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-334fb013-fcee-42c0-addb-c173f91e103a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c12e7e52c14147a1b01b502c08acce81', 'request_id': 'req-334fb013-fcee-42c0-addb-c173f91e103a'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:43.584212 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-334fb013-fcee-42c0-addb-c173f91e103a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c12e7e52c14147a1b01b502c08acce81', 'request_id': 'req-334fb013-fcee-42c0-addb-c173f91e103a'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:43.586978 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:30:43.620710 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-334fb013-fcee-42c0-addb-c173f91e103a admin admin] The token cache is being invalidate because project c12e7e52c14147a1b01b502c08acce81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 15:30:43.621058 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-334fb013-fcee-42c0-addb-c173f91e103a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:43.630465 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-334fb013-fcee-42c0-addb-c173f91e103a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:43.634293 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1213/2403] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 13 15:30:43 2022] DELETE /identity/v3/projects/c12e7e52c14147a1b01b502c08acce81 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:30:43.638843 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dff6883-a3a4-4b07-ad8e-34de96ae80d4 service neutron] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:43.651475 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dff6883-a3a4-4b07-ad8e-34de96ae80d4 service neutron] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:43.750913 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf448f9-e078-475e-8782-4668e44d8368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:43.752284 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf448f9-e078-475e-8782-4668e44d8368 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:43.752676 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf448f9-e078-475e-8782-4668e44d8368 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:43.753086 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf448f9-e078-475e-8782-4668e44d8368 admin admin] PATH_INFO: `/v3/users/aca9e3131660426b8ce8b84aa4da3e66` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:43.754848 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf448f9-e078-475e-8782-4668e44d8368 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aca9e3131660426b8ce8b84aa4da3e66)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:43.757177 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf448f9-e078-475e-8782-4668e44d8368 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:43.838330 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-9cf448f9-e078-475e-8782-4668e44d8368 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aca9e3131660426b8ce8b84aa4da3e66'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:43.839112 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-9cf448f9-e078-475e-8782-4668e44d8368 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aca9e3131660426b8ce8b84aa4da3e66'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:43.840341 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-9cf448f9-e078-475e-8782-4668e44d8368 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aca9e3131660426b8ce8b84aa4da3e66'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:43.850949 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-9cf448f9-e078-475e-8782-4668e44d8368 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aca9e3131660426b8ce8b84aa4da3e66'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:43.865973 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-9cf448f9-e078-475e-8782-4668e44d8368 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aca9e3131660426b8ce8b84aa4da3e66'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:43.885279 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1191/2404] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 13 15:30:43 2022] DELETE /identity/v3/users/aca9e3131660426b8ce8b84aa4da3e66 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:30:44.276307 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334fb013-fcee-42c0-addb-c173f91e103a admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:44.278025 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-334fb013-fcee-42c0-addb-c173f91e103a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:44.300292 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334fb013-fcee-42c0-addb-c173f91e103a admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:44.374054 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3a6d49-1656-42cf-b8d4-69985a96572b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:44.374601 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3a6d49-1656-42cf-b8d4-69985a96572b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:44.374956 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3a6d49-1656-42cf-b8d4-69985a96572b admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:44.375303 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3a6d49-1656-42cf-b8d4-69985a96572b admin admin] PATH_INFO: `/v3/projects/9d858b74882d43af883a4bd3d24ab6ab` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:44.377278 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3a6d49-1656-42cf-b8d4-69985a96572b admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d858b74882d43af883a4bd3d24ab6ab)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:44.379181 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3a6d49-1656-42cf-b8d4-69985a96572b admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:44.456159 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-4b3a6d49-1656-42cf-b8d4-69985a96572b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d858b74882d43af883a4bd3d24ab6ab', 'request_id': 'req-4b3a6d49-1656-42cf-b8d4-69985a96572b'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:44.463738 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-4b3a6d49-1656-42cf-b8d4-69985a96572b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d858b74882d43af883a4bd3d24ab6ab', 'request_id': 'req-4b3a6d49-1656-42cf-b8d4-69985a96572b'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:44.478048 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-4b3a6d49-1656-42cf-b8d4-69985a96572b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d858b74882d43af883a4bd3d24ab6ab', 'request_id': 'req-4b3a6d49-1656-42cf-b8d4-69985a96572b'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:44.498465 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-4b3a6d49-1656-42cf-b8d4-69985a96572b admin admin] The token cache is being invalidate because project 9d858b74882d43af883a4bd3d24ab6ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 15:30:44.498877 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-4b3a6d49-1656-42cf-b8d4-69985a96572b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:44.499536 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-4b3a6d49-1656-42cf-b8d4-69985a96572b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:44.501338 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1214/2405] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 13 15:30:44 2022] DELETE /identity/v3/projects/9d858b74882d43af883a4bd3d24ab6ab => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 15:30:44.505756 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf448f9-e078-475e-8782-4668e44d8368 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:44.507441 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-9cf448f9-e078-475e-8782-4668e44d8368 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:44.530283 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf448f9-e078-475e-8782-4668e44d8368 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:44.536249 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:30:44.614187 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0096ea18-3225-43e2-a7f2-8745f41b24ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:44.615003 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0096ea18-3225-43e2-a7f2-8745f41b24ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:44.615384 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0096ea18-3225-43e2-a7f2-8745f41b24ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:44.615764 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0096ea18-3225-43e2-a7f2-8745f41b24ad admin admin] PATH_INFO: `/v3/users/c6a927c05d3d404ea0fc54f554336cf0` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:44.617037 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0096ea18-3225-43e2-a7f2-8745f41b24ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6a927c05d3d404ea0fc54f554336cf0)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:44.619256 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0096ea18-3225-43e2-a7f2-8745f41b24ad admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:44.696586 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-0096ea18-3225-43e2-a7f2-8745f41b24ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6a927c05d3d404ea0fc54f554336cf0'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:44.698196 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-0096ea18-3225-43e2-a7f2-8745f41b24ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6a927c05d3d404ea0fc54f554336cf0'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:44.699316 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-0096ea18-3225-43e2-a7f2-8745f41b24ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6a927c05d3d404ea0fc54f554336cf0'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:44.714701 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-0096ea18-3225-43e2-a7f2-8745f41b24ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6a927c05d3d404ea0fc54f554336cf0'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:44.738674 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-0096ea18-3225-43e2-a7f2-8745f41b24ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6a927c05d3d404ea0fc54f554336cf0'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:44.752879 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1192/2406] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 13 15:30:44 2022] DELETE /identity/v3/users/c6a927c05d3d404ea0fc54f554336cf0 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:30:45.426609 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3a6d49-1656-42cf-b8d4-69985a96572b admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:45.428450 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-4b3a6d49-1656-42cf-b8d4-69985a96572b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:45.454486 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3a6d49-1656-42cf-b8d4-69985a96572b admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:45.607807 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22e65e2-c7e6-444f-92af-d93e9e827d3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:45.608529 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22e65e2-c7e6-444f-92af-d93e9e827d3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:45.608893 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22e65e2-c7e6-444f-92af-d93e9e827d3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:45.609247 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22e65e2-c7e6-444f-92af-d93e9e827d3a admin admin] PATH_INFO: `/v3/projects/2a1db6345a4d40e5800eafa990d33fc0` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:45.611744 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22e65e2-c7e6-444f-92af-d93e9e827d3a admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a1db6345a4d40e5800eafa990d33fc0)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:45.625491 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22e65e2-c7e6-444f-92af-d93e9e827d3a admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:45.683490 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:30:45.719825 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-a22e65e2-c7e6-444f-92af-d93e9e827d3a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a1db6345a4d40e5800eafa990d33fc0', 'request_id': 'req-a22e65e2-c7e6-444f-92af-d93e9e827d3a'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:45.727434 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-a22e65e2-c7e6-444f-92af-d93e9e827d3a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a1db6345a4d40e5800eafa990d33fc0', 'request_id': 'req-a22e65e2-c7e6-444f-92af-d93e9e827d3a'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:45.737804 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-a22e65e2-c7e6-444f-92af-d93e9e827d3a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a1db6345a4d40e5800eafa990d33fc0', 'request_id': 'req-a22e65e2-c7e6-444f-92af-d93e9e827d3a'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:45.753951 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-a22e65e2-c7e6-444f-92af-d93e9e827d3a admin admin] The token cache is being invalidate because project 2a1db6345a4d40e5800eafa990d33fc0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 15:30:45.754389 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-a22e65e2-c7e6-444f-92af-d93e9e827d3a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:45.755158 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-a22e65e2-c7e6-444f-92af-d93e9e827d3a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:45.757195 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1215/2407] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 13 15:30:45 2022] DELETE /identity/v3/projects/2a1db6345a4d40e5800eafa990d33fc0 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:30:45.762669 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bb359a-77dc-4374-9f25-451794d7e04f None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:45.763173 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bb359a-77dc-4374-9f25-451794d7e04f None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:45.763263 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bb359a-77dc-4374-9f25-451794d7e04f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:45.789039 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-40bb359a-77dc-4374-9f25-451794d7e04f None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:30:45.790357 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-40bb359a-77dc-4374-9f25-451794d7e04f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:45.889496 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1193/2408] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:30:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:30:45.897655 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca38d64-4b4f-448e-893a-7fbfc138b5fb None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:45.898384 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca38d64-4b4f-448e-893a-7fbfc138b5fb None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:45.899216 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca38d64-4b4f-448e-893a-7fbfc138b5fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:45.929850 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-eca38d64-4b4f-448e-893a-7fbfc138b5fb None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:30:45.931284 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-eca38d64-4b4f-448e-893a-7fbfc138b5fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:45.956237 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1216/2409] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:30:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:30:45.960234 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bb359a-77dc-4374-9f25-451794d7e04f None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:45.976320 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bb359a-77dc-4374-9f25-451794d7e04f None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:45.984087 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f9f469-7d98-486d-adaf-1cd61bf3377e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:45.984087 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f9f469-7d98-486d-adaf-1cd61bf3377e admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:45.984087 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f9f469-7d98-486d-adaf-1cd61bf3377e admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:45.984087 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f9f469-7d98-486d-adaf-1cd61bf3377e admin admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:45.985193 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f9f469-7d98-486d-adaf-1cd61bf3377e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:30:45.985688 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f9f469-7d98-486d-adaf-1cd61bf3377e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:45.988046 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f9f469-7d98-486d-adaf-1cd61bf3377e admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:46.005247 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1194/2410] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Sep 13 15:30:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:30:46.006750 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca38d64-4b4f-448e-893a-7fbfc138b5fb None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:46.017857 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca38d64-4b4f-448e-893a-7fbfc138b5fb None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:46.026458 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7c55c5-03d0-45a2-959b-7ccd0b29d6e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:46.027179 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7c55c5-03d0-45a2-959b-7ccd0b29d6e8 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:46.027500 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7c55c5-03d0-45a2-959b-7ccd0b29d6e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:46.027881 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7c55c5-03d0-45a2-959b-7ccd0b29d6e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:46.028607 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7c55c5-03d0-45a2-959b-7ccd0b29d6e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:46.030670 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7c55c5-03d0-45a2-959b-7ccd0b29d6e8 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:46.073671 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1217/2411] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 13 15:30:46 2022] POST /identity/v3/projects => generated 385 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:30:46.083440 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f9f469-7d98-486d-adaf-1cd61bf3377e admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:46.093694 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f9f469-7d98-486d-adaf-1cd61bf3377e admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:46.108997 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:30:46.162322 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb00c37-38a8-4316-8715-b9de2c2ac61c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:46.163122 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb00c37-38a8-4316-8715-b9de2c2ac61c admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:46.163405 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb00c37-38a8-4316-8715-b9de2c2ac61c admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:46.163678 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb00c37-38a8-4316-8715-b9de2c2ac61c admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:46.164312 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb00c37-38a8-4316-8715-b9de2c2ac61c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:46.166418 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb00c37-38a8-4316-8715-b9de2c2ac61c admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:46.194481 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1195/2412] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 13 15:30:46 2022] POST /identity/v3/users => generated 293 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:30:46.195694 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7c55c5-03d0-45a2-959b-7ccd0b29d6e8 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:46.209826 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7c55c5-03d0-45a2-959b-7ccd0b29d6e8 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:46.214420 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa03929-8821-4443-ad83-78d3826df2a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:46.215045 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa03929-8821-4443-ad83-78d3826df2a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:46.215322 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa03929-8821-4443-ad83-78d3826df2a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:46.215633 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa03929-8821-4443-ad83-78d3826df2a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:46.216236 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa03929-8821-4443-ad83-78d3826df2a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:46.217897 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa03929-8821-4443-ad83-78d3826df2a6 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:46.228701 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1218/2413] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:30:46 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 15:30:46.232896 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb00c37-38a8-4316-8715-b9de2c2ac61c admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:46.245927 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb00c37-38a8-4316-8715-b9de2c2ac61c admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:46.251011 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd66623d-7806-48e2-b9e6-58fce36ee3af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:46.252326 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd66623d-7806-48e2-b9e6-58fce36ee3af admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:46.252794 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd66623d-7806-48e2-b9e6-58fce36ee3af admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:46.252923 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd66623d-7806-48e2-b9e6-58fce36ee3af admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:46.253549 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd66623d-7806-48e2-b9e6-58fce36ee3af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:46.255357 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd66623d-7806-48e2-b9e6-58fce36ee3af admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:46.269730 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1196/2414] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:30:46 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 15:30:46.273928 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa03929-8821-4443-ad83-78d3826df2a6 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:46.285577 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa03929-8821-4443-ad83-78d3826df2a6 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:46.290505 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6071b3-92c1-45dd-806f-52c8c3281fc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:46.291121 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6071b3-92c1-45dd-806f-52c8c3281fc0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:46.291410 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6071b3-92c1-45dd-806f-52c8c3281fc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:46.291686 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6071b3-92c1-45dd-806f-52c8c3281fc0 admin admin] PATH_INFO: `/v3/projects/e41c346cfcd54bb497a83b2a30e5bb98/users/49b9da189f8249a5bfbcbd8b28187f86/roles/3fae3d3a28e147d3b2bede2378ff79ae` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:46.308487 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6071b3-92c1-45dd-806f-52c8c3281fc0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e41c346cfcd54bb497a83b2a30e5bb98, user_id=49b9da189f8249a5bfbcbd8b28187f86, role_id=3fae3d3a28e147d3b2bede2378ff79ae)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:46.311264 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6071b3-92c1-45dd-806f-52c8c3281fc0 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:46.325890 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1219/2415] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 13 15:30:46 2022] PUT /identity/v3/projects/e41c346cfcd54bb497a83b2a30e5bb98/users/49b9da189f8249a5bfbcbd8b28187f86/roles/3fae3d3a28e147d3b2bede2378ff79ae => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:30:46.337427 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0512107-cd1c-4a1c-92a3-4c0fddb8fc54 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:46.337747 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0512107-cd1c-4a1c-92a3-4c0fddb8fc54 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:46.338029 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0512107-cd1c-4a1c-92a3-4c0fddb8fc54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:46.366600 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-e0512107-cd1c-4a1c-92a3-4c0fddb8fc54 None None] MFA Rules not processed for user `49b9da189f8249a5bfbcbd8b28187f86`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:30:46.367884 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-e0512107-cd1c-4a1c-92a3-4c0fddb8fc54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:46.444715 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1197/2416] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:30:46 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:30:46.457448 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6071b3-92c1-45dd-806f-52c8c3281fc0 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:46.459333 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-4c6071b3-92c1-45dd-806f-52c8c3281fc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:46.521087 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6071b3-92c1-45dd-806f-52c8c3281fc0 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:46.524790 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5f58e7-11f1-482d-9965-bc9576d0c750 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97acd23097d54bf7805c3cef60626ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:46.525408 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5f58e7-11f1-482d-9965-bc9576d0c750 service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:46.525693 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5f58e7-11f1-482d-9965-bc9576d0c750 service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:46.525985 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5f58e7-11f1-482d-9965-bc9576d0c750 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:46.536189 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5f58e7-11f1-482d-9965-bc9576d0c750 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:46.537694 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5f58e7-11f1-482d-9965-bc9576d0c750 service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:46.552172 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1220/2417] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:30:46 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:30:47.106133 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0512107-cd1c-4a1c-92a3-4c0fddb8fc54 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:47.108442 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-e0512107-cd1c-4a1c-92a3-4c0fddb8fc54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:47.193889 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0512107-cd1c-4a1c-92a3-4c0fddb8fc54 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:47.193889 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e4379f-fe4b-41d6-9625-12a288c1612b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:47.193889 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e4379f-fe4b-41d6-9625-12a288c1612b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:47.193889 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e4379f-fe4b-41d6-9625-12a288c1612b admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:47.197923 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e4379f-fe4b-41d6-9625-12a288c1612b admin admin] PATH_INFO: `/v3/users/51eb48bdb3d747dd9d59bc1286311675` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:47.197923 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e4379f-fe4b-41d6-9625-12a288c1612b admin admin] RBAC: Authorizing `identity:delete_user(user_id=51eb48bdb3d747dd9d59bc1286311675)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:47.197923 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e4379f-fe4b-41d6-9625-12a288c1612b admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:47.235074 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:30:47.268954 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-a1e4379f-fe4b-41d6-9625-12a288c1612b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51eb48bdb3d747dd9d59bc1286311675'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:47.269950 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-a1e4379f-fe4b-41d6-9625-12a288c1612b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51eb48bdb3d747dd9d59bc1286311675'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:47.270630 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-a1e4379f-fe4b-41d6-9625-12a288c1612b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51eb48bdb3d747dd9d59bc1286311675'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:47.278720 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-a1e4379f-fe4b-41d6-9625-12a288c1612b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51eb48bdb3d747dd9d59bc1286311675'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:47.297669 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-a1e4379f-fe4b-41d6-9625-12a288c1612b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51eb48bdb3d747dd9d59bc1286311675'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:47.343636 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1198/2418] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 13 15:30:47 2022] DELETE /identity/v3/users/51eb48bdb3d747dd9d59bc1286311675 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:30:47.349005 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb286c3-3262-4657-a5e0-5133547dae1d None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:47.349375 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb286c3-3262-4657-a5e0-5133547dae1d None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:47.349665 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb286c3-3262-4657-a5e0-5133547dae1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:47.372410 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-6bb286c3-3262-4657-a5e0-5133547dae1d None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:30:47.374228 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-6bb286c3-3262-4657-a5e0-5133547dae1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:47.451421 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=91,keystone:DELETE=6,keystone:INSERT=3 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:30:47.483694 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1221/2419] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:30:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:30:47.493908 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e4379f-fe4b-41d6-9625-12a288c1612b admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:47.495432 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-a1e4379f-fe4b-41d6-9625-12a288c1612b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:47.566084 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e4379f-fe4b-41d6-9625-12a288c1612b admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:47.569891 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983330f9-ffea-41e3-913f-5a2055de12ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41675154bbba47388040966f75d84c3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:47.570522 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983330f9-ffea-41e3-913f-5a2055de12ed service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:47.570802 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983330f9-ffea-41e3-913f-5a2055de12ed service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:47.571074 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983330f9-ffea-41e3-913f-5a2055de12ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:47.581236 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983330f9-ffea-41e3-913f-5a2055de12ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:47.582752 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983330f9-ffea-41e3-913f-5a2055de12ed service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:47.593273 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1199/2420] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:30:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:30:47.901353 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb286c3-3262-4657-a5e0-5133547dae1d None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:47.903099 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-6bb286c3-3262-4657-a5e0-5133547dae1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:47.924791 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb286c3-3262-4657-a5e0-5133547dae1d None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:47.929858 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbe7018-691a-49f3-a523-94f2e3053cb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:47.930521 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbe7018-691a-49f3-a523-94f2e3053cb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:47.930807 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbe7018-691a-49f3-a523-94f2e3053cb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:47.931087 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbe7018-691a-49f3-a523-94f2e3053cb3 admin admin] PATH_INFO: `/v3/projects/3d7db1894b53440993d0ba99a0a8107d` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:47.932287 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbe7018-691a-49f3-a523-94f2e3053cb3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d7db1894b53440993d0ba99a0a8107d)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:47.934331 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbe7018-691a-49f3-a523-94f2e3053cb3 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:47.991795 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-5fbe7018-691a-49f3-a523-94f2e3053cb3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d7db1894b53440993d0ba99a0a8107d', 'request_id': 'req-5fbe7018-691a-49f3-a523-94f2e3053cb3'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:47.998396 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-5fbe7018-691a-49f3-a523-94f2e3053cb3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d7db1894b53440993d0ba99a0a8107d', 'request_id': 'req-5fbe7018-691a-49f3-a523-94f2e3053cb3'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:48.006903 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-5fbe7018-691a-49f3-a523-94f2e3053cb3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d7db1894b53440993d0ba99a0a8107d', 'request_id': 'req-5fbe7018-691a-49f3-a523-94f2e3053cb3'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:48.019999 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-5fbe7018-691a-49f3-a523-94f2e3053cb3 admin admin] The token cache is being invalidate because project 3d7db1894b53440993d0ba99a0a8107d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 15:30:48.020319 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-5fbe7018-691a-49f3-a523-94f2e3053cb3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:48.020962 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-5fbe7018-691a-49f3-a523-94f2e3053cb3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:48.022877 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1222/2421] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 13 15:30:47 2022] DELETE /identity/v3/projects/3d7db1894b53440993d0ba99a0a8107d => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:30:48.028042 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aa8fa2-589a-45c0-9bbd-90bb489c8bf5 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:48.028364 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aa8fa2-589a-45c0-9bbd-90bb489c8bf5 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:48.028709 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aa8fa2-589a-45c0-9bbd-90bb489c8bf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:48.078034 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-48aa8fa2-589a-45c0-9bbd-90bb489c8bf5 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:30:48.079388 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-48aa8fa2-589a-45c0-9bbd-90bb489c8bf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:48.172392 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1200/2422] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:30:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:30:48.182032 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c56258-d30b-4136-ac2e-6110a37b219f None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:48.182547 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c56258-d30b-4136-ac2e-6110a37b219f None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:48.183086 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c56258-d30b-4136-ac2e-6110a37b219f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:48.208107 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-42c56258-d30b-4136-ac2e-6110a37b219f None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:30:48.209679 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-42c56258-d30b-4136-ac2e-6110a37b219f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:48.219552 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1223/2423] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:30:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:30:48.224351 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48aa8fa2-589a-45c0-9bbd-90bb489c8bf5 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:48.241252 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48aa8fa2-589a-45c0-9bbd-90bb489c8bf5 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:48.248541 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9272d1b0-ca85-45f5-b8f0-df17f1d13eb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:48.249218 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9272d1b0-ca85-45f5-b8f0-df17f1d13eb7 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:48.249653 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9272d1b0-ca85-45f5-b8f0-df17f1d13eb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:48.250085 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9272d1b0-ca85-45f5-b8f0-df17f1d13eb7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:48.254936 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9272d1b0-ca85-45f5-b8f0-df17f1d13eb7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:30:48.255322 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9272d1b0-ca85-45f5-b8f0-df17f1d13eb7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:48.257013 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9272d1b0-ca85-45f5-b8f0-df17f1d13eb7 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:48.273427 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1201/2424] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Sep 13 15:30:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 15:30:48.277863 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c56258-d30b-4136-ac2e-6110a37b219f None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:48.290063 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c56258-d30b-4136-ac2e-6110a37b219f None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:48.295114 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8d4b09-d2f5-4166-938d-fee11d2aa53f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:48.295735 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8d4b09-d2f5-4166-938d-fee11d2aa53f admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:48.296014 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8d4b09-d2f5-4166-938d-fee11d2aa53f admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:48.296288 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8d4b09-d2f5-4166-938d-fee11d2aa53f admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:48.297125 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8d4b09-d2f5-4166-938d-fee11d2aa53f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:48.299572 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8d4b09-d2f5-4166-938d-fee11d2aa53f admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:48.332530 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1224/2425] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 13 15:30:48 2022] POST /identity/v3/projects => generated 375 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:30:48.336395 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9272d1b0-ca85-45f5-b8f0-df17f1d13eb7 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:48.358541 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9272d1b0-ca85-45f5-b8f0-df17f1d13eb7 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:48.392556 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:30:48.427107 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dc9bc0-27b2-450c-8063-348ac27a6e08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:48.427721 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dc9bc0-27b2-450c-8063-348ac27a6e08 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:48.428002 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dc9bc0-27b2-450c-8063-348ac27a6e08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:48.428319 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dc9bc0-27b2-450c-8063-348ac27a6e08 admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:48.428941 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dc9bc0-27b2-450c-8063-348ac27a6e08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:48.430877 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dc9bc0-27b2-450c-8063-348ac27a6e08 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:48.460740 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1202/2426] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 13 15:30:48 2022] POST /identity/v3/users => generated 288 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:30:48.461962 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8d4b09-d2f5-4166-938d-fee11d2aa53f admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:48.477419 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8d4b09-d2f5-4166-938d-fee11d2aa53f admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:48.482913 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a20b027-dc7b-4d81-98fe-84377a42f10a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:48.483542 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a20b027-dc7b-4d81-98fe-84377a42f10a admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:48.483826 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a20b027-dc7b-4d81-98fe-84377a42f10a admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:48.484361 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a20b027-dc7b-4d81-98fe-84377a42f10a admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:48.484744 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a20b027-dc7b-4d81-98fe-84377a42f10a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:48.486963 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a20b027-dc7b-4d81-98fe-84377a42f10a admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:48.498214 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1225/2427] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:30:48 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 15:30:48.501660 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dc9bc0-27b2-450c-8063-348ac27a6e08 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:48.513462 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dc9bc0-27b2-450c-8063-348ac27a6e08 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:48.518928 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0368ed5e-d89e-4990-9315-16f2dfbd074d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:48.519533 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0368ed5e-d89e-4990-9315-16f2dfbd074d admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:48.519815 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0368ed5e-d89e-4990-9315-16f2dfbd074d admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:48.520088 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0368ed5e-d89e-4990-9315-16f2dfbd074d admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:48.520764 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0368ed5e-d89e-4990-9315-16f2dfbd074d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:48.522388 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0368ed5e-d89e-4990-9315-16f2dfbd074d admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:48.532401 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1203/2428] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:30:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 15:30:48.537586 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a20b027-dc7b-4d81-98fe-84377a42f10a admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:48.548054 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a20b027-dc7b-4d81-98fe-84377a42f10a admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:48.553448 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca30b7c4-fdf7-4bb8-a1df-b08ac8540890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:48.554151 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca30b7c4-fdf7-4bb8-a1df-b08ac8540890 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:48.554599 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca30b7c4-fdf7-4bb8-a1df-b08ac8540890 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:48.554890 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca30b7c4-fdf7-4bb8-a1df-b08ac8540890 admin admin] PATH_INFO: `/v3/projects/1ca4970161964ea69056f67522292b8e/users/c7dd85f9b44a4ce8a498dec34508f9d6/roles/3fae3d3a28e147d3b2bede2378ff79ae` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:48.571512 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca30b7c4-fdf7-4bb8-a1df-b08ac8540890 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ca4970161964ea69056f67522292b8e, user_id=c7dd85f9b44a4ce8a498dec34508f9d6, role_id=3fae3d3a28e147d3b2bede2378ff79ae)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:48.574535 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca30b7c4-fdf7-4bb8-a1df-b08ac8540890 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:48.596934 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1226/2429] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 13 15:30:48 2022] PUT /identity/v3/projects/1ca4970161964ea69056f67522292b8e/users/c7dd85f9b44a4ce8a498dec34508f9d6/roles/3fae3d3a28e147d3b2bede2378ff79ae => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:30:48.607451 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6c8bd9-4e6a-49e0-95bf-fb56bfe5ac6a None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:48.607757 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6c8bd9-4e6a-49e0-95bf-fb56bfe5ac6a None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:48.608018 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6c8bd9-4e6a-49e0-95bf-fb56bfe5ac6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:48.638887 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-9d6c8bd9-4e6a-49e0-95bf-fb56bfe5ac6a None None] MFA Rules not processed for user `c7dd85f9b44a4ce8a498dec34508f9d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:30:48.640375 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-9d6c8bd9-4e6a-49e0-95bf-fb56bfe5ac6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:48.718626 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1204/2430] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:30:48 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:30:48.732213 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca30b7c4-fdf7-4bb8-a1df-b08ac8540890 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:48.733988 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-ca30b7c4-fdf7-4bb8-a1df-b08ac8540890 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:48.807832 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca30b7c4-fdf7-4bb8-a1df-b08ac8540890 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:48.811545 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acc12c5-9118-4dd0-bdaa-458cbf248b2e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97acd23097d54bf7805c3cef60626ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:48.812179 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acc12c5-9118-4dd0-bdaa-458cbf248b2e service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:48.812466 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acc12c5-9118-4dd0-bdaa-458cbf248b2e service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:48.812748 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acc12c5-9118-4dd0-bdaa-458cbf248b2e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:48.821419 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acc12c5-9118-4dd0-bdaa-458cbf248b2e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:48.822906 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acc12c5-9118-4dd0-bdaa-458cbf248b2e service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:48.832838 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1227/2431] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:30:48 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:30:49.220829 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6c8bd9-4e6a-49e0-95bf-fb56bfe5ac6a None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:49.222500 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-9d6c8bd9-4e6a-49e0-95bf-fb56bfe5ac6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:49.288819 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6c8bd9-4e6a-49e0-95bf-fb56bfe5ac6a None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:49.293337 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a6d38e-2120-4bba-affd-0c8bec4f4e52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:49.294015 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a6d38e-2120-4bba-affd-0c8bec4f4e52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:49.294303 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a6d38e-2120-4bba-affd-0c8bec4f4e52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:49.294582 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a6d38e-2120-4bba-affd-0c8bec4f4e52 admin admin] PATH_INFO: `/v3/users/49b9da189f8249a5bfbcbd8b28187f86` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:49.295708 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a6d38e-2120-4bba-affd-0c8bec4f4e52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=49b9da189f8249a5bfbcbd8b28187f86)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:49.297661 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a6d38e-2120-4bba-affd-0c8bec4f4e52 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:49.344033 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:30:49.347805 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-12a6d38e-2120-4bba-affd-0c8bec4f4e52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49b9da189f8249a5bfbcbd8b28187f86'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:49.348975 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-12a6d38e-2120-4bba-affd-0c8bec4f4e52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49b9da189f8249a5bfbcbd8b28187f86'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:49.350056 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-12a6d38e-2120-4bba-affd-0c8bec4f4e52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49b9da189f8249a5bfbcbd8b28187f86'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:49.360292 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-12a6d38e-2120-4bba-affd-0c8bec4f4e52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49b9da189f8249a5bfbcbd8b28187f86'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:49.375953 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-12a6d38e-2120-4bba-affd-0c8bec4f4e52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49b9da189f8249a5bfbcbd8b28187f86'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:49.393016 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1205/2432] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 13 15:30:49 2022] DELETE /identity/v3/users/49b9da189f8249a5bfbcbd8b28187f86 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:30:49.397674 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2318294c-96a8-4408-8c1f-fcf1aa39dde6 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:49.399608 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2318294c-96a8-4408-8c1f-fcf1aa39dde6 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:49.402394 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2318294c-96a8-4408-8c1f-fcf1aa39dde6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:49.422983 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-2318294c-96a8-4408-8c1f-fcf1aa39dde6 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:30:49.424824 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-2318294c-96a8-4408-8c1f-fcf1aa39dde6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:49.433325 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:30:49.498293 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1228/2433] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:30:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:30:49.510235 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a6d38e-2120-4bba-affd-0c8bec4f4e52 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:49.511697 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-12a6d38e-2120-4bba-affd-0c8bec4f4e52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:49.578636 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a6d38e-2120-4bba-affd-0c8bec4f4e52 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:49.582554 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc6b41d-ac47-4180-b715-ec44010c2303 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41675154bbba47388040966f75d84c3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:49.583264 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc6b41d-ac47-4180-b715-ec44010c2303 service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:49.583557 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc6b41d-ac47-4180-b715-ec44010c2303 service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:49.583831 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc6b41d-ac47-4180-b715-ec44010c2303 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:49.594381 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc6b41d-ac47-4180-b715-ec44010c2303 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:49.596898 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc6b41d-ac47-4180-b715-ec44010c2303 service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:49.611963 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1206/2434] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:30:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:30:49.739530 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2318294c-96a8-4408-8c1f-fcf1aa39dde6 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:49.741229 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-2318294c-96a8-4408-8c1f-fcf1aa39dde6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:49.756543 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2318294c-96a8-4408-8c1f-fcf1aa39dde6 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:49.761336 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828bea60-85ab-4c0b-9071-c861982cb32c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:49.762206 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828bea60-85ab-4c0b-9071-c861982cb32c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:49.762661 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828bea60-85ab-4c0b-9071-c861982cb32c admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:49.763094 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828bea60-85ab-4c0b-9071-c861982cb32c admin admin] PATH_INFO: `/v3/users/b1c4b0faa3704f3b945be942292f409b` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:49.764408 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828bea60-85ab-4c0b-9071-c861982cb32c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1c4b0faa3704f3b945be942292f409b)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:49.766702 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828bea60-85ab-4c0b-9071-c861982cb32c admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:49.838902 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-828bea60-85ab-4c0b-9071-c861982cb32c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1c4b0faa3704f3b945be942292f409b'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:49.840173 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-828bea60-85ab-4c0b-9071-c861982cb32c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1c4b0faa3704f3b945be942292f409b'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:49.841078 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-828bea60-85ab-4c0b-9071-c861982cb32c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1c4b0faa3704f3b945be942292f409b'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:49.858358 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-828bea60-85ab-4c0b-9071-c861982cb32c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1c4b0faa3704f3b945be942292f409b'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:49.882340 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-828bea60-85ab-4c0b-9071-c861982cb32c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1c4b0faa3704f3b945be942292f409b'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:49.903851 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1229/2435] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 13 15:30:49 2022] DELETE /identity/v3/users/b1c4b0faa3704f3b945be942292f409b => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:30:49.905575 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e72a53-6939-460e-a4b3-7b5f9accb351 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:49.905955 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e72a53-6939-460e-a4b3-7b5f9accb351 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:49.906239 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e72a53-6939-460e-a4b3-7b5f9accb351 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:49.932626 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-73e72a53-6939-460e-a4b3-7b5f9accb351 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:30:49.934822 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-73e72a53-6939-460e-a4b3-7b5f9accb351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:50.029171 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828bea60-85ab-4c0b-9071-c861982cb32c admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:50.031099 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-828bea60-85ab-4c0b-9071-c861982cb32c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:50.040808 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1207/2436] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:30:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:30:50.053910 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828bea60-85ab-4c0b-9071-c861982cb32c admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:50.060908 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f658a2cf-bf30-47ce-8aa6-e9c1b229c614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:50.061444 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f658a2cf-bf30-47ce-8aa6-e9c1b229c614 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:50.061844 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f658a2cf-bf30-47ce-8aa6-e9c1b229c614 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:50.062166 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f658a2cf-bf30-47ce-8aa6-e9c1b229c614 admin admin] PATH_INFO: `/v3/projects/e41c346cfcd54bb497a83b2a30e5bb98` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:50.063270 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f658a2cf-bf30-47ce-8aa6-e9c1b229c614 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e41c346cfcd54bb497a83b2a30e5bb98)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:50.064655 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e72a53-6939-460e-a4b3-7b5f9accb351 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:50.065961 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f658a2cf-bf30-47ce-8aa6-e9c1b229c614 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:50.066320 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-73e72a53-6939-460e-a4b3-7b5f9accb351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:50.135937 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-f658a2cf-bf30-47ce-8aa6-e9c1b229c614 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e41c346cfcd54bb497a83b2a30e5bb98', 'request_id': 'req-f658a2cf-bf30-47ce-8aa6-e9c1b229c614'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:50.143718 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-f658a2cf-bf30-47ce-8aa6-e9c1b229c614 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e41c346cfcd54bb497a83b2a30e5bb98', 'request_id': 'req-f658a2cf-bf30-47ce-8aa6-e9c1b229c614'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:50.156762 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-f658a2cf-bf30-47ce-8aa6-e9c1b229c614 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e41c346cfcd54bb497a83b2a30e5bb98', 'request_id': 'req-f658a2cf-bf30-47ce-8aa6-e9c1b229c614'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:50.172613 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-f658a2cf-bf30-47ce-8aa6-e9c1b229c614 admin admin] The token cache is being invalidate because project e41c346cfcd54bb497a83b2a30e5bb98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 15:30:50.172939 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-f658a2cf-bf30-47ce-8aa6-e9c1b229c614 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:50.174060 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e72a53-6939-460e-a4b3-7b5f9accb351 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:50.174551 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-f658a2cf-bf30-47ce-8aa6-e9c1b229c614 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:50.176224 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1230/2437] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 13 15:30:50 2022] DELETE /identity/v3/projects/e41c346cfcd54bb497a83b2a30e5bb98 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 15:30:50.181685 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2826a96a-5ddc-4b3e-b9aa-54972cbb6d09 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:50.182006 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2826a96a-5ddc-4b3e-b9aa-54972cbb6d09 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:50.182288 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2826a96a-5ddc-4b3e-b9aa-54972cbb6d09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:50.194910 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:30:50.214389 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-2826a96a-5ddc-4b3e-b9aa-54972cbb6d09 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:30:50.216359 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-2826a96a-5ddc-4b3e-b9aa-54972cbb6d09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:50.221626 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:30:50.239866 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572b86f3-81cc-4537-98b3-61d2b81831cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41675154bbba47388040966f75d84c3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:50.240495 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572b86f3-81cc-4537-98b3-61d2b81831cd service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:50.240783 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572b86f3-81cc-4537-98b3-61d2b81831cd service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:50.241063 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572b86f3-81cc-4537-98b3-61d2b81831cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:50.243046 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-572b86f3-81cc-4537-98b3-61d2b81831cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:50.322626 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1231/2438] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:30:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 15:30:50.324056 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbb1e04-be5d-4679-9f8b-ff61951704d1 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:50.324406 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbb1e04-be5d-4679-9f8b-ff61951704d1 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:50.324747 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbb1e04-be5d-4679-9f8b-ff61951704d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:50.345766 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-5bbb1e04-be5d-4679-9f8b-ff61951704d1 None None] MFA Rules not processed for user `c7dd85f9b44a4ce8a498dec34508f9d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:30:50.350561 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-5bbb1e04-be5d-4679-9f8b-ff61951704d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:50.360287 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572b86f3-81cc-4537-98b3-61d2b81831cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:50.361942 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572b86f3-81cc-4537-98b3-61d2b81831cd service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:50.374956 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1208/2439] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:30:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:30:50.380692 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c875c7-36a8-4797-824a-f0e07549e94b None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:50.381781 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c875c7-36a8-4797-824a-f0e07549e94b None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:50.382291 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c875c7-36a8-4797-824a-f0e07549e94b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:50.414034 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-c0c875c7-36a8-4797-824a-f0e07549e94b None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:30:50.415762 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-c0c875c7-36a8-4797-824a-f0e07549e94b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:50.421677 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1232/2440] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:30:50 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:30:50.431254 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1209/2441] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:30:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:30:50.435775 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbb1e04-be5d-4679-9f8b-ff61951704d1 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:50.449775 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbb1e04-be5d-4679-9f8b-ff61951704d1 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:50.456398 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a172f21-de27-4134-88eb-ffe225082070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:50.457019 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a172f21-de27-4134-88eb-ffe225082070 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:50.457304 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a172f21-de27-4134-88eb-ffe225082070 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:50.457636 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a172f21-de27-4134-88eb-ffe225082070 admin admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:50.458497 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a172f21-de27-4134-88eb-ffe225082070 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:30:50.458816 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a172f21-de27-4134-88eb-ffe225082070 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:50.460799 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a172f21-de27-4134-88eb-ffe225082070 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:50.480775 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1233/2442] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Sep 13 15:30:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 15:30:50.486442 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c875c7-36a8-4797-824a-f0e07549e94b None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:50.496844 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c875c7-36a8-4797-824a-f0e07549e94b None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:50.508208 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d167bf57-edb0-4603-8d05-fca88b0c38c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:50.509273 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d167bf57-edb0-4603-8d05-fca88b0c38c0 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:50.509806 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d167bf57-edb0-4603-8d05-fca88b0c38c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:50.510241 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d167bf57-edb0-4603-8d05-fca88b0c38c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:50.511151 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d167bf57-edb0-4603-8d05-fca88b0c38c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:50.514386 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d167bf57-edb0-4603-8d05-fca88b0c38c0 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:50.554753 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1210/2443] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 13 15:30:50 2022] POST /identity/v3/projects => generated 385 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:30:50.558660 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a172f21-de27-4134-88eb-ffe225082070 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:50.587744 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a172f21-de27-4134-88eb-ffe225082070 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:50.679113 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5edb9a-5563-4284-a24c-b7a7067cb862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:50.679630 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5edb9a-5563-4284-a24c-b7a7067cb862 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:50.680328 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5edb9a-5563-4284-a24c-b7a7067cb862 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:50.680710 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5edb9a-5563-4284-a24c-b7a7067cb862 admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:50.682025 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5edb9a-5563-4284-a24c-b7a7067cb862 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:50.687587 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5edb9a-5563-4284-a24c-b7a7067cb862 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:50.743402 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1234/2444] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 13 15:30:50 2022] POST /identity/v3/users => generated 293 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:30:50.747891 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d167bf57-edb0-4603-8d05-fca88b0c38c0 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:50.765692 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5edb9a-5563-4284-a24c-b7a7067cb862 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:50.769006 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-2f5edb9a-5563-4284-a24c-b7a7067cb862 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:50.773496 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d167bf57-edb0-4603-8d05-fca88b0c38c0 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:50.783333 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5edb9a-5563-4284-a24c-b7a7067cb862 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:50.793183 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09b7ada-6909-4acf-8b95-972e0567ed5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:50.793900 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09b7ada-6909-4acf-8b95-972e0567ed5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:50.794193 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09b7ada-6909-4acf-8b95-972e0567ed5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:50.794475 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09b7ada-6909-4acf-8b95-972e0567ed5f admin admin] PATH_INFO: `/v3/projects/e29705b1f11f40538db7a7f9a88a406b` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:50.795775 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09b7ada-6909-4acf-8b95-972e0567ed5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=e29705b1f11f40538db7a7f9a88a406b)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:50.797548 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c518d354-eabe-452b-afc4-a25d2611ca8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:50.798138 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09b7ada-6909-4acf-8b95-972e0567ed5f admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:50.798436 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c518d354-eabe-452b-afc4-a25d2611ca8c admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:50.798822 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c518d354-eabe-452b-afc4-a25d2611ca8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:50.799219 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c518d354-eabe-452b-afc4-a25d2611ca8c admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:50.799989 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c518d354-eabe-452b-afc4-a25d2611ca8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:50.801960 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c518d354-eabe-452b-afc4-a25d2611ca8c admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:50.824933 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1211/2445] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:30:50 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 15:30:50.830217 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c518d354-eabe-452b-afc4-a25d2611ca8c admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:50.841974 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c518d354-eabe-452b-afc4-a25d2611ca8c admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:50.854913 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:30:50.860445 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c575568f-0fe8-437c-907d-c2addcb1aa2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:50.862887 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c575568f-0fe8-437c-907d-c2addcb1aa2b admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:50.863378 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c575568f-0fe8-437c-907d-c2addcb1aa2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:50.863837 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c575568f-0fe8-437c-907d-c2addcb1aa2b admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:50.864679 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c575568f-0fe8-437c-907d-c2addcb1aa2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:50.866413 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c575568f-0fe8-437c-907d-c2addcb1aa2b admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:50.878242 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1212/2446] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:30:50 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 15:30:50.882509 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c575568f-0fe8-437c-907d-c2addcb1aa2b admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:50.887807 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-f09b7ada-6909-4acf-8b95-972e0567ed5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e29705b1f11f40538db7a7f9a88a406b', 'request_id': 'req-f09b7ada-6909-4acf-8b95-972e0567ed5f'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:50.897350 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-f09b7ada-6909-4acf-8b95-972e0567ed5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e29705b1f11f40538db7a7f9a88a406b', 'request_id': 'req-f09b7ada-6909-4acf-8b95-972e0567ed5f'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:50.898786 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c575568f-0fe8-437c-907d-c2addcb1aa2b admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:50.907492 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-f09b7ada-6909-4acf-8b95-972e0567ed5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e29705b1f11f40538db7a7f9a88a406b', 'request_id': 'req-f09b7ada-6909-4acf-8b95-972e0567ed5f'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:50.921432 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-f09b7ada-6909-4acf-8b95-972e0567ed5f admin admin] The token cache is being invalidate because project e29705b1f11f40538db7a7f9a88a406b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 15:30:50.921758 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-f09b7ada-6909-4acf-8b95-972e0567ed5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:50.922443 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-f09b7ada-6909-4acf-8b95-972e0567ed5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:30:50.925297 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1235/2447] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 13 15:30:50 2022] DELETE /identity/v3/projects/e29705b1f11f40538db7a7f9a88a406b => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:30:50.930334 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebbd768-5763-44e7-9074-cdc7905ac79a None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:50.930623 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebbd768-5763-44e7-9074-cdc7905ac79a None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:50.930906 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebbd768-5763-44e7-9074-cdc7905ac79a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:50.951449 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-6ebbd768-5763-44e7-9074-cdc7905ac79a None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:30:50.952951 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-6ebbd768-5763-44e7-9074-cdc7905ac79a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:50.981270 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d624c76-7691-44e1-a3f8-dd432c3ef834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:50.982072 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d624c76-7691-44e1-a3f8-dd432c3ef834 admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:50.982425 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d624c76-7691-44e1-a3f8-dd432c3ef834 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:50.982770 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d624c76-7691-44e1-a3f8-dd432c3ef834 admin admin] PATH_INFO: `/v3/projects/e256212fe6a14fc58293ed09dfc02cd8/users/33164e89b34a4b3d8ce3abfd6e55628d/roles/3fae3d3a28e147d3b2bede2378ff79ae` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:51.005315 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d624c76-7691-44e1-a3f8-dd432c3ef834 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e256212fe6a14fc58293ed09dfc02cd8, user_id=33164e89b34a4b3d8ce3abfd6e55628d, role_id=3fae3d3a28e147d3b2bede2378ff79ae)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:51.008867 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d624c76-7691-44e1-a3f8-dd432c3ef834 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:51.023229 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1236/2448] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:30:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 15:30:51.028935 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1213/2449] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 13 15:30:50 2022] PUT /identity/v3/projects/e256212fe6a14fc58293ed09dfc02cd8/users/33164e89b34a4b3d8ce3abfd6e55628d/roles/3fae3d3a28e147d3b2bede2378ff79ae => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 15:30:51.035232 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03f6bc3-fdb1-4637-b217-f798c5bbbe80 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:51.035529 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03f6bc3-fdb1-4637-b217-f798c5bbbe80 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:51.035950 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03f6bc3-fdb1-4637-b217-f798c5bbbe80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:51.040573 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b86841-1fcd-4bb2-8060-387489b608d8 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:51.040861 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b86841-1fcd-4bb2-8060-387489b608d8 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:51.041134 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b86841-1fcd-4bb2-8060-387489b608d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:51.045112 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:30:51.061864 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-00b86841-1fcd-4bb2-8060-387489b608d8 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:30:51.062771 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-c03f6bc3-fdb1-4637-b217-f798c5bbbe80 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:30:51.063542 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-00b86841-1fcd-4bb2-8060-387489b608d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:51.064238 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-c03f6bc3-fdb1-4637-b217-f798c5bbbe80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:51.143822 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1214/2450] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:30:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:30:51.147283 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03f6bc3-fdb1-4637-b217-f798c5bbbe80 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:51.151121 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1237/2451] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:30:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 15:30:51.171514 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03f6bc3-fdb1-4637-b217-f798c5bbbe80 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:51.178468 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b86841-1fcd-4bb2-8060-387489b608d8 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:51.179175 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97905d1a-729f-4a34-97ef-c63f71fc2f46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:51.179806 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97905d1a-729f-4a34-97ef-c63f71fc2f46 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:51.179985 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-00b86841-1fcd-4bb2-8060-387489b608d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:51.180090 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97905d1a-729f-4a34-97ef-c63f71fc2f46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:51.180350 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97905d1a-729f-4a34-97ef-c63f71fc2f46 admin admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:51.182103 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97905d1a-729f-4a34-97ef-c63f71fc2f46 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:30:51.182420 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97905d1a-729f-4a34-97ef-c63f71fc2f46 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:51.184023 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97905d1a-729f-4a34-97ef-c63f71fc2f46 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:51.200851 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1215/2452] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Sep 13 15:30:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:30:51.206219 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97905d1a-729f-4a34-97ef-c63f71fc2f46 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:51.228624 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97905d1a-729f-4a34-97ef-c63f71fc2f46 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:51.235986 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e7b441-b91a-4200-8a6f-e1de2ca4ee62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:51.237370 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e7b441-b91a-4200-8a6f-e1de2ca4ee62 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:51.237833 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e7b441-b91a-4200-8a6f-e1de2ca4ee62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:51.238213 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e7b441-b91a-4200-8a6f-e1de2ca4ee62 admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:51.239867 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e7b441-b91a-4200-8a6f-e1de2ca4ee62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:51.242962 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e7b441-b91a-4200-8a6f-e1de2ca4ee62 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:51.278281 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b86841-1fcd-4bb2-8060-387489b608d8 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:51.283072 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca658ee-9cef-4e50-b435-7bda47804111 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41675154bbba47388040966f75d84c3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:51.283700 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca658ee-9cef-4e50-b435-7bda47804111 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:51.284123 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca658ee-9cef-4e50-b435-7bda47804111 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:51.284421 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca658ee-9cef-4e50-b435-7bda47804111 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:51.286916 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1216/2453] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 13 15:30:51 2022] POST /identity/v3/projects => generated 391 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:30:51.292282 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e7b441-b91a-4200-8a6f-e1de2ca4ee62 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:51.307321 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca658ee-9cef-4e50-b435-7bda47804111 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:51.309390 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca658ee-9cef-4e50-b435-7bda47804111 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:51.315806 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:30:51.326550 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1238/2454] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:30:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:30:51.408510 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e7b441-b91a-4200-8a6f-e1de2ca4ee62 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:51.412663 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1eaf7c-c98a-4eb4-ad55-f435076cd6b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:51.413365 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1eaf7c-c98a-4eb4-ad55-f435076cd6b6 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:51.413690 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1eaf7c-c98a-4eb4-ad55-f435076cd6b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:51.414916 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1eaf7c-c98a-4eb4-ad55-f435076cd6b6 admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:51.418519 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1eaf7c-c98a-4eb4-ad55-f435076cd6b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:51.419136 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1eaf7c-c98a-4eb4-ad55-f435076cd6b6 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:51.462858 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1217/2455] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 13 15:30:51 2022] POST /identity/v3/users => generated 296 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:30:51.464210 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca658ee-9cef-4e50-b435-7bda47804111 service neutron] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:51.485907 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca658ee-9cef-4e50-b435-7bda47804111 service neutron] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:51.492333 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8fb2e3-21ae-4d0e-a77b-88af93f2895c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:51.493282 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8fb2e3-21ae-4d0e-a77b-88af93f2895c admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:51.493970 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8fb2e3-21ae-4d0e-a77b-88af93f2895c admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:51.494256 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8fb2e3-21ae-4d0e-a77b-88af93f2895c admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:51.496326 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8fb2e3-21ae-4d0e-a77b-88af93f2895c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:51.498166 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8fb2e3-21ae-4d0e-a77b-88af93f2895c admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:51.518174 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1239/2456] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:30:51 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 15:30:51.519821 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1eaf7c-c98a-4eb4-ad55-f435076cd6b6 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:51.538338 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1eaf7c-c98a-4eb4-ad55-f435076cd6b6 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:51.545828 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53fa919-2270-4e23-89a4-04d258667ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:51.546908 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53fa919-2270-4e23-89a4-04d258667ab6 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:51.546908 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53fa919-2270-4e23-89a4-04d258667ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:51.547425 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53fa919-2270-4e23-89a4-04d258667ab6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:51.548257 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53fa919-2270-4e23-89a4-04d258667ab6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:51.551118 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53fa919-2270-4e23-89a4-04d258667ab6 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:51.566671 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1218/2457] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:30:51 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 15:30:51.574545 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8fb2e3-21ae-4d0e-a77b-88af93f2895c admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:51.592447 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8fb2e3-21ae-4d0e-a77b-88af93f2895c admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:51.606122 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df98ae75-cc51-4368-96c5-13391c428899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:51.607870 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df98ae75-cc51-4368-96c5-13391c428899 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:51.608434 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df98ae75-cc51-4368-96c5-13391c428899 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:51.614525 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df98ae75-cc51-4368-96c5-13391c428899 admin admin] PATH_INFO: `/v3/projects/49096c8bf00d4ac98f6fc1ccc182f7b7/users/ef20c45f66a3459d8c75e94f16ccbfd4/roles/3fae3d3a28e147d3b2bede2378ff79ae` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:51.666155 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df98ae75-cc51-4368-96c5-13391c428899 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49096c8bf00d4ac98f6fc1ccc182f7b7, user_id=ef20c45f66a3459d8c75e94f16ccbfd4, role_id=3fae3d3a28e147d3b2bede2378ff79ae)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:51.669319 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df98ae75-cc51-4368-96c5-13391c428899 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:51.706827 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1240/2458] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 13 15:30:51 2022] PUT /identity/v3/projects/49096c8bf00d4ac98f6fc1ccc182f7b7/users/ef20c45f66a3459d8c75e94f16ccbfd4/roles/3fae3d3a28e147d3b2bede2378ff79ae => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:30:51.718883 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95179617-f756-41c1-a4f4-712602eaf0f7 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:51.718986 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95179617-f756-41c1-a4f4-712602eaf0f7 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:51.719256 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95179617-f756-41c1-a4f4-712602eaf0f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:51.765237 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-95179617-f756-41c1-a4f4-712602eaf0f7 None None] MFA Rules not processed for user `ef20c45f66a3459d8c75e94f16ccbfd4`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:30:51.767090 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-95179617-f756-41c1-a4f4-712602eaf0f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:51.818633 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:30:51.868133 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1219/2459] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:30:51 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:30:51.877025 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df98ae75-cc51-4368-96c5-13391c428899 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:51.878963 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-df98ae75-cc51-4368-96c5-13391c428899 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:52.034479 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df98ae75-cc51-4368-96c5-13391c428899 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:30:52.067142 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ea1668-b39e-4f8f-a976-a65eb252ee17 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97acd23097d54bf7805c3cef60626ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:30:52.072745 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ea1668-b39e-4f8f-a976-a65eb252ee17 service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:52.073994 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ea1668-b39e-4f8f-a976-a65eb252ee17 service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:52.074927 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ea1668-b39e-4f8f-a976-a65eb252ee17 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:52.120320 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ea1668-b39e-4f8f-a976-a65eb252ee17 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:30:52.125461 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ea1668-b39e-4f8f-a976-a65eb252ee17 service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:30:52.155327 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1241/2460] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:30:51 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:30:59.487718 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8f0893-5260-46af-84bf-6fd09b81e24d None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:30:59.488217 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8f0893-5260-46af-84bf-6fd09b81e24d None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:30:59.488455 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8f0893-5260-46af-84bf-6fd09b81e24d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:30:59.570247 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-4e8f0893-5260-46af-84bf-6fd09b81e24d None None] MFA Rules not processed for user `33164e89b34a4b3d8ce3abfd6e55628d`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:30:59.571620 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-4e8f0893-5260-46af-84bf-6fd09b81e24d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:30:59.824491 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1220/2461] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:30:59 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:30:59.829337 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ea1668-b39e-4f8f-a976-a65eb252ee17 service cinder] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:30:59.831705 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-c6ea1668-b39e-4f8f-a976-a65eb252ee17 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:31:00.038586 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ea1668-b39e-4f8f-a976-a65eb252ee17 service cinder] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:31:00.054248 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4785f2ab-5baa-4dfb-bdcf-0851b892b245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:31:00.054914 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4785f2ab-5baa-4dfb-bdcf-0851b892b245 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:31:00.057279 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4785f2ab-5baa-4dfb-bdcf-0851b892b245 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:31:00.057898 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4785f2ab-5baa-4dfb-bdcf-0851b892b245 admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:31:00.059216 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4785f2ab-5baa-4dfb-bdcf-0851b892b245 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:31:00.065640 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4785f2ab-5baa-4dfb-bdcf-0851b892b245 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:31:00.164870 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8f0893-5260-46af-84bf-6fd09b81e24d None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:31:00.177847 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1242/2462] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 13 15:30:59 2022] POST /identity/v3/projects => generated 385 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:31:00.184598 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8f0893-5260-46af-84bf-6fd09b81e24d None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:31:00.329951 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73486af-6b07-452d-a1ba-270f966ef5ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:31:00.331606 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73486af-6b07-452d-a1ba-270f966ef5ed admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:31:00.331606 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73486af-6b07-452d-a1ba-270f966ef5ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:31:00.331606 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73486af-6b07-452d-a1ba-270f966ef5ed admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:31:00.344373 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73486af-6b07-452d-a1ba-270f966ef5ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:31:00.347733 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73486af-6b07-452d-a1ba-270f966ef5ed admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:31:00.430318 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1221/2463] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 13 15:31:00 2022] POST /identity/v3/users => generated 299 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 15:31:00.434178 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4785f2ab-5baa-4dfb-bdcf-0851b892b245 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:31:00.447258 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4785f2ab-5baa-4dfb-bdcf-0851b892b245 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:31:00.453664 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07657c86-129a-4fbc-baf4-cc43aa52583b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:31:00.455289 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07657c86-129a-4fbc-baf4-cc43aa52583b admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:31:00.455619 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07657c86-129a-4fbc-baf4-cc43aa52583b admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:31:00.455977 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07657c86-129a-4fbc-baf4-cc43aa52583b admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:31:00.456717 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07657c86-129a-4fbc-baf4-cc43aa52583b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:31:00.459494 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07657c86-129a-4fbc-baf4-cc43aa52583b admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:31:00.476454 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1243/2464] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:31:00 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 15:31:00.481037 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73486af-6b07-452d-a1ba-270f966ef5ed admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:31:00.495854 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73486af-6b07-452d-a1ba-270f966ef5ed admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:31:00.502223 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8525a6-c62d-4f81-a310-8f910d212a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:31:00.503532 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8525a6-c62d-4f81-a310-8f910d212a8b admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:31:00.504347 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8525a6-c62d-4f81-a310-8f910d212a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:31:00.504856 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8525a6-c62d-4f81-a310-8f910d212a8b admin admin] PATH_INFO: `/v3/projects/747bfefebb41450987615772826ed049/users/da627e5102594c67b740da1fd5ea3b9e/roles/f34412ad29f1478cba775b033129f71f` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:31:00.531356 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8525a6-c62d-4f81-a310-8f910d212a8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=747bfefebb41450987615772826ed049, user_id=da627e5102594c67b740da1fd5ea3b9e, role_id=f34412ad29f1478cba775b033129f71f)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:31:00.534569 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8525a6-c62d-4f81-a310-8f910d212a8b admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:31:00.552940 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1222/2465] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 13 15:31:00 2022] PUT /identity/v3/projects/747bfefebb41450987615772826ed049/users/da627e5102594c67b740da1fd5ea3b9e/roles/f34412ad29f1478cba775b033129f71f => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 15:31:00.556949 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07657c86-129a-4fbc-baf4-cc43aa52583b admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:31:00.570745 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07657c86-129a-4fbc-baf4-cc43aa52583b admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:31:00.631524 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:31:00.664709 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489fc590-ecec-4316-9f60-d4b01e6507db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:31:00.665355 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489fc590-ecec-4316-9f60-d4b01e6507db admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:31:00.665692 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489fc590-ecec-4316-9f60-d4b01e6507db admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:31:00.667127 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489fc590-ecec-4316-9f60-d4b01e6507db admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:31:00.668146 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489fc590-ecec-4316-9f60-d4b01e6507db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:31:00.670097 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489fc590-ecec-4316-9f60-d4b01e6507db admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:31:00.685235 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1244/2466] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:31:00 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 15:31:00.689280 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8525a6-c62d-4f81-a310-8f910d212a8b admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:31:00.706390 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8525a6-c62d-4f81-a310-8f910d212a8b admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:31:00.728908 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1d4b9b-71c2-4c72-89f7-b7614ad2ec66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:31:00.729863 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1d4b9b-71c2-4c72-89f7-b7614ad2ec66 admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:31:00.730453 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1d4b9b-71c2-4c72-89f7-b7614ad2ec66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:31:00.730569 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1d4b9b-71c2-4c72-89f7-b7614ad2ec66 admin admin] PATH_INFO: `/v3/projects/747bfefebb41450987615772826ed049/users/da627e5102594c67b740da1fd5ea3b9e/roles/f34412ad29f1478cba775b033129f71f` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:31:00.733858 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1d4b9b-71c2-4c72-89f7-b7614ad2ec66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=747bfefebb41450987615772826ed049, user_id=da627e5102594c67b740da1fd5ea3b9e, role_id=f34412ad29f1478cba775b033129f71f)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:31:00.737291 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1d4b9b-71c2-4c72-89f7-b7614ad2ec66 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:31:00.760655 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1223/2467] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 13 15:31:00 2022] PUT /identity/v3/projects/747bfefebb41450987615772826ed049/users/da627e5102594c67b740da1fd5ea3b9e/roles/f34412ad29f1478cba775b033129f71f => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:31:01.642397 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e916e0e0-105e-4a30-9b87-1ab5aea64912 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:31:01.642942 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e916e0e0-105e-4a30-9b87-1ab5aea64912 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:31:01.642942 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e916e0e0-105e-4a30-9b87-1ab5aea64912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:31:01.687469 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-e916e0e0-105e-4a30-9b87-1ab5aea64912 None None] MFA Rules not processed for user `0f2d373741034946bb989002d4b895ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:31:01.689592 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-e916e0e0-105e-4a30-9b87-1ab5aea64912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:31:01.839443 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1245/2468] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:31:01 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:31:04.090760 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea0f350-7772-4895-917d-bedca384bbdc None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:31:04.091219 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea0f350-7772-4895-917d-bedca384bbdc None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:31:04.091327 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea0f350-7772-4895-917d-bedca384bbdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:31:04.127039 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-7ea0f350-7772-4895-917d-bedca384bbdc None None] MFA Rules not processed for user `e97bcdb20f1e416ea41b99c226617faf`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:31:04.132227 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-7ea0f350-7772-4895-917d-bedca384bbdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:31:04.153972 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:31:04.245502 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1224/2469] 10.222.0.27 () {58 vars in 1009 bytes} [Tue Sep 13 15:31:04 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:31:04.276306 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e916e0e0-105e-4a30-9b87-1ab5aea64912 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:31:04.328852 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea0f350-7772-4895-917d-bedca384bbdc None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:31:04.331023 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-7ea0f350-7772-4895-917d-bedca384bbdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:31:04.366049 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e916e0e0-105e-4a30-9b87-1ab5aea64912 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:31:04.373220 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7153ea52-93e9-4788-ad87-93a126e85703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:31:04.374409 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7153ea52-93e9-4788-ad87-93a126e85703 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:31:04.375243 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7153ea52-93e9-4788-ad87-93a126e85703 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:31:04.375673 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7153ea52-93e9-4788-ad87-93a126e85703 admin admin] PATH_INFO: `/v3/users/ef20c45f66a3459d8c75e94f16ccbfd4` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:31:04.377860 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7153ea52-93e9-4788-ad87-93a126e85703 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef20c45f66a3459d8c75e94f16ccbfd4)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:31:04.380452 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7153ea52-93e9-4788-ad87-93a126e85703 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:31:04.465424 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-7153ea52-93e9-4788-ad87-93a126e85703 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef20c45f66a3459d8c75e94f16ccbfd4'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:31:04.467655 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-7153ea52-93e9-4788-ad87-93a126e85703 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef20c45f66a3459d8c75e94f16ccbfd4'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:31:04.468332 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-7153ea52-93e9-4788-ad87-93a126e85703 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef20c45f66a3459d8c75e94f16ccbfd4'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:31:04.484952 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-7153ea52-93e9-4788-ad87-93a126e85703 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef20c45f66a3459d8c75e94f16ccbfd4'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:31:04.513452 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-7153ea52-93e9-4788-ad87-93a126e85703 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef20c45f66a3459d8c75e94f16ccbfd4'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:31:04.549736 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:31:04.562797 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1246/2470] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 13 15:31:04 2022] DELETE /identity/v3/users/ef20c45f66a3459d8c75e94f16ccbfd4 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:31:04.568370 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae9b7d2-685c-4a5c-9a64-6dbb642ee9a6 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:31:04.568660 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae9b7d2-685c-4a5c-9a64-6dbb642ee9a6 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:31:04.568944 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae9b7d2-685c-4a5c-9a64-6dbb642ee9a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:31:04.572593 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea0f350-7772-4895-917d-bedca384bbdc None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:31:04.611505 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-3ae9b7d2-685c-4a5c-9a64-6dbb642ee9a6 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:31:04.612748 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-3ae9b7d2-685c-4a5c-9a64-6dbb642ee9a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:31:04.781554 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1247/2471] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:31:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:31:04.787019 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3f987d-1bbd-45d6-b486-839b988631a2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc735644be394e0abe73e709373e2003', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:31:04.787651 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3f987d-1bbd-45d6-b486-839b988631a2 service swift] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:31:04.787932 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3f987d-1bbd-45d6-b486-839b988631a2 service swift] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:31:04.788207 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3f987d-1bbd-45d6-b486-839b988631a2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:31:04.790114 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-7f3f987d-1bbd-45d6-b486-839b988631a2 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:31:04.835760 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae9b7d2-685c-4a5c-9a64-6dbb642ee9a6 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:31:04.837225 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-3ae9b7d2-685c-4a5c-9a64-6dbb642ee9a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:31:04.940056 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae9b7d2-685c-4a5c-9a64-6dbb642ee9a6 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:31:04.945384 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80518e0-4ec1-490e-919a-3b835035570d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41675154bbba47388040966f75d84c3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:31:04.946477 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80518e0-4ec1-490e-919a-3b835035570d service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:31:04.947308 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80518e0-4ec1-490e-919a-3b835035570d service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:31:04.947655 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80518e0-4ec1-490e-919a-3b835035570d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:31:04.974590 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80518e0-4ec1-490e-919a-3b835035570d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:31:04.976593 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80518e0-4ec1-490e-919a-3b835035570d service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:31:04.993318 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1248/2472] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:31:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:31:05.004637 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3f987d-1bbd-45d6-b486-839b988631a2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:31:05.006330 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3f987d-1bbd-45d6-b486-839b988631a2 service swift] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:31:05.017945 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1225/2473] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Sep 13 15:31:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 689 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 13 15:31:05.840407 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80518e0-4ec1-490e-919a-3b835035570d service neutron] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:31:05.842311 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-e80518e0-4ec1-490e-919a-3b835035570d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:31:05.877105 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80518e0-4ec1-490e-919a-3b835035570d service neutron] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:31:05.884391 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9845a8d-9e02-4a87-aa87-c43cd7306f61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:31:05.885045 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9845a8d-9e02-4a87-aa87-c43cd7306f61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:31:05.885325 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9845a8d-9e02-4a87-aa87-c43cd7306f61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:31:05.885600 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9845a8d-9e02-4a87-aa87-c43cd7306f61 admin admin] PATH_INFO: `/v3/projects/49096c8bf00d4ac98f6fc1ccc182f7b7` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:31:05.887218 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9845a8d-9e02-4a87-aa87-c43cd7306f61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=49096c8bf00d4ac98f6fc1ccc182f7b7)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:31:05.889753 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9845a8d-9e02-4a87-aa87-c43cd7306f61 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:31:05.991158 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-b9845a8d-9e02-4a87-aa87-c43cd7306f61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49096c8bf00d4ac98f6fc1ccc182f7b7', 'request_id': 'req-b9845a8d-9e02-4a87-aa87-c43cd7306f61'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:31:06.013741 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-b9845a8d-9e02-4a87-aa87-c43cd7306f61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49096c8bf00d4ac98f6fc1ccc182f7b7', 'request_id': 'req-b9845a8d-9e02-4a87-aa87-c43cd7306f61'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:31:06.039244 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-b9845a8d-9e02-4a87-aa87-c43cd7306f61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49096c8bf00d4ac98f6fc1ccc182f7b7', 'request_id': 'req-b9845a8d-9e02-4a87-aa87-c43cd7306f61'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:31:06.065197 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-b9845a8d-9e02-4a87-aa87-c43cd7306f61 admin admin] The token cache is being invalidate because project 49096c8bf00d4ac98f6fc1ccc182f7b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 15:31:06.066154 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-b9845a8d-9e02-4a87-aa87-c43cd7306f61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:31:06.067802 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-b9845a8d-9e02-4a87-aa87-c43cd7306f61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:31:06.073563 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1249/2474] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 13 15:31:05 2022] DELETE /identity/v3/projects/49096c8bf00d4ac98f6fc1ccc182f7b7 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:31:08.582106 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3f987d-1bbd-45d6-b486-839b988631a2 service swift] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:31:08.583631 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-7f3f987d-1bbd-45d6-b486-839b988631a2 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:31:08.615582 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3f987d-1bbd-45d6-b486-839b988631a2 service swift] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:31:08.628646 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:31:08.781449 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d743a2c9-2007-42ee-8b01-23ac4d7737fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:31:08.784970 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d743a2c9-2007-42ee-8b01-23ac4d7737fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:31:08.785328 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d743a2c9-2007-42ee-8b01-23ac4d7737fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:31:08.785769 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d743a2c9-2007-42ee-8b01-23ac4d7737fc admin admin] PATH_INFO: `/v3/users/74a7adf27152438eb13a729b8afec0e4` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:31:08.787791 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d743a2c9-2007-42ee-8b01-23ac4d7737fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=74a7adf27152438eb13a729b8afec0e4)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:31:08.790661 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d743a2c9-2007-42ee-8b01-23ac4d7737fc admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:31:08.998282 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-d743a2c9-2007-42ee-8b01-23ac4d7737fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74a7adf27152438eb13a729b8afec0e4'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:31:09.002924 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-d743a2c9-2007-42ee-8b01-23ac4d7737fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74a7adf27152438eb13a729b8afec0e4'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:31:09.004447 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-d743a2c9-2007-42ee-8b01-23ac4d7737fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74a7adf27152438eb13a729b8afec0e4'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:31:09.036316 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-d743a2c9-2007-42ee-8b01-23ac4d7737fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74a7adf27152438eb13a729b8afec0e4'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:31:09.058282 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-d743a2c9-2007-42ee-8b01-23ac4d7737fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74a7adf27152438eb13a729b8afec0e4'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:31:09.103695 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1226/2475] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 13 15:31:08 2022] DELETE /identity/v3/users/74a7adf27152438eb13a729b8afec0e4 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:31:09.105947 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b0b2cc-78da-4a59-84a8-7aff0522c9d7 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:31:09.107079 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b0b2cc-78da-4a59-84a8-7aff0522c9d7 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:31:09.107594 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b0b2cc-78da-4a59-84a8-7aff0522c9d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:31:09.153779 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-65b0b2cc-78da-4a59-84a8-7aff0522c9d7 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:31:09.155426 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-65b0b2cc-78da-4a59-84a8-7aff0522c9d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:31:09.183075 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:31:09.277989 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1250/2476] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:31:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:31:09.718009 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d743a2c9-2007-42ee-8b01-23ac4d7737fc admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:31:09.721252 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-d743a2c9-2007-42ee-8b01-23ac4d7737fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:31:09.835716 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d743a2c9-2007-42ee-8b01-23ac4d7737fc admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:31:09.839685 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a101bf48-1421-4397-93c2-3bc7d6da7dbb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41675154bbba47388040966f75d84c3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:31:09.840307 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a101bf48-1421-4397-93c2-3bc7d6da7dbb service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:31:09.840593 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a101bf48-1421-4397-93c2-3bc7d6da7dbb service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:31:09.840861 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a101bf48-1421-4397-93c2-3bc7d6da7dbb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:31:09.866353 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a101bf48-1421-4397-93c2-3bc7d6da7dbb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:31:09.869014 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a101bf48-1421-4397-93c2-3bc7d6da7dbb service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:31:09.884042 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1227/2477] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:31:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:31:10.541238 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b0b2cc-78da-4a59-84a8-7aff0522c9d7 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:31:10.543689 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-65b0b2cc-78da-4a59-84a8-7aff0522c9d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:31:10.566749 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b0b2cc-78da-4a59-84a8-7aff0522c9d7 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:31:10.590964 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7909b479-2027-488c-8dba-dad0de3e0b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:31:10.591642 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7909b479-2027-488c-8dba-dad0de3e0b49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:31:10.591928 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7909b479-2027-488c-8dba-dad0de3e0b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:31:10.592216 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7909b479-2027-488c-8dba-dad0de3e0b49 admin admin] PATH_INFO: `/v3/projects/142f39a5605f445a97146e3e810d520e` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:31:10.596941 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7909b479-2027-488c-8dba-dad0de3e0b49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=142f39a5605f445a97146e3e810d520e)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:31:10.607361 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7909b479-2027-488c-8dba-dad0de3e0b49 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:31:10.673006 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510efef7-867b-4f9d-8d19-15472e0061f2 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:31:10.673345 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510efef7-867b-4f9d-8d19-15472e0061f2 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:31:10.673752 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510efef7-867b-4f9d-8d19-15472e0061f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:31:10.781076 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-510efef7-867b-4f9d-8d19-15472e0061f2 None None] MFA Rules not processed for user `da627e5102594c67b740da1fd5ea3b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:31:10.784919 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-510efef7-867b-4f9d-8d19-15472e0061f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:31:10.806111 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-7909b479-2027-488c-8dba-dad0de3e0b49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '142f39a5605f445a97146e3e810d520e', 'request_id': 'req-7909b479-2027-488c-8dba-dad0de3e0b49'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:31:10.827863 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-7909b479-2027-488c-8dba-dad0de3e0b49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '142f39a5605f445a97146e3e810d520e', 'request_id': 'req-7909b479-2027-488c-8dba-dad0de3e0b49'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:31:10.835772 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:31:10.852043 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-7909b479-2027-488c-8dba-dad0de3e0b49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '142f39a5605f445a97146e3e810d520e', 'request_id': 'req-7909b479-2027-488c-8dba-dad0de3e0b49'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:31:10.921137 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-7909b479-2027-488c-8dba-dad0de3e0b49 admin admin] The token cache is being invalidate because project 142f39a5605f445a97146e3e810d520e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 15:31:10.923414 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-7909b479-2027-488c-8dba-dad0de3e0b49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:31:10.927906 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-7909b479-2027-488c-8dba-dad0de3e0b49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:31:10.976508 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1251/2478] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 13 15:31:10 2022] DELETE /identity/v3/projects/142f39a5605f445a97146e3e810d520e => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:31:11.180879 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1228/2479] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:31:10 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 509 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 15:31:11.188748 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7909b479-2027-488c-8dba-dad0de3e0b49 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:31:11.190580 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-7909b479-2027-488c-8dba-dad0de3e0b49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:31:11.276331 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7909b479-2027-488c-8dba-dad0de3e0b49 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:31:11.284359 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f171c366-31fc-41f7-9162-9da7d3bd481e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef26a5203094c83b52f10b930dfc453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:31:11.285135 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f171c366-31fc-41f7-9162-9da7d3bd481e service glance] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:31:11.285510 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f171c366-31fc-41f7-9162-9da7d3bd481e service glance] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:31:11.285885 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f171c366-31fc-41f7-9162-9da7d3bd481e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:31:11.288316 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-f171c366-31fc-41f7-9162-9da7d3bd481e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:31:11.379596 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f171c366-31fc-41f7-9162-9da7d3bd481e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:31:11.381357 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f171c366-31fc-41f7-9162-9da7d3bd481e service glance] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:31:11.404967 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1252/2480] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:31:11 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:31:11.645581 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2a7b75-eb65-4912-b3ce-1eabf1a092d1 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:31:11.645899 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2a7b75-eb65-4912-b3ce-1eabf1a092d1 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:31:11.646184 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2a7b75-eb65-4912-b3ce-1eabf1a092d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:31:11.675977 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-dd2a7b75-eb65-4912-b3ce-1eabf1a092d1 None None] MFA Rules not processed for user `e97bcdb20f1e416ea41b99c226617faf`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:31:11.677236 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-dd2a7b75-eb65-4912-b3ce-1eabf1a092d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:31:11.772732 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1229/2481] 10.222.0.27 () {58 vars in 1009 bytes} [Tue Sep 13 15:31:11 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:31:11.788654 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f171c366-31fc-41f7-9162-9da7d3bd481e service glance] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:31:11.790768 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-f171c366-31fc-41f7-9162-9da7d3bd481e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:31:11.803182 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:31:11.957384 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f171c366-31fc-41f7-9162-9da7d3bd481e service glance] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:31:11.960295 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8336f37d-4845-4a87-9f49-d6aa853b07c0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc735644be394e0abe73e709373e2003', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:31:11.960934 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8336f37d-4845-4a87-9f49-d6aa853b07c0 service swift] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:31:11.961219 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8336f37d-4845-4a87-9f49-d6aa853b07c0 service swift] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:31:11.961497 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8336f37d-4845-4a87-9f49-d6aa853b07c0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:31:11.973188 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8336f37d-4845-4a87-9f49-d6aa853b07c0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:31:11.974932 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8336f37d-4845-4a87-9f49-d6aa853b07c0 service swift] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:31:11.990860 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1253/2482] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Sep 13 15:31:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 15:31:21.769182 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=46 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:31:22.006163 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=30 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:31:28.266477 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c195b2f-d160-4dbf-abed-fa24c977350b None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:31:28.267599 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c195b2f-d160-4dbf-abed-fa24c977350b None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:31:28.267974 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c195b2f-d160-4dbf-abed-fa24c977350b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:31:28.306701 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc6ab65-c216-458f-9fc9-4cf81021317c None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:31:28.307296 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc6ab65-c216-458f-9fc9-4cf81021317c None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:31:28.307296 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc6ab65-c216-458f-9fc9-4cf81021317c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:31:28.317334 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-1c195b2f-d160-4dbf-abed-fa24c977350b None None] MFA Rules not processed for user `33164e89b34a4b3d8ce3abfd6e55628d`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:31:28.321618 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-1c195b2f-d160-4dbf-abed-fa24c977350b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:31:28.332026 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1230/2483] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:31:28 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:31:28.345723 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-2dc6ab65-c216-458f-9fc9-4cf81021317c None None] MFA Rules not processed for user `e97bcdb20f1e416ea41b99c226617faf`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:31:28.352142 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-2dc6ab65-c216-458f-9fc9-4cf81021317c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:31:28.363941 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1254/2484] 10.222.0.27 () {58 vars in 1009 bytes} [Tue Sep 13 15:31:28 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:31:28.379080 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c195b2f-d160-4dbf-abed-fa24c977350b None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:31:28.394085 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c195b2f-d160-4dbf-abed-fa24c977350b None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:31:28.399674 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9049c68a-27a0-420b-8fd8-8c6ff2f88884 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc735644be394e0abe73e709373e2003', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:31:28.400504 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9049c68a-27a0-420b-8fd8-8c6ff2f88884 service swift] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:31:28.400792 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9049c68a-27a0-420b-8fd8-8c6ff2f88884 service swift] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:31:28.401067 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9049c68a-27a0-420b-8fd8-8c6ff2f88884 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:31:28.413433 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9049c68a-27a0-420b-8fd8-8c6ff2f88884 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:31:28.415110 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9049c68a-27a0-420b-8fd8-8c6ff2f88884 service swift] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:31:28.426623 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1231/2485] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Sep 13 15:31:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 15:31:29.146580 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51249252-0958-43d3-b509-aef9c2aeacac None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:31:29.146927 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51249252-0958-43d3-b509-aef9c2aeacac None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:31:29.147163 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51249252-0958-43d3-b509-aef9c2aeacac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:31:29.178639 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-51249252-0958-43d3-b509-aef9c2aeacac None None] MFA Rules not processed for user `e97bcdb20f1e416ea41b99c226617faf`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:31:29.180169 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-51249252-0958-43d3-b509-aef9c2aeacac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:31:29.189735 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1255/2486] 10.222.0.27 () {58 vars in 967 bytes} [Tue Sep 13 15:31:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:31:29.214448 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9049c68a-27a0-420b-8fd8-8c6ff2f88884 service swift] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:31:29.226709 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9049c68a-27a0-420b-8fd8-8c6ff2f88884 service swift] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:31:29.232255 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed57d6ce-f26a-4099-b1c6-8b6c3cbee61c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc735644be394e0abe73e709373e2003', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:31:29.233321 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed57d6ce-f26a-4099-b1c6-8b6c3cbee61c service swift] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:31:29.233548 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed57d6ce-f26a-4099-b1c6-8b6c3cbee61c service swift] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:31:29.233885 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed57d6ce-f26a-4099-b1c6-8b6c3cbee61c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:31:29.243696 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed57d6ce-f26a-4099-b1c6-8b6c3cbee61c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:31:29.245300 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed57d6ce-f26a-4099-b1c6-8b6c3cbee61c service swift] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:31:29.255346 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1232/2487] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Sep 13 15:31:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 15:31:29.667743 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc727e9-d8d6-4530-9316-f10a68307751 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:31:29.668323 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc727e9-d8d6-4530-9316-f10a68307751 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:31:29.668323 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc727e9-d8d6-4530-9316-f10a68307751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:31:29.704418 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-3cc727e9-d8d6-4530-9316-f10a68307751 None None] MFA Rules not processed for user `e97bcdb20f1e416ea41b99c226617faf`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:31:29.705667 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-3cc727e9-d8d6-4530-9316-f10a68307751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:31:29.735765 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1256/2488] 10.222.0.27 () {58 vars in 1009 bytes} [Tue Sep 13 15:31:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:31:29.751390 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed57d6ce-f26a-4099-b1c6-8b6c3cbee61c service swift] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:31:29.772014 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed57d6ce-f26a-4099-b1c6-8b6c3cbee61c service swift] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:31:29.782028 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2defe7c-9cc2-48aa-9d61-78790b42af1c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc735644be394e0abe73e709373e2003', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:31:29.782949 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2defe7c-9cc2-48aa-9d61-78790b42af1c service swift] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:31:29.783302 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2defe7c-9cc2-48aa-9d61-78790b42af1c service swift] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:31:29.786065 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2defe7c-9cc2-48aa-9d61-78790b42af1c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:31:29.801289 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2defe7c-9cc2-48aa-9d61-78790b42af1c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:31:29.803463 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2defe7c-9cc2-48aa-9d61-78790b42af1c service swift] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:31:29.815801 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1233/2489] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Sep 13 15:31:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 13 15:31:30.261236 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c67210-fced-4b4c-b825-d8b8aaa60971 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:31:30.261931 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c67210-fced-4b4c-b825-d8b8aaa60971 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:31:30.262381 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c67210-fced-4b4c-b825-d8b8aaa60971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:31:30.287808 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-10c67210-fced-4b4c-b825-d8b8aaa60971 None None] MFA Rules not processed for user `e97bcdb20f1e416ea41b99c226617faf`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:31:30.289182 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-10c67210-fced-4b4c-b825-d8b8aaa60971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:31:30.297931 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1257/2490] 10.222.0.27 () {58 vars in 967 bytes} [Tue Sep 13 15:31:30 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 15:31:30.321013 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2defe7c-9cc2-48aa-9d61-78790b42af1c service swift] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:31:30.335170 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2defe7c-9cc2-48aa-9d61-78790b42af1c service swift] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:31:30.342010 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec353968-d01a-469e-af84-5f8a17a4a9c0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc735644be394e0abe73e709373e2003', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:31:30.342756 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec353968-d01a-469e-af84-5f8a17a4a9c0 service swift] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:31:30.343120 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec353968-d01a-469e-af84-5f8a17a4a9c0 service swift] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:31:30.343636 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec353968-d01a-469e-af84-5f8a17a4a9c0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:31:30.352950 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec353968-d01a-469e-af84-5f8a17a4a9c0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:31:30.354621 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec353968-d01a-469e-af84-5f8a17a4a9c0 service swift] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:31:30.364660 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1234/2491] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Sep 13 15:31:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 15:31:31.265603 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412b38ae-3f6c-40f1-9154-937cadcf248f None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:31:31.266263 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412b38ae-3f6c-40f1-9154-937cadcf248f None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:31:31.267117 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412b38ae-3f6c-40f1-9154-937cadcf248f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:31:31.289654 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-412b38ae-3f6c-40f1-9154-937cadcf248f None None] MFA Rules not processed for user `e97bcdb20f1e416ea41b99c226617faf`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:31:31.290951 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-412b38ae-3f6c-40f1-9154-937cadcf248f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:31:31.322801 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1258/2492] 10.222.0.27 () {58 vars in 1009 bytes} [Tue Sep 13 15:31:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:31:31.339072 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec353968-d01a-469e-af84-5f8a17a4a9c0 service swift] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:31:31.356138 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec353968-d01a-469e-af84-5f8a17a4a9c0 service swift] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:31:31.364826 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ea212d-b579-495e-9a03-3aa607e03e1e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc735644be394e0abe73e709373e2003', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:31:31.365447 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ea212d-b579-495e-9a03-3aa607e03e1e service swift] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:31:31.366637 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ea212d-b579-495e-9a03-3aa607e03e1e service swift] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:31:31.366947 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ea212d-b579-495e-9a03-3aa607e03e1e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:31:31.386184 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ea212d-b579-495e-9a03-3aa607e03e1e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:31:31.388168 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ea212d-b579-495e-9a03-3aa607e03e1e service swift] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:31:31.415319 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1235/2493] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Sep 13 15:31:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 15:31:33.480689 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412b38ae-3f6c-40f1-9154-937cadcf248f None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:31:33.482289 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-412b38ae-3f6c-40f1-9154-937cadcf248f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:31:33.564705 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412b38ae-3f6c-40f1-9154-937cadcf248f None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:31:33.569554 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c317daad-d26f-42b8-a68a-513c5b987fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:31:33.570247 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c317daad-d26f-42b8-a68a-513c5b987fc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:31:33.570697 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c317daad-d26f-42b8-a68a-513c5b987fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:31:33.571285 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c317daad-d26f-42b8-a68a-513c5b987fc1 admin admin] PATH_INFO: `/v3/users/c7dd85f9b44a4ce8a498dec34508f9d6` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:31:33.572767 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c317daad-d26f-42b8-a68a-513c5b987fc1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7dd85f9b44a4ce8a498dec34508f9d6)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:31:33.575521 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c317daad-d26f-42b8-a68a-513c5b987fc1 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:31:33.615421 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dda5ca0-87e4-4062-9c92-734af109bc5f None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:31:33.616401 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dda5ca0-87e4-4062-9c92-734af109bc5f None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:31:33.616734 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dda5ca0-87e4-4062-9c92-734af109bc5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:31:33.638625 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-5dda5ca0-87e4-4062-9c92-734af109bc5f None None] MFA Rules not processed for user `e97bcdb20f1e416ea41b99c226617faf`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:31:33.640729 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-5dda5ca0-87e4-4062-9c92-734af109bc5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:31:33.643034 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-c317daad-d26f-42b8-a68a-513c5b987fc1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7dd85f9b44a4ce8a498dec34508f9d6'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:31:33.643877 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-c317daad-d26f-42b8-a68a-513c5b987fc1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7dd85f9b44a4ce8a498dec34508f9d6'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:31:33.644582 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-c317daad-d26f-42b8-a68a-513c5b987fc1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7dd85f9b44a4ce8a498dec34508f9d6'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:31:33.649995 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1236/2494] 10.222.0.27 () {58 vars in 967 bytes} [Tue Sep 13 15:31:33 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:31:33.652366 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-c317daad-d26f-42b8-a68a-513c5b987fc1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7dd85f9b44a4ce8a498dec34508f9d6'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:31:33.664868 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dda5ca0-87e4-4062-9c92-734af109bc5f None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:31:33.666351 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-5dda5ca0-87e4-4062-9c92-734af109bc5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:31:33.672804 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-c317daad-d26f-42b8-a68a-513c5b987fc1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7dd85f9b44a4ce8a498dec34508f9d6'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:31:33.683094 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dda5ca0-87e4-4062-9c92-734af109bc5f None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:31:33.689350 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d43d1d3-2eaf-43a1-8948-2113a7ebe9f9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc735644be394e0abe73e709373e2003', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:31:33.690282 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d43d1d3-2eaf-43a1-8948-2113a7ebe9f9 service swift] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:31:33.690741 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d43d1d3-2eaf-43a1-8948-2113a7ebe9f9 service swift] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:31:33.691018 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1259/2495] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 13 15:31:33 2022] DELETE /identity/v3/users/c7dd85f9b44a4ce8a498dec34508f9d6 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:31:33.691361 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d43d1d3-2eaf-43a1-8948-2113a7ebe9f9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:31:33.695790 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74047798-f2a1-490d-9373-62448cb8d89c None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:31:33.696081 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74047798-f2a1-490d-9373-62448cb8d89c None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:31:33.696358 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74047798-f2a1-490d-9373-62448cb8d89c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:31:33.707236 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d43d1d3-2eaf-43a1-8948-2113a7ebe9f9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:31:33.709012 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d43d1d3-2eaf-43a1-8948-2113a7ebe9f9 service swift] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:31:33.718078 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-74047798-f2a1-490d-9373-62448cb8d89c None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:31:33.720201 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1237/2496] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Sep 13 15:31:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 13 15:31:33.720436 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-74047798-f2a1-490d-9373-62448cb8d89c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:31:33.815583 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:31:33.854358 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1260/2497] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:31:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:31:33.866697 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d43d1d3-2eaf-43a1-8948-2113a7ebe9f9 service swift] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:31:33.868127 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-9d43d1d3-2eaf-43a1-8948-2113a7ebe9f9 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:31:33.943409 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d43d1d3-2eaf-43a1-8948-2113a7ebe9f9 service swift] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:31:34.019506 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f879a0dc-e431-4666-af9e-c8d8957ce5a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41675154bbba47388040966f75d84c3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:31:34.020126 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f879a0dc-e431-4666-af9e-c8d8957ce5a8 service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:31:34.020685 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f879a0dc-e431-4666-af9e-c8d8957ce5a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:31:34.036351 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f879a0dc-e431-4666-af9e-c8d8957ce5a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:31:34.048332 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f879a0dc-e431-4666-af9e-c8d8957ce5a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:31:34.050136 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f879a0dc-e431-4666-af9e-c8d8957ce5a8 service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:31:34.077406 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1238/2498] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:31:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:31:34.293723 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74047798-f2a1-490d-9373-62448cb8d89c None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:31:34.295978 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-74047798-f2a1-490d-9373-62448cb8d89c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:31:34.319976 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74047798-f2a1-490d-9373-62448cb8d89c None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:31:34.326112 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd4641f-c262-4862-9c81-d3a1a79e631b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:31:34.327029 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd4641f-c262-4862-9c81-d3a1a79e631b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:31:34.327367 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd4641f-c262-4862-9c81-d3a1a79e631b admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:31:34.327573 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd4641f-c262-4862-9c81-d3a1a79e631b admin admin] PATH_INFO: `/v3/projects/1ca4970161964ea69056f67522292b8e` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:31:34.328776 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd4641f-c262-4862-9c81-d3a1a79e631b admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ca4970161964ea69056f67522292b8e)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:31:34.331146 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd4641f-c262-4862-9c81-d3a1a79e631b admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:31:34.396457 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-2cd4641f-c262-4862-9c81-d3a1a79e631b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ca4970161964ea69056f67522292b8e', 'request_id': 'req-2cd4641f-c262-4862-9c81-d3a1a79e631b'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:31:34.403979 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-2cd4641f-c262-4862-9c81-d3a1a79e631b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ca4970161964ea69056f67522292b8e', 'request_id': 'req-2cd4641f-c262-4862-9c81-d3a1a79e631b'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:31:34.416360 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-2cd4641f-c262-4862-9c81-d3a1a79e631b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ca4970161964ea69056f67522292b8e', 'request_id': 'req-2cd4641f-c262-4862-9c81-d3a1a79e631b'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:31:34.430594 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-2cd4641f-c262-4862-9c81-d3a1a79e631b admin admin] The token cache is being invalidate because project 1ca4970161964ea69056f67522292b8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 15:31:34.430899 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-2cd4641f-c262-4862-9c81-d3a1a79e631b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:31:34.431550 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-2cd4641f-c262-4862-9c81-d3a1a79e631b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:31:34.433072 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1261/2499] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 13 15:31:34 2022] DELETE /identity/v3/projects/1ca4970161964ea69056f67522292b8e => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:31:34.438950 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59171193-f8a2-46b0-9160-a9d19862e36c None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:31:34.439495 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59171193-f8a2-46b0-9160-a9d19862e36c None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:31:34.440068 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59171193-f8a2-46b0-9160-a9d19862e36c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:31:34.461606 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-59171193-f8a2-46b0-9160-a9d19862e36c None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:31:34.462863 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-59171193-f8a2-46b0-9160-a9d19862e36c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:31:34.490247 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:31:34.570772 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1239/2500] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:31:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:31:34.579666 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e68f4e-cb9a-4ed6-9510-fe8342d36aec None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:31:34.580258 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e68f4e-cb9a-4ed6-9510-fe8342d36aec None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:31:34.580484 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e68f4e-cb9a-4ed6-9510-fe8342d36aec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:31:34.601405 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-18e68f4e-cb9a-4ed6-9510-fe8342d36aec None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:31:34.602993 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-18e68f4e-cb9a-4ed6-9510-fe8342d36aec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:31:34.611679 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1262/2501] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:31:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:31:34.616109 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59171193-f8a2-46b0-9160-a9d19862e36c None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:31:34.629333 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59171193-f8a2-46b0-9160-a9d19862e36c None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:31:34.634603 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6f9682-82ac-4a14-a458-ec4e1a6a1557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:31:34.635325 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6f9682-82ac-4a14-a458-ec4e1a6a1557 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:31:34.635740 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6f9682-82ac-4a14-a458-ec4e1a6a1557 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:31:34.636081 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6f9682-82ac-4a14-a458-ec4e1a6a1557 admin admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:31:34.636825 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6f9682-82ac-4a14-a458-ec4e1a6a1557 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:31:34.637200 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6f9682-82ac-4a14-a458-ec4e1a6a1557 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:31:34.638972 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6f9682-82ac-4a14-a458-ec4e1a6a1557 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:31:34.653730 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1240/2502] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Sep 13 15:31:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:31:34.657616 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e68f4e-cb9a-4ed6-9510-fe8342d36aec None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:31:34.669406 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e68f4e-cb9a-4ed6-9510-fe8342d36aec None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:31:34.674525 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8d6f74-483f-40e6-8c7a-8755ceffd4bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:31:34.675652 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8d6f74-483f-40e6-8c7a-8755ceffd4bd admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:31:34.675909 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8d6f74-483f-40e6-8c7a-8755ceffd4bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:31:34.676197 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8d6f74-483f-40e6-8c7a-8755ceffd4bd admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:31:34.676833 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8d6f74-483f-40e6-8c7a-8755ceffd4bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:31:34.678824 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8d6f74-483f-40e6-8c7a-8755ceffd4bd admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:31:34.708441 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1263/2503] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 13 15:31:34 2022] POST /identity/v3/projects => generated 399 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:31:34.713411 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6f9682-82ac-4a14-a458-ec4e1a6a1557 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:31:34.726207 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6f9682-82ac-4a14-a458-ec4e1a6a1557 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:31:34.788180 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860a88fa-3f8f-467a-bb52-c948f514f49e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:31:34.788793 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860a88fa-3f8f-467a-bb52-c948f514f49e admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:31:34.789080 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860a88fa-3f8f-467a-bb52-c948f514f49e admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:31:34.789356 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860a88fa-3f8f-467a-bb52-c948f514f49e admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:31:34.790047 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860a88fa-3f8f-467a-bb52-c948f514f49e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:31:34.791980 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860a88fa-3f8f-467a-bb52-c948f514f49e admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:31:34.815675 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1241/2504] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 13 15:31:34 2022] POST /identity/v3/users => generated 300 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:31:34.823124 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8d6f74-483f-40e6-8c7a-8755ceffd4bd admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:31:34.835292 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8d6f74-483f-40e6-8c7a-8755ceffd4bd admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:31:34.839944 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f3e8e2-9cb8-4adb-9811-f950a06ff212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:31:34.840549 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f3e8e2-9cb8-4adb-9811-f950a06ff212 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:31:34.840835 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f3e8e2-9cb8-4adb-9811-f950a06ff212 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:31:34.841108 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f3e8e2-9cb8-4adb-9811-f950a06ff212 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:31:34.841780 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f3e8e2-9cb8-4adb-9811-f950a06ff212 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:31:34.844031 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f3e8e2-9cb8-4adb-9811-f950a06ff212 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:31:34.854665 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1264/2505] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:31:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 15:31:34.858708 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860a88fa-3f8f-467a-bb52-c948f514f49e admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:31:34.869276 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860a88fa-3f8f-467a-bb52-c948f514f49e admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:31:34.874000 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3052e0b2-c44b-483c-9030-268fd380dd74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:31:34.874641 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3052e0b2-c44b-483c-9030-268fd380dd74 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:31:34.874928 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3052e0b2-c44b-483c-9030-268fd380dd74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:31:34.875202 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3052e0b2-c44b-483c-9030-268fd380dd74 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:31:34.875945 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3052e0b2-c44b-483c-9030-268fd380dd74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:31:34.877556 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3052e0b2-c44b-483c-9030-268fd380dd74 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:31:34.892368 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1242/2506] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:31:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 15:31:34.893524 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f3e8e2-9cb8-4adb-9811-f950a06ff212 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:31:34.904046 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f3e8e2-9cb8-4adb-9811-f950a06ff212 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:31:34.909854 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8163cd-8189-48e9-b6f4-34dc676ac298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:31:34.910523 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8163cd-8189-48e9-b6f4-34dc676ac298 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:31:34.910810 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8163cd-8189-48e9-b6f4-34dc676ac298 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:31:34.911152 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8163cd-8189-48e9-b6f4-34dc676ac298 admin admin] PATH_INFO: `/v3/projects/a8fa332c4957407b88bf50d6c7b1fc05/users/cf6e060301434cb4856ddf37d2423c5a/roles/3fae3d3a28e147d3b2bede2378ff79ae` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:31:34.926614 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8163cd-8189-48e9-b6f4-34dc676ac298 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8fa332c4957407b88bf50d6c7b1fc05, user_id=cf6e060301434cb4856ddf37d2423c5a, role_id=3fae3d3a28e147d3b2bede2378ff79ae)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:31:34.929278 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8163cd-8189-48e9-b6f4-34dc676ac298 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:31:34.943164 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1265/2507] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 13 15:31:34 2022] PUT /identity/v3/projects/a8fa332c4957407b88bf50d6c7b1fc05/users/cf6e060301434cb4856ddf37d2423c5a/roles/3fae3d3a28e147d3b2bede2378ff79ae => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:31:34.954401 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477b757f-c897-470e-a55c-eb22434a77c0 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:31:34.954691 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477b757f-c897-470e-a55c-eb22434a77c0 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:31:34.954970 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477b757f-c897-470e-a55c-eb22434a77c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:31:34.983273 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-477b757f-c897-470e-a55c-eb22434a77c0 None None] MFA Rules not processed for user `cf6e060301434cb4856ddf37d2423c5a`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:31:34.984437 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-477b757f-c897-470e-a55c-eb22434a77c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:31:35.050147 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1243/2508] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:31:34 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:31:35.061986 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8163cd-8189-48e9-b6f4-34dc676ac298 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:31:35.064089 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-1e8163cd-8189-48e9-b6f4-34dc676ac298 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:31:35.124348 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8163cd-8189-48e9-b6f4-34dc676ac298 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:31:35.128314 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cee2781-21bb-4fb9-a904-794f4d5de959 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97acd23097d54bf7805c3cef60626ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:31:35.128893 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cee2781-21bb-4fb9-a904-794f4d5de959 service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:31:35.129172 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cee2781-21bb-4fb9-a904-794f4d5de959 service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:31:35.129442 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cee2781-21bb-4fb9-a904-794f4d5de959 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:31:35.139384 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cee2781-21bb-4fb9-a904-794f4d5de959 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:31:35.141692 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cee2781-21bb-4fb9-a904-794f4d5de959 service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:31:35.151155 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1266/2509] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:31:35 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:31:36.098117 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477b757f-c897-470e-a55c-eb22434a77c0 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:31:36.099823 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-477b757f-c897-470e-a55c-eb22434a77c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:31:36.131199 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:31:36.180748 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477b757f-c897-470e-a55c-eb22434a77c0 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:31:36.185552 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ad73e8-28df-4e74-af2d-87dfbc9ed33d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:31:36.186305 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ad73e8-28df-4e74-af2d-87dfbc9ed33d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:31:36.186607 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ad73e8-28df-4e74-af2d-87dfbc9ed33d admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:31:36.186880 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ad73e8-28df-4e74-af2d-87dfbc9ed33d admin admin] PATH_INFO: `/v3/users/168dd28a0e4546c5a1f65f6b58f7dace` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:31:36.188589 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ad73e8-28df-4e74-af2d-87dfbc9ed33d admin admin] RBAC: Authorizing `identity:delete_user(user_id=168dd28a0e4546c5a1f65f6b58f7dace)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:31:36.190526 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ad73e8-28df-4e74-af2d-87dfbc9ed33d admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:31:36.250008 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-b7ad73e8-28df-4e74-af2d-87dfbc9ed33d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '168dd28a0e4546c5a1f65f6b58f7dace'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:31:36.250698 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-b7ad73e8-28df-4e74-af2d-87dfbc9ed33d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '168dd28a0e4546c5a1f65f6b58f7dace'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:31:36.251295 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-b7ad73e8-28df-4e74-af2d-87dfbc9ed33d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '168dd28a0e4546c5a1f65f6b58f7dace'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:31:36.259985 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-b7ad73e8-28df-4e74-af2d-87dfbc9ed33d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '168dd28a0e4546c5a1f65f6b58f7dace'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:31:36.277915 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-b7ad73e8-28df-4e74-af2d-87dfbc9ed33d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '168dd28a0e4546c5a1f65f6b58f7dace'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:31:36.293785 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1244/2510] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 13 15:31:36 2022] DELETE /identity/v3/users/168dd28a0e4546c5a1f65f6b58f7dace => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:31:36.506746 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cee2781-21bb-4fb9-a904-794f4d5de959 service cinder] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:31:36.525954 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cee2781-21bb-4fb9-a904-794f4d5de959 service cinder] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:31:36.532978 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:31:36.604914 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b29021-561b-4200-ab1a-6bb390629e03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:31:36.605716 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b29021-561b-4200-ab1a-6bb390629e03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:31:36.606096 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b29021-561b-4200-ab1a-6bb390629e03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:31:36.606280 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b29021-561b-4200-ab1a-6bb390629e03 admin admin] PATH_INFO: `/v3/projects/4a4c7ab1ee344f81ad36446bd115f863` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:31:36.607425 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b29021-561b-4200-ab1a-6bb390629e03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a4c7ab1ee344f81ad36446bd115f863)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:31:36.610017 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b29021-561b-4200-ab1a-6bb390629e03 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:31:36.668065 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-84b29021-561b-4200-ab1a-6bb390629e03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a4c7ab1ee344f81ad36446bd115f863', 'request_id': 'req-84b29021-561b-4200-ab1a-6bb390629e03'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:31:36.675477 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-84b29021-561b-4200-ab1a-6bb390629e03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a4c7ab1ee344f81ad36446bd115f863', 'request_id': 'req-84b29021-561b-4200-ab1a-6bb390629e03'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:31:36.687755 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-84b29021-561b-4200-ab1a-6bb390629e03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a4c7ab1ee344f81ad36446bd115f863', 'request_id': 'req-84b29021-561b-4200-ab1a-6bb390629e03'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:31:36.698870 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-84b29021-561b-4200-ab1a-6bb390629e03 admin admin] The token cache is being invalidate because project 4a4c7ab1ee344f81ad36446bd115f863 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 15:31:36.699160 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-84b29021-561b-4200-ab1a-6bb390629e03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:31:36.699833 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-84b29021-561b-4200-ab1a-6bb390629e03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:31:36.708152 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1267/2511] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 13 15:31:36 2022] DELETE /identity/v3/projects/4a4c7ab1ee344f81ad36446bd115f863 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:31:36.710068 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a531407-41aa-40c9-a1cb-454c1ae17182 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:31:36.710464 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a531407-41aa-40c9-a1cb-454c1ae17182 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:31:36.710721 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a531407-41aa-40c9-a1cb-454c1ae17182 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:31:36.737430 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-6a531407-41aa-40c9-a1cb-454c1ae17182 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:31:36.738854 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-6a531407-41aa-40c9-a1cb-454c1ae17182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:31:36.815957 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1245/2512] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:31:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:31:36.823430 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b25474f-143f-4285-a336-1f140c03fefc None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:31:36.823725 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b25474f-143f-4285-a336-1f140c03fefc None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:31:36.824196 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b25474f-143f-4285-a336-1f140c03fefc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:31:36.851065 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-7b25474f-143f-4285-a336-1f140c03fefc None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:31:36.852312 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-7b25474f-143f-4285-a336-1f140c03fefc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:31:36.865729 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1268/2513] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:31:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 15:31:36.867041 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a531407-41aa-40c9-a1cb-454c1ae17182 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:31:36.879020 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a531407-41aa-40c9-a1cb-454c1ae17182 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:31:36.888112 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d05bad-45c4-4bd6-93cd-32cf13f6e000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:31:36.889182 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d05bad-45c4-4bd6-93cd-32cf13f6e000 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:31:36.889629 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d05bad-45c4-4bd6-93cd-32cf13f6e000 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:31:36.890630 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d05bad-45c4-4bd6-93cd-32cf13f6e000 admin admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:31:36.891644 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d05bad-45c4-4bd6-93cd-32cf13f6e000 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:31:36.892256 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d05bad-45c4-4bd6-93cd-32cf13f6e000 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:31:36.894341 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d05bad-45c4-4bd6-93cd-32cf13f6e000 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:31:36.908996 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1246/2514] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Sep 13 15:31:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:31:36.914409 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b25474f-143f-4285-a336-1f140c03fefc None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:31:36.925443 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b25474f-143f-4285-a336-1f140c03fefc None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:31:36.931791 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8d6456-b3f4-4928-8dad-9b8582895196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:31:36.932762 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8d6456-b3f4-4928-8dad-9b8582895196 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:31:36.933303 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8d6456-b3f4-4928-8dad-9b8582895196 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:31:36.933718 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8d6456-b3f4-4928-8dad-9b8582895196 admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:31:36.934831 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8d6456-b3f4-4928-8dad-9b8582895196 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:31:36.940144 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8d6456-b3f4-4928-8dad-9b8582895196 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:31:36.983869 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1269/2515] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 13 15:31:36 2022] POST /identity/v3/projects => generated 371 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:31:36.993754 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d05bad-45c4-4bd6-93cd-32cf13f6e000 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:31:37.005152 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d05bad-45c4-4bd6-93cd-32cf13f6e000 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:31:37.056384 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:31:37.106400 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e758ea3a-44b7-482b-99a7-70fcaba3c6de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:31:37.107213 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e758ea3a-44b7-482b-99a7-70fcaba3c6de admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:31:37.107503 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e758ea3a-44b7-482b-99a7-70fcaba3c6de admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:31:37.107785 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e758ea3a-44b7-482b-99a7-70fcaba3c6de admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:31:37.108448 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e758ea3a-44b7-482b-99a7-70fcaba3c6de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:31:37.111040 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e758ea3a-44b7-482b-99a7-70fcaba3c6de admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:31:37.135646 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1247/2516] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 13 15:31:36 2022] POST /identity/v3/users => generated 286 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 15:31:37.139814 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8d6456-b3f4-4928-8dad-9b8582895196 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:31:37.152105 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8d6456-b3f4-4928-8dad-9b8582895196 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:31:37.156980 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f3649b-9211-41f8-9ffe-1611e01d9df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:31:37.157584 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f3649b-9211-41f8-9ffe-1611e01d9df6 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:31:37.157900 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f3649b-9211-41f8-9ffe-1611e01d9df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:31:37.158179 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f3649b-9211-41f8-9ffe-1611e01d9df6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:31:37.158820 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f3649b-9211-41f8-9ffe-1611e01d9df6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:31:37.160426 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f3649b-9211-41f8-9ffe-1611e01d9df6 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:31:37.172102 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1270/2517] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:31:37 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 15:31:37.176213 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e758ea3a-44b7-482b-99a7-70fcaba3c6de admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:31:37.186815 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e758ea3a-44b7-482b-99a7-70fcaba3c6de admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:31:37.195038 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966fa1ed-ec1e-488c-a48c-70c3e8fa9ca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:31:37.195948 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966fa1ed-ec1e-488c-a48c-70c3e8fa9ca3 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:31:37.196487 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966fa1ed-ec1e-488c-a48c-70c3e8fa9ca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:31:37.196659 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966fa1ed-ec1e-488c-a48c-70c3e8fa9ca3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:31:37.197592 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966fa1ed-ec1e-488c-a48c-70c3e8fa9ca3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:31:37.199739 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966fa1ed-ec1e-488c-a48c-70c3e8fa9ca3 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:31:37.213987 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1248/2518] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:31:37 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 15:31:37.218333 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f3649b-9211-41f8-9ffe-1611e01d9df6 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:31:37.229402 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f3649b-9211-41f8-9ffe-1611e01d9df6 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:31:37.235037 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6915ac53-680a-4c27-9f87-79b141d7b935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:31:37.235718 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6915ac53-680a-4c27-9f87-79b141d7b935 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:31:37.236072 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6915ac53-680a-4c27-9f87-79b141d7b935 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:31:37.236434 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6915ac53-680a-4c27-9f87-79b141d7b935 admin admin] PATH_INFO: `/v3/projects/fed73134b1c8412fb7eba1cb4a286b33/users/25faadaedd724585ac50358a5a234835/roles/3fae3d3a28e147d3b2bede2378ff79ae` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:31:37.255217 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6915ac53-680a-4c27-9f87-79b141d7b935 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fed73134b1c8412fb7eba1cb4a286b33, user_id=25faadaedd724585ac50358a5a234835, role_id=3fae3d3a28e147d3b2bede2378ff79ae)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:31:37.258278 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6915ac53-680a-4c27-9f87-79b141d7b935 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:31:37.274034 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1271/2519] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 13 15:31:37 2022] PUT /identity/v3/projects/fed73134b1c8412fb7eba1cb4a286b33/users/25faadaedd724585ac50358a5a234835/roles/3fae3d3a28e147d3b2bede2378ff79ae => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:31:37.279135 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640a52d3-9265-4ec1-b9c4-91c92821c764 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:31:37.279428 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640a52d3-9265-4ec1-b9c4-91c92821c764 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:31:37.279707 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640a52d3-9265-4ec1-b9c4-91c92821c764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:31:37.299620 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-640a52d3-9265-4ec1-b9c4-91c92821c764 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:31:37.300799 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-640a52d3-9265-4ec1-b9c4-91c92821c764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:31:37.370613 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1249/2520] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:31:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:31:37.381564 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6915ac53-680a-4c27-9f87-79b141d7b935 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:31:37.383318 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-6915ac53-680a-4c27-9f87-79b141d7b935 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:31:37.424307 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:31:37.446596 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6915ac53-680a-4c27-9f87-79b141d7b935 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:31:37.450567 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5a6cff-50e0-4e76-a02b-4d4d02ea12a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41675154bbba47388040966f75d84c3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:31:37.451261 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5a6cff-50e0-4e76-a02b-4d4d02ea12a3 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:31:37.451868 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5a6cff-50e0-4e76-a02b-4d4d02ea12a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:31:37.452220 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5a6cff-50e0-4e76-a02b-4d4d02ea12a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:31:37.473729 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5a6cff-50e0-4e76-a02b-4d4d02ea12a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:31:37.473729 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5a6cff-50e0-4e76-a02b-4d4d02ea12a3 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:31:37.480370 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1272/2521] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:31:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:31:40.696024 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640a52d3-9265-4ec1-b9c4-91c92821c764 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:31:40.697589 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-640a52d3-9265-4ec1-b9c4-91c92821c764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:31:40.713149 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640a52d3-9265-4ec1-b9c4-91c92821c764 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:31:40.725288 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c6b4e0-9eff-45d1-8f9b-45f6c1ed6c20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:31:40.726001 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c6b4e0-9eff-45d1-8f9b-45f6c1ed6c20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:31:40.726289 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c6b4e0-9eff-45d1-8f9b-45f6c1ed6c20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:31:40.726567 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c6b4e0-9eff-45d1-8f9b-45f6c1ed6c20 admin admin] PATH_INFO: `/v3/users/cf6e060301434cb4856ddf37d2423c5a` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:31:40.727911 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c6b4e0-9eff-45d1-8f9b-45f6c1ed6c20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf6e060301434cb4856ddf37d2423c5a)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:31:40.729949 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c6b4e0-9eff-45d1-8f9b-45f6c1ed6c20 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:31:40.804122 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-45c6b4e0-9eff-45d1-8f9b-45f6c1ed6c20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf6e060301434cb4856ddf37d2423c5a'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:31:40.805176 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-45c6b4e0-9eff-45d1-8f9b-45f6c1ed6c20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf6e060301434cb4856ddf37d2423c5a'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:31:40.805995 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-45c6b4e0-9eff-45d1-8f9b-45f6c1ed6c20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf6e060301434cb4856ddf37d2423c5a'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:31:40.815348 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-45c6b4e0-9eff-45d1-8f9b-45f6c1ed6c20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf6e060301434cb4856ddf37d2423c5a'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:31:40.834676 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-45c6b4e0-9eff-45d1-8f9b-45f6c1ed6c20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf6e060301434cb4856ddf37d2423c5a'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:31:40.860005 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1250/2522] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 13 15:31:40 2022] DELETE /identity/v3/users/cf6e060301434cb4856ddf37d2423c5a => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:31:40.864287 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8832f1-3e4b-40c4-8270-6c7db91dc02b None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:31:40.865104 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8832f1-3e4b-40c4-8270-6c7db91dc02b None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:31:40.865387 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8832f1-3e4b-40c4-8270-6c7db91dc02b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:31:40.885494 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-3e8832f1-3e4b-40c4-8270-6c7db91dc02b None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:31:40.889026 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-3e8832f1-3e4b-40c4-8270-6c7db91dc02b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:31:40.977078 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1273/2523] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:31:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:31:40.987479 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c6b4e0-9eff-45d1-8f9b-45f6c1ed6c20 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:31:40.989767 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-45c6b4e0-9eff-45d1-8f9b-45f6c1ed6c20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:31:41.013976 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:31:41.063092 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c6b4e0-9eff-45d1-8f9b-45f6c1ed6c20 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:31:41.067213 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cb6d77-a9a1-4bf9-8a11-bc545f5acb2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41675154bbba47388040966f75d84c3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:31:41.067836 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cb6d77-a9a1-4bf9-8a11-bc545f5acb2b service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:31:41.068326 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cb6d77-a9a1-4bf9-8a11-bc545f5acb2b service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:31:41.068611 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cb6d77-a9a1-4bf9-8a11-bc545f5acb2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:31:41.080690 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cb6d77-a9a1-4bf9-8a11-bc545f5acb2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:31:41.087128 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cb6d77-a9a1-4bf9-8a11-bc545f5acb2b service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:31:41.109689 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1251/2524] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:31:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:31:41.514602 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8832f1-3e4b-40c4-8270-6c7db91dc02b None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:31:41.516894 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-3e8832f1-3e4b-40c4-8270-6c7db91dc02b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:31:41.534748 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8832f1-3e4b-40c4-8270-6c7db91dc02b None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:31:41.547688 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b04768c-3d20-4073-9e9a-262b4ce99dcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:31:41.549593 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b04768c-3d20-4073-9e9a-262b4ce99dcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:31:41.550008 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b04768c-3d20-4073-9e9a-262b4ce99dcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:31:41.550772 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b04768c-3d20-4073-9e9a-262b4ce99dcd admin admin] PATH_INFO: `/v3/projects/a8fa332c4957407b88bf50d6c7b1fc05` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:31:41.563712 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b04768c-3d20-4073-9e9a-262b4ce99dcd admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8fa332c4957407b88bf50d6c7b1fc05)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:31:41.566423 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b04768c-3d20-4073-9e9a-262b4ce99dcd admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:31:41.636169 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-8b04768c-3d20-4073-9e9a-262b4ce99dcd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8fa332c4957407b88bf50d6c7b1fc05', 'request_id': 'req-8b04768c-3d20-4073-9e9a-262b4ce99dcd'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:31:41.647231 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-8b04768c-3d20-4073-9e9a-262b4ce99dcd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8fa332c4957407b88bf50d6c7b1fc05', 'request_id': 'req-8b04768c-3d20-4073-9e9a-262b4ce99dcd'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:31:41.669598 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-8b04768c-3d20-4073-9e9a-262b4ce99dcd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8fa332c4957407b88bf50d6c7b1fc05', 'request_id': 'req-8b04768c-3d20-4073-9e9a-262b4ce99dcd'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:31:41.698988 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-8b04768c-3d20-4073-9e9a-262b4ce99dcd admin admin] The token cache is being invalidate because project a8fa332c4957407b88bf50d6c7b1fc05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 15:31:41.699298 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-8b04768c-3d20-4073-9e9a-262b4ce99dcd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:31:41.702270 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-8b04768c-3d20-4073-9e9a-262b4ce99dcd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:31:41.705524 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1274/2525] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 13 15:31:41 2022] DELETE /identity/v3/projects/a8fa332c4957407b88bf50d6c7b1fc05 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:31:43.776804 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5321826c-cd74-4410-a215-edf62ae358da None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:31:43.783842 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5321826c-cd74-4410-a215-edf62ae358da None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:31:43.784407 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5321826c-cd74-4410-a215-edf62ae358da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:31:43.830457 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-5321826c-cd74-4410-a215-edf62ae358da None None] MFA Rules not processed for user `25faadaedd724585ac50358a5a234835`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:31:43.831733 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-5321826c-cd74-4410-a215-edf62ae358da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:31:43.939395 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1252/2526] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:31:43 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:31:43.943604 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b04768c-3d20-4073-9e9a-262b4ce99dcd admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:31:43.945668 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-8b04768c-3d20-4073-9e9a-262b4ce99dcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:31:44.029663 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b04768c-3d20-4073-9e9a-262b4ce99dcd admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:31:44.035859 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c113044e-9ab8-4f61-be4c-ddbd8f202f1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:31:44.036514 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c113044e-9ab8-4f61-be4c-ddbd8f202f1f admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:31:44.036931 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c113044e-9ab8-4f61-be4c-ddbd8f202f1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:31:44.037216 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c113044e-9ab8-4f61-be4c-ddbd8f202f1f admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:31:44.038093 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c113044e-9ab8-4f61-be4c-ddbd8f202f1f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:31:44.040076 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c113044e-9ab8-4f61-be4c-ddbd8f202f1f admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:31:44.046844 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:31:44.074175 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1275/2527] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 13 15:31:43 2022] POST /identity/v3/projects => generated 371 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:31:44.078199 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5321826c-cd74-4410-a215-edf62ae358da None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:31:44.092486 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5321826c-cd74-4410-a215-edf62ae358da None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:31:44.156441 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c32f1b-fd1a-45cf-aef2-318dea5395c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:31:44.157067 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c32f1b-fd1a-45cf-aef2-318dea5395c8 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:31:44.157356 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c32f1b-fd1a-45cf-aef2-318dea5395c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:31:44.157636 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c32f1b-fd1a-45cf-aef2-318dea5395c8 admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:31:44.158349 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c32f1b-fd1a-45cf-aef2-318dea5395c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:31:44.160365 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c32f1b-fd1a-45cf-aef2-318dea5395c8 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:31:44.183055 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1253/2528] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 13 15:31:44 2022] POST /identity/v3/users => generated 292 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 15:31:44.186462 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c113044e-9ab8-4f61-be4c-ddbd8f202f1f admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:31:44.197819 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c113044e-9ab8-4f61-be4c-ddbd8f202f1f admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:31:44.202907 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4947829b-b4a9-49ce-9dcf-cdfa2e632147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:31:44.203521 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4947829b-b4a9-49ce-9dcf-cdfa2e632147 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:31:44.203954 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4947829b-b4a9-49ce-9dcf-cdfa2e632147 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:31:44.204235 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4947829b-b4a9-49ce-9dcf-cdfa2e632147 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:31:44.204889 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4947829b-b4a9-49ce-9dcf-cdfa2e632147 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:31:44.206553 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4947829b-b4a9-49ce-9dcf-cdfa2e632147 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:31:44.216750 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1276/2529] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:31:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 15:31:44.221624 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c32f1b-fd1a-45cf-aef2-318dea5395c8 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:31:44.232462 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c32f1b-fd1a-45cf-aef2-318dea5395c8 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:31:44.238073 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c99a7e-57e1-4b87-bfab-e3c129bef269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:31:44.238763 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c99a7e-57e1-4b87-bfab-e3c129bef269 admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:31:44.239022 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c99a7e-57e1-4b87-bfab-e3c129bef269 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:31:44.239300 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c99a7e-57e1-4b87-bfab-e3c129bef269 admin admin] PATH_INFO: `/v3/projects/bdba2bc3117d4be297aca9125dca9d78/users/5ce47fbaa0a849b294be1d81fc68b9cb/roles/f34412ad29f1478cba775b033129f71f` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:31:44.255333 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c99a7e-57e1-4b87-bfab-e3c129bef269 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdba2bc3117d4be297aca9125dca9d78, user_id=5ce47fbaa0a849b294be1d81fc68b9cb, role_id=f34412ad29f1478cba775b033129f71f)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:31:44.258041 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c99a7e-57e1-4b87-bfab-e3c129bef269 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:31:44.271245 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1254/2530] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 13 15:31:44 2022] PUT /identity/v3/projects/bdba2bc3117d4be297aca9125dca9d78/users/5ce47fbaa0a849b294be1d81fc68b9cb/roles/f34412ad29f1478cba775b033129f71f => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 15:31:44.275168 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4947829b-b4a9-49ce-9dcf-cdfa2e632147 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:31:44.286190 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4947829b-b4a9-49ce-9dcf-cdfa2e632147 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:31:44.351886 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d59e9c5-3ec8-4ff8-98db-38f4e4308a85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:31:44.352506 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d59e9c5-3ec8-4ff8-98db-38f4e4308a85 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:31:44.352792 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d59e9c5-3ec8-4ff8-98db-38f4e4308a85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:31:44.353070 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d59e9c5-3ec8-4ff8-98db-38f4e4308a85 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:31:44.353744 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d59e9c5-3ec8-4ff8-98db-38f4e4308a85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:31:44.355362 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d59e9c5-3ec8-4ff8-98db-38f4e4308a85 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:31:44.365244 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1277/2531] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:31:44 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 15:31:44.369454 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c99a7e-57e1-4b87-bfab-e3c129bef269 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:31:44.380557 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c99a7e-57e1-4b87-bfab-e3c129bef269 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:31:44.385440 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfb482a-f7a1-422d-a3b4-c594e2954063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:31:44.386654 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfb482a-f7a1-422d-a3b4-c594e2954063 admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:31:44.386654 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfb482a-f7a1-422d-a3b4-c594e2954063 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:31:44.386654 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfb482a-f7a1-422d-a3b4-c594e2954063 admin admin] PATH_INFO: `/v3/projects/bdba2bc3117d4be297aca9125dca9d78/users/5ce47fbaa0a849b294be1d81fc68b9cb/roles/f34412ad29f1478cba775b033129f71f` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:31:44.388709 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfb482a-f7a1-422d-a3b4-c594e2954063 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdba2bc3117d4be297aca9125dca9d78, user_id=5ce47fbaa0a849b294be1d81fc68b9cb, role_id=f34412ad29f1478cba775b033129f71f)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:31:44.392141 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfb482a-f7a1-422d-a3b4-c594e2954063 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:31:44.404783 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1255/2532] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 13 15:31:44 2022] PUT /identity/v3/projects/bdba2bc3117d4be297aca9125dca9d78/users/5ce47fbaa0a849b294be1d81fc68b9cb/roles/f34412ad29f1478cba775b033129f71f => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:31:49.938149 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a0c454-1ae7-4092-89d8-ff26bdf46d76 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:31:49.938741 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a0c454-1ae7-4092-89d8-ff26bdf46d76 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:31:49.938741 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a0c454-1ae7-4092-89d8-ff26bdf46d76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:31:49.968917 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-55a0c454-1ae7-4092-89d8-ff26bdf46d76 None None] MFA Rules not processed for user `5ce47fbaa0a849b294be1d81fc68b9cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:31:49.970371 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-55a0c454-1ae7-4092-89d8-ff26bdf46d76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:31:50.041399 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1278/2533] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:31:49 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:31:50.183610 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfb482a-f7a1-422d-a3b4-c594e2954063 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:31:50.185954 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-0bfb482a-f7a1-422d-a3b4-c594e2954063 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:31:50.201463 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:31:50.303012 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfb482a-f7a1-422d-a3b4-c594e2954063 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:31:50.309536 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee36bff4-a5b3-40fd-b9d4-0f3e658a058c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62aad71c6c1a4469805762bba330bf0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:31:50.310184 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee36bff4-a5b3-40fd-b9d4-0f3e658a058c service nova] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:31:50.310469 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee36bff4-a5b3-40fd-b9d4-0f3e658a058c service nova] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:31:50.310748 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee36bff4-a5b3-40fd-b9d4-0f3e658a058c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:31:50.390726 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee36bff4-a5b3-40fd-b9d4-0f3e658a058c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:31:50.392381 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee36bff4-a5b3-40fd-b9d4-0f3e658a058c service nova] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:31:50.402608 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1256/2534] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:31:50 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:31:51.688625 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcb001a-de0e-42c1-8fce-2c653fd5970d None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:31:51.689017 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcb001a-de0e-42c1-8fce-2c653fd5970d None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:31:51.689017 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcb001a-de0e-42c1-8fce-2c653fd5970d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:31:51.728332 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-5fcb001a-de0e-42c1-8fce-2c653fd5970d None None] MFA Rules not processed for user `25faadaedd724585ac50358a5a234835`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:31:51.729558 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-5fcb001a-de0e-42c1-8fce-2c653fd5970d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:31:51.738698 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1279/2535] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:31:51 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:31:57.562294 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23449e64-f6fd-41a2-b4b8-1e5416fbe3b3 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:31:57.563009 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23449e64-f6fd-41a2-b4b8-1e5416fbe3b3 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:31:57.563009 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23449e64-f6fd-41a2-b4b8-1e5416fbe3b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:31:57.718345 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-23449e64-f6fd-41a2-b4b8-1e5416fbe3b3 None None] MFA Rules not processed for user `7fe1e310cd5b4506bc6e10a2f5742cbb`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:31:57.726844 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-23449e64-f6fd-41a2-b4b8-1e5416fbe3b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:31:57.834848 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1257/2536] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:31:57 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:31:59.230609 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcb001a-de0e-42c1-8fce-2c653fd5970d None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:31:59.232086 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-5fcb001a-de0e-42c1-8fce-2c653fd5970d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:31:59.286819 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:31:59.308666 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcb001a-de0e-42c1-8fce-2c653fd5970d None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:31:59.314330 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc24e757-18b4-492e-acbd-edd840ff4795 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b56f96cb3184a3ba82c8a0c3427e268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:31:59.314942 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc24e757-18b4-492e-acbd-edd840ff4795 service placement] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:31:59.315226 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc24e757-18b4-492e-acbd-edd840ff4795 service placement] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:31:59.315502 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc24e757-18b4-492e-acbd-edd840ff4795 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:31:59.317225 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-dc24e757-18b4-492e-acbd-edd840ff4795 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:31:59.329150 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc24e757-18b4-492e-acbd-edd840ff4795 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:31:59.330841 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc24e757-18b4-492e-acbd-edd840ff4795 service placement] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:31:59.341046 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1280/2537] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:31:59 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:32:00.530803 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23449e64-f6fd-41a2-b4b8-1e5416fbe3b3 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:32:00.532266 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-23449e64-f6fd-41a2-b4b8-1e5416fbe3b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:32:00.586775 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:32:00.592583 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23449e64-f6fd-41a2-b4b8-1e5416fbe3b3 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:32:00.596794 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b07269c-32c8-4bcc-bc78-fba52bec1b07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41675154bbba47388040966f75d84c3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:32:00.597410 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b07269c-32c8-4bcc-bc78-fba52bec1b07 service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:32:00.597728 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b07269c-32c8-4bcc-bc78-fba52bec1b07 service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:32:00.598002 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b07269c-32c8-4bcc-bc78-fba52bec1b07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:32:00.599763 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-2b07269c-32c8-4bcc-bc78-fba52bec1b07 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:32:00.674033 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b07269c-32c8-4bcc-bc78-fba52bec1b07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:32:00.675469 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b07269c-32c8-4bcc-bc78-fba52bec1b07 service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:32:00.684846 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1258/2538] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:32:00 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:32:09.336712 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=9 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:32:10.680655 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=29 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:32:19.787363 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc24e757-18b4-492e-acbd-edd840ff4795 service placement] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:32:19.788770 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-dc24e757-18b4-492e-acbd-edd840ff4795 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:32:19.800155 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc24e757-18b4-492e-acbd-edd840ff4795 service placement] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:32:19.803736 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc28c07-5490-472a-8aea-a8293737ea67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41675154bbba47388040966f75d84c3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:32:19.804337 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc28c07-5490-472a-8aea-a8293737ea67 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:32:19.804617 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc28c07-5490-472a-8aea-a8293737ea67 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:32:19.804888 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc28c07-5490-472a-8aea-a8293737ea67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:32:19.814310 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc28c07-5490-472a-8aea-a8293737ea67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:32:19.815746 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc28c07-5490-472a-8aea-a8293737ea67 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:32:19.825065 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1281/2539] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:32:19 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:32:25.497135 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8675520-26de-467f-bacf-82ebb9a031c1 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:32:25.497878 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8675520-26de-467f-bacf-82ebb9a031c1 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:32:25.497878 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8675520-26de-467f-bacf-82ebb9a031c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:32:25.517380 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-d8675520-26de-467f-bacf-82ebb9a031c1 None None] MFA Rules not processed for user `0f2d373741034946bb989002d4b895ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:32:25.518626 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-d8675520-26de-467f-bacf-82ebb9a031c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:32:25.572891 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1259/2540] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:32:25 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:32:29.820939 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=6 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:32:35.566444 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=25 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:33:07.930184 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558ed5e6-56d6-4d39-85c6-6e9e7ad9f323 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:33:07.930696 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558ed5e6-56d6-4d39-85c6-6e9e7ad9f323 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:33:07.930800 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558ed5e6-56d6-4d39-85c6-6e9e7ad9f323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:33:07.952025 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-558ed5e6-56d6-4d39-85c6-6e9e7ad9f323 None None] MFA Rules not processed for user `7fe1e310cd5b4506bc6e10a2f5742cbb`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:33:07.953228 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-558ed5e6-56d6-4d39-85c6-6e9e7ad9f323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:33:07.960135 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1282/2541] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:33:07 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 15:33:17.946754 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=3 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:33:31.786170 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8675520-26de-467f-bacf-82ebb9a031c1 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:33:31.787874 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-d8675520-26de-467f-bacf-82ebb9a031c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:33:31.862966 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8675520-26de-467f-bacf-82ebb9a031c1 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:33:31.867469 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934fdf4d-024f-41df-b546-c50bda0dbe76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:33:31.868095 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934fdf4d-024f-41df-b546-c50bda0dbe76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:33:31.868372 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934fdf4d-024f-41df-b546-c50bda0dbe76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:33:31.868644 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934fdf4d-024f-41df-b546-c50bda0dbe76 admin admin] PATH_INFO: `/v3/users/0f2d373741034946bb989002d4b895ca` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:33:31.869790 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934fdf4d-024f-41df-b546-c50bda0dbe76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f2d373741034946bb989002d4b895ca)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:33:31.871682 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934fdf4d-024f-41df-b546-c50bda0dbe76 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:33:31.920022 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-934fdf4d-024f-41df-b546-c50bda0dbe76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f2d373741034946bb989002d4b895ca'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:33:31.920673 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-934fdf4d-024f-41df-b546-c50bda0dbe76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f2d373741034946bb989002d4b895ca'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:33:31.921278 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-934fdf4d-024f-41df-b546-c50bda0dbe76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f2d373741034946bb989002d4b895ca'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:33:31.929057 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-934fdf4d-024f-41df-b546-c50bda0dbe76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f2d373741034946bb989002d4b895ca'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:33:31.941460 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-934fdf4d-024f-41df-b546-c50bda0dbe76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f2d373741034946bb989002d4b895ca'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:33:31.954044 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1260/2542] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 13 15:33:31 2022] DELETE /identity/v3/users/0f2d373741034946bb989002d4b895ca => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:33:32.129605 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558ed5e6-56d6-4d39-85c6-6e9e7ad9f323 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:33:32.142767 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558ed5e6-56d6-4d39-85c6-6e9e7ad9f323 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:33:32.203043 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733f1206-2452-45cc-bc20-6b7bb65a2e0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:33:32.203683 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733f1206-2452-45cc-bc20-6b7bb65a2e0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:33:32.203968 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733f1206-2452-45cc-bc20-6b7bb65a2e0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:33:32.204246 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733f1206-2452-45cc-bc20-6b7bb65a2e0e admin admin] PATH_INFO: `/v3/projects/8b972a050e4c40f6bf091a10e9933a8d` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:33:32.205391 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733f1206-2452-45cc-bc20-6b7bb65a2e0e admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b972a050e4c40f6bf091a10e9933a8d)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:33:32.207480 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733f1206-2452-45cc-bc20-6b7bb65a2e0e admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:33:32.252120 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-733f1206-2452-45cc-bc20-6b7bb65a2e0e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b972a050e4c40f6bf091a10e9933a8d', 'request_id': 'req-733f1206-2452-45cc-bc20-6b7bb65a2e0e'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:33:32.258736 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-733f1206-2452-45cc-bc20-6b7bb65a2e0e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b972a050e4c40f6bf091a10e9933a8d', 'request_id': 'req-733f1206-2452-45cc-bc20-6b7bb65a2e0e'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:33:32.265831 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-733f1206-2452-45cc-bc20-6b7bb65a2e0e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b972a050e4c40f6bf091a10e9933a8d', 'request_id': 'req-733f1206-2452-45cc-bc20-6b7bb65a2e0e'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:33:32.276170 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-733f1206-2452-45cc-bc20-6b7bb65a2e0e admin admin] The token cache is being invalidate because project 8b972a050e4c40f6bf091a10e9933a8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 15:33:32.276484 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-733f1206-2452-45cc-bc20-6b7bb65a2e0e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:33:32.277123 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-733f1206-2452-45cc-bc20-6b7bb65a2e0e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:33:32.278673 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1283/2543] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 13 15:33:32 2022] DELETE /identity/v3/projects/8b972a050e4c40f6bf091a10e9933a8d => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:33:32.283740 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860de657-41cc-49b4-b892-de0be7c96901 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:33:32.284258 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860de657-41cc-49b4-b892-de0be7c96901 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:33:32.284636 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860de657-41cc-49b4-b892-de0be7c96901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:33:32.305228 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-860de657-41cc-49b4-b892-de0be7c96901 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:33:32.306466 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-860de657-41cc-49b4-b892-de0be7c96901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:33:32.365579 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1261/2544] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:33:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:33:32.373233 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d99435-a320-468a-9428-7bac54fe7a86 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:33:32.373523 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d99435-a320-468a-9428-7bac54fe7a86 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:33:32.373825 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d99435-a320-468a-9428-7bac54fe7a86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:33:32.394620 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-c1d99435-a320-468a-9428-7bac54fe7a86 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:33:32.395857 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-c1d99435-a320-468a-9428-7bac54fe7a86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:33:32.403731 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1284/2545] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:33:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:33:32.407957 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860de657-41cc-49b4-b892-de0be7c96901 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:33:32.418156 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860de657-41cc-49b4-b892-de0be7c96901 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:33:32.422767 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5152e604-3b3c-4415-9467-b1200d5a100f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:33:32.423364 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5152e604-3b3c-4415-9467-b1200d5a100f admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:33:32.423648 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5152e604-3b3c-4415-9467-b1200d5a100f admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:33:32.423923 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5152e604-3b3c-4415-9467-b1200d5a100f admin admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:33:32.424573 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5152e604-3b3c-4415-9467-b1200d5a100f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:33:32.424875 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5152e604-3b3c-4415-9467-b1200d5a100f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:33:32.426562 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5152e604-3b3c-4415-9467-b1200d5a100f admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:33:32.437934 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1262/2546] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Sep 13 15:33:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 15:33:32.442814 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d99435-a320-468a-9428-7bac54fe7a86 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:33:32.452258 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d99435-a320-468a-9428-7bac54fe7a86 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:33:32.457547 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33ecb68-59b5-447c-b0fa-d5eed67f2047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:33:32.458179 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33ecb68-59b5-447c-b0fa-d5eed67f2047 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:33:32.458460 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33ecb68-59b5-447c-b0fa-d5eed67f2047 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:33:32.458732 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33ecb68-59b5-447c-b0fa-d5eed67f2047 admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:33:32.459364 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33ecb68-59b5-447c-b0fa-d5eed67f2047 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:33:32.461261 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33ecb68-59b5-447c-b0fa-d5eed67f2047 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:33:32.489432 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1285/2547] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 13 15:33:32 2022] POST /identity/v3/projects => generated 387 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:33:32.493984 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5152e604-3b3c-4415-9467-b1200d5a100f admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:33:32.504861 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5152e604-3b3c-4415-9467-b1200d5a100f admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:33:32.508381 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:33:32.564355 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a51b46-b887-42e7-8a8d-f56db0fdbee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:33:32.566025 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a51b46-b887-42e7-8a8d-f56db0fdbee9 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:33:32.566424 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a51b46-b887-42e7-8a8d-f56db0fdbee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:33:32.566703 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a51b46-b887-42e7-8a8d-f56db0fdbee9 admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:33:32.567388 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a51b46-b887-42e7-8a8d-f56db0fdbee9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:33:32.569320 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a51b46-b887-42e7-8a8d-f56db0fdbee9 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:33:32.591821 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1263/2548] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 13 15:33:32 2022] POST /identity/v3/users => generated 294 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:33:32.595827 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33ecb68-59b5-447c-b0fa-d5eed67f2047 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:33:32.606491 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33ecb68-59b5-447c-b0fa-d5eed67f2047 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:33:32.611188 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fad6828-e556-425d-b54c-86efbf1c3af1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:33:32.611962 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fad6828-e556-425d-b54c-86efbf1c3af1 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:33:32.612262 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fad6828-e556-425d-b54c-86efbf1c3af1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:33:32.612636 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fad6828-e556-425d-b54c-86efbf1c3af1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:33:32.613284 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fad6828-e556-425d-b54c-86efbf1c3af1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:33:32.614934 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fad6828-e556-425d-b54c-86efbf1c3af1 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:33:32.625232 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1286/2549] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:33:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 15:33:32.629863 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a51b46-b887-42e7-8a8d-f56db0fdbee9 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:33:32.639832 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a51b46-b887-42e7-8a8d-f56db0fdbee9 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:33:32.645254 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0715a849-0f3a-4cc1-b8ca-89dd11f56245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:33:32.646078 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0715a849-0f3a-4cc1-b8ca-89dd11f56245 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:33:32.646363 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0715a849-0f3a-4cc1-b8ca-89dd11f56245 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:33:32.646690 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0715a849-0f3a-4cc1-b8ca-89dd11f56245 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:33:32.647424 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0715a849-0f3a-4cc1-b8ca-89dd11f56245 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:33:32.649007 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0715a849-0f3a-4cc1-b8ca-89dd11f56245 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:33:32.660064 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1264/2550] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:33:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 15:33:32.664472 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fad6828-e556-425d-b54c-86efbf1c3af1 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:33:32.675033 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fad6828-e556-425d-b54c-86efbf1c3af1 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:33:32.679978 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a980c1-d0ea-4a98-8f0c-301d5753ab82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:33:32.680639 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a980c1-d0ea-4a98-8f0c-301d5753ab82 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:33:32.680926 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a980c1-d0ea-4a98-8f0c-301d5753ab82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:33:32.681199 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a980c1-d0ea-4a98-8f0c-301d5753ab82 admin admin] PATH_INFO: `/v3/projects/716964a4c18745b0b650752d01a8e14e/users/fc1649ee0b274411aec5c7cd993b4e95/roles/3fae3d3a28e147d3b2bede2378ff79ae` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:33:32.696717 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a980c1-d0ea-4a98-8f0c-301d5753ab82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=716964a4c18745b0b650752d01a8e14e, user_id=fc1649ee0b274411aec5c7cd993b4e95, role_id=3fae3d3a28e147d3b2bede2378ff79ae)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:33:32.699458 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a980c1-d0ea-4a98-8f0c-301d5753ab82 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:33:32.718518 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1287/2551] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 13 15:33:32 2022] PUT /identity/v3/projects/716964a4c18745b0b650752d01a8e14e/users/fc1649ee0b274411aec5c7cd993b4e95/roles/3fae3d3a28e147d3b2bede2378ff79ae => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:33:32.724162 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540978ae-6245-49a6-a603-042b39ba76a8 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:33:32.724449 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540978ae-6245-49a6-a603-042b39ba76a8 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:33:32.724723 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540978ae-6245-49a6-a603-042b39ba76a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:33:32.744079 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-540978ae-6245-49a6-a603-042b39ba76a8 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:33:32.745281 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-540978ae-6245-49a6-a603-042b39ba76a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:33:32.808084 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1265/2552] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:33:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:33:32.818692 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a980c1-d0ea-4a98-8f0c-301d5753ab82 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:33:32.820689 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-69a980c1-d0ea-4a98-8f0c-301d5753ab82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:33:32.852788 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:33:32.882962 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a980c1-d0ea-4a98-8f0c-301d5753ab82 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:33:32.886621 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971c1fed-0f88-42a4-a0e3-c6ebbf971218 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41675154bbba47388040966f75d84c3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:33:32.887225 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971c1fed-0f88-42a4-a0e3-c6ebbf971218 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:33:32.887502 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971c1fed-0f88-42a4-a0e3-c6ebbf971218 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:33:32.887780 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971c1fed-0f88-42a4-a0e3-c6ebbf971218 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:33:32.897304 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971c1fed-0f88-42a4-a0e3-c6ebbf971218 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:33:32.898769 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971c1fed-0f88-42a4-a0e3-c6ebbf971218 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:33:32.908767 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1288/2553] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:33:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:33:37.724049 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ed22ca-63e8-47e3-ab95-a9e2a80a73d7 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:33:37.724628 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ed22ca-63e8-47e3-ab95-a9e2a80a73d7 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:33:37.724628 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ed22ca-63e8-47e3-ab95-a9e2a80a73d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:33:37.760288 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-43ed22ca-63e8-47e3-ab95-a9e2a80a73d7 None None] MFA Rules not processed for user `fc1649ee0b274411aec5c7cd993b4e95`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:33:37.762016 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-43ed22ca-63e8-47e3-ab95-a9e2a80a73d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:33:37.869490 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1266/2554] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:33:37 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:33:37.884746 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971c1fed-0f88-42a4-a0e3-c6ebbf971218 service neutron] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:33:37.886196 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-971c1fed-0f88-42a4-a0e3-c6ebbf971218 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:33:38.007278 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971c1fed-0f88-42a4-a0e3-c6ebbf971218 service neutron] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:33:38.014758 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f895bf-d9be-43ca-9853-d40849039851 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62aad71c6c1a4469805762bba330bf0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:33:38.015385 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f895bf-d9be-43ca-9853-d40849039851 service nova] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:33:38.015676 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f895bf-d9be-43ca-9853-d40849039851 service nova] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:33:38.015955 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f895bf-d9be-43ca-9853-d40849039851 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:33:38.026108 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f895bf-d9be-43ca-9853-d40849039851 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:33:38.027905 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f895bf-d9be-43ca-9853-d40849039851 service nova] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:33:38.041195 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1289/2555] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:33:37 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:33:39.344800 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585e8779-e2ff-4854-abae-9a5f04694d02 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:33:39.345316 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585e8779-e2ff-4854-abae-9a5f04694d02 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:33:39.345316 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585e8779-e2ff-4854-abae-9a5f04694d02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:33:39.364587 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-585e8779-e2ff-4854-abae-9a5f04694d02 None None] MFA Rules not processed for user `fc1649ee0b274411aec5c7cd993b4e95`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:33:39.365818 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-585e8779-e2ff-4854-abae-9a5f04694d02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:33:39.372532 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1267/2556] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:33:39 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:33:42.812860 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7567d32-4100-4241-baae-e4cfa5b36182 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:33:42.813349 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7567d32-4100-4241-baae-e4cfa5b36182 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:33:42.813765 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7567d32-4100-4241-baae-e4cfa5b36182 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:33:42.835026 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-c7567d32-4100-4241-baae-e4cfa5b36182 None None] MFA Rules not processed for user `e97bcdb20f1e416ea41b99c226617faf`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:33:42.836333 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-c7567d32-4100-4241-baae-e4cfa5b36182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:33:42.894064 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1290/2557] 10.222.0.27 () {58 vars in 967 bytes} [Tue Sep 13 15:33:42 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:33:42.949898 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585e8779-e2ff-4854-abae-9a5f04694d02 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:33:42.951602 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-585e8779-e2ff-4854-abae-9a5f04694d02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:33:42.964213 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:33:43.023998 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585e8779-e2ff-4854-abae-9a5f04694d02 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:33:43.028986 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bf0797-eae3-4725-9509-ab14211731cc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc735644be394e0abe73e709373e2003', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:33:43.029596 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bf0797-eae3-4725-9509-ab14211731cc service swift] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:33:43.029906 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bf0797-eae3-4725-9509-ab14211731cc service swift] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:33:43.030176 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bf0797-eae3-4725-9509-ab14211731cc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:33:43.041046 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bf0797-eae3-4725-9509-ab14211731cc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:33:43.042669 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bf0797-eae3-4725-9509-ab14211731cc service swift] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:33:43.052307 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1268/2558] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Sep 13 15:33:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 15:33:50.310637 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7567d32-4100-4241-baae-e4cfa5b36182 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:33:50.312731 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-c7567d32-4100-4241-baae-e4cfa5b36182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:33:50.325381 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7567d32-4100-4241-baae-e4cfa5b36182 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:33:50.330866 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c354d2b1-2370-4e2e-9094-a216585f6046 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41675154bbba47388040966f75d84c3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:33:50.331517 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c354d2b1-2370-4e2e-9094-a216585f6046 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:33:50.331873 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c354d2b1-2370-4e2e-9094-a216585f6046 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:33:50.332990 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c354d2b1-2370-4e2e-9094-a216585f6046 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:33:50.336007 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-c354d2b1-2370-4e2e-9094-a216585f6046 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:33:50.356390 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c354d2b1-2370-4e2e-9094-a216585f6046 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:33:50.358049 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c354d2b1-2370-4e2e-9094-a216585f6046 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:33:50.371487 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1291/2559] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:33:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:33:50.493393 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bf0797-eae3-4725-9509-ab14211731cc service swift] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:33:50.495643 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-f1bf0797-eae3-4725-9509-ab14211731cc service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:33:50.518991 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bf0797-eae3-4725-9509-ab14211731cc service swift] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:33:50.524545 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2fb6d8-8461-43a2-b90d-beae489150f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:33:50.525248 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2fb6d8-8461-43a2-b90d-beae489150f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:33:50.525599 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2fb6d8-8461-43a2-b90d-beae489150f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:33:50.526087 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2fb6d8-8461-43a2-b90d-beae489150f9 admin admin] PATH_INFO: `/v3/users/33164e89b34a4b3d8ce3abfd6e55628d` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:33:50.527403 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2fb6d8-8461-43a2-b90d-beae489150f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=33164e89b34a4b3d8ce3abfd6e55628d)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:33:50.529368 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2fb6d8-8461-43a2-b90d-beae489150f9 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:33:50.580627 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-0b2fb6d8-8461-43a2-b90d-beae489150f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33164e89b34a4b3d8ce3abfd6e55628d'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:33:50.581280 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-0b2fb6d8-8461-43a2-b90d-beae489150f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33164e89b34a4b3d8ce3abfd6e55628d'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:33:50.582053 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-0b2fb6d8-8461-43a2-b90d-beae489150f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33164e89b34a4b3d8ce3abfd6e55628d'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:33:50.589659 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-0b2fb6d8-8461-43a2-b90d-beae489150f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33164e89b34a4b3d8ce3abfd6e55628d'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:33:50.590936 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c354d2b1-2370-4e2e-9094-a216585f6046 service neutron] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:33:50.601424 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c354d2b1-2370-4e2e-9094-a216585f6046 service neutron] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:33:50.605432 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbdd17e-0cf1-42c3-a853-af49eea31b75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41675154bbba47388040966f75d84c3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:33:50.605682 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-0b2fb6d8-8461-43a2-b90d-beae489150f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33164e89b34a4b3d8ce3abfd6e55628d'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:33:50.606547 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbdd17e-0cf1-42c3-a853-af49eea31b75 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:33:50.606917 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbdd17e-0cf1-42c3-a853-af49eea31b75 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:33:50.607398 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbdd17e-0cf1-42c3-a853-af49eea31b75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:33:50.609327 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-2fbdd17e-0cf1-42c3-a853-af49eea31b75 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:33:50.619160 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1269/2560] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 13 15:33:50 2022] DELETE /identity/v3/users/33164e89b34a4b3d8ce3abfd6e55628d => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:33:50.625207 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbdd17e-0cf1-42c3-a853-af49eea31b75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:33:50.626834 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbdd17e-0cf1-42c3-a853-af49eea31b75 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:33:50.638418 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1292/2561] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:33:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 15:33:50.804285 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2fb6d8-8461-43a2-b90d-beae489150f9 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:33:50.806032 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-0b2fb6d8-8461-43a2-b90d-beae489150f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:33:50.879702 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2fb6d8-8461-43a2-b90d-beae489150f9 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:33:50.884255 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1775de3-50bb-40dd-8b7f-c13f292d27c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:33:50.884890 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1775de3-50bb-40dd-8b7f-c13f292d27c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:33:50.885174 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1775de3-50bb-40dd-8b7f-c13f292d27c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:33:50.885454 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1775de3-50bb-40dd-8b7f-c13f292d27c7 admin admin] PATH_INFO: `/v3/projects/e256212fe6a14fc58293ed09dfc02cd8` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:33:50.886707 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1775de3-50bb-40dd-8b7f-c13f292d27c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e256212fe6a14fc58293ed09dfc02cd8)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:33:50.888672 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1775de3-50bb-40dd-8b7f-c13f292d27c7 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:33:50.901073 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:33:50.942857 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-d1775de3-50bb-40dd-8b7f-c13f292d27c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e256212fe6a14fc58293ed09dfc02cd8', 'request_id': 'req-d1775de3-50bb-40dd-8b7f-c13f292d27c7'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:33:50.949243 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-d1775de3-50bb-40dd-8b7f-c13f292d27c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e256212fe6a14fc58293ed09dfc02cd8', 'request_id': 'req-d1775de3-50bb-40dd-8b7f-c13f292d27c7'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:33:50.956307 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-d1775de3-50bb-40dd-8b7f-c13f292d27c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e256212fe6a14fc58293ed09dfc02cd8', 'request_id': 'req-d1775de3-50bb-40dd-8b7f-c13f292d27c7'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:33:50.969289 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-d1775de3-50bb-40dd-8b7f-c13f292d27c7 admin admin] The token cache is being invalidate because project e256212fe6a14fc58293ed09dfc02cd8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 15:33:50.969667 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-d1775de3-50bb-40dd-8b7f-c13f292d27c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:33:50.971091 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-d1775de3-50bb-40dd-8b7f-c13f292d27c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:33:50.972744 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1270/2562] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 13 15:33:50 2022] DELETE /identity/v3/projects/e256212fe6a14fc58293ed09dfc02cd8 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:33:50.976969 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbdd17e-0cf1-42c3-a853-af49eea31b75 service neutron] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:33:50.987683 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbdd17e-0cf1-42c3-a853-af49eea31b75 service neutron] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:33:51.021049 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:33:51.050105 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a210cc7f-6e0f-4935-98d1-2c245c199c7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:33:51.050748 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a210cc7f-6e0f-4935-98d1-2c245c199c7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:33:51.051033 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a210cc7f-6e0f-4935-98d1-2c245c199c7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:33:51.051313 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a210cc7f-6e0f-4935-98d1-2c245c199c7d admin admin] PATH_INFO: `/v3/users/da627e5102594c67b740da1fd5ea3b9e` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:33:51.052467 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a210cc7f-6e0f-4935-98d1-2c245c199c7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=da627e5102594c67b740da1fd5ea3b9e)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:33:51.054652 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a210cc7f-6e0f-4935-98d1-2c245c199c7d admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:33:51.109233 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-a210cc7f-6e0f-4935-98d1-2c245c199c7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da627e5102594c67b740da1fd5ea3b9e'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:33:51.109951 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-a210cc7f-6e0f-4935-98d1-2c245c199c7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da627e5102594c67b740da1fd5ea3b9e'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:33:51.110872 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-a210cc7f-6e0f-4935-98d1-2c245c199c7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da627e5102594c67b740da1fd5ea3b9e'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:33:51.119503 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-a210cc7f-6e0f-4935-98d1-2c245c199c7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da627e5102594c67b740da1fd5ea3b9e'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:33:51.132906 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-a210cc7f-6e0f-4935-98d1-2c245c199c7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da627e5102594c67b740da1fd5ea3b9e'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:33:51.146846 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1293/2563] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 13 15:33:50 2022] DELETE /identity/v3/users/da627e5102594c67b740da1fd5ea3b9e => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:33:51.394130 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1775de3-50bb-40dd-8b7f-c13f292d27c7 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:33:51.395611 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-d1775de3-50bb-40dd-8b7f-c13f292d27c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:33:51.409458 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1775de3-50bb-40dd-8b7f-c13f292d27c7 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:33:51.473568 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57559ac-106a-479a-bb12-52492b2b5537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:33:51.474555 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57559ac-106a-479a-bb12-52492b2b5537 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:33:51.474840 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57559ac-106a-479a-bb12-52492b2b5537 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:33:51.475120 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57559ac-106a-479a-bb12-52492b2b5537 admin admin] PATH_INFO: `/v3/projects/747bfefebb41450987615772826ed049` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:33:51.476313 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57559ac-106a-479a-bb12-52492b2b5537 admin admin] RBAC: Authorizing `identity:delete_project(project_id=747bfefebb41450987615772826ed049)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:33:51.478263 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57559ac-106a-479a-bb12-52492b2b5537 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:33:51.530593 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-a57559ac-106a-479a-bb12-52492b2b5537 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '747bfefebb41450987615772826ed049', 'request_id': 'req-a57559ac-106a-479a-bb12-52492b2b5537'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:33:51.537271 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-a57559ac-106a-479a-bb12-52492b2b5537 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '747bfefebb41450987615772826ed049', 'request_id': 'req-a57559ac-106a-479a-bb12-52492b2b5537'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:33:51.542900 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-a57559ac-106a-479a-bb12-52492b2b5537 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '747bfefebb41450987615772826ed049', 'request_id': 'req-a57559ac-106a-479a-bb12-52492b2b5537'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:33:51.557790 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-a57559ac-106a-479a-bb12-52492b2b5537 admin admin] The token cache is being invalidate because project 747bfefebb41450987615772826ed049 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 15:33:51.558080 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-a57559ac-106a-479a-bb12-52492b2b5537 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:33:51.558714 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-a57559ac-106a-479a-bb12-52492b2b5537 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:33:51.560893 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1271/2564] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 13 15:33:51 2022] DELETE /identity/v3/projects/747bfefebb41450987615772826ed049 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:34:01.142157 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=38,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:34:01.554371 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=70,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:34:01.811939 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a210cc7f-6e0f-4935-98d1-2c245c199c7d admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:34:01.813340 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-a210cc7f-6e0f-4935-98d1-2c245c199c7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:34:01.871165 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a210cc7f-6e0f-4935-98d1-2c245c199c7d admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:34:01.917806 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d7c1e2-cf26-45af-a72f-09db419bc1d5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97acd23097d54bf7805c3cef60626ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:34:01.918412 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d7c1e2-cf26-45af-a72f-09db419bc1d5 service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:34:01.918694 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d7c1e2-cf26-45af-a72f-09db419bc1d5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:34:01.918968 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d7c1e2-cf26-45af-a72f-09db419bc1d5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:34:01.920702 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-49d7c1e2-cf26-45af-a72f-09db419bc1d5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:34:01.977568 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d7c1e2-cf26-45af-a72f-09db419bc1d5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:34:01.979036 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d7c1e2-cf26-45af-a72f-09db419bc1d5 service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:34:01.988841 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1294/2565] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:34:01 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:34:11.983791 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=68 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:34:12.876529 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57559ac-106a-479a-bb12-52492b2b5537 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:34:12.878598 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-a57559ac-106a-479a-bb12-52492b2b5537 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:34:12.936205 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57559ac-106a-479a-bb12-52492b2b5537 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:34:12.939808 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babd6cd8-b68d-4ee4-aafd-e52cfbf2f93f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41675154bbba47388040966f75d84c3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:34:12.940499 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babd6cd8-b68d-4ee4-aafd-e52cfbf2f93f service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:34:12.940789 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babd6cd8-b68d-4ee4-aafd-e52cfbf2f93f service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:34:12.941062 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babd6cd8-b68d-4ee4-aafd-e52cfbf2f93f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:34:12.942871 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-babd6cd8-b68d-4ee4-aafd-e52cfbf2f93f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:34:13.005892 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babd6cd8-b68d-4ee4-aafd-e52cfbf2f93f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:34:13.007228 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babd6cd8-b68d-4ee4-aafd-e52cfbf2f93f service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:34:13.016823 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1272/2566] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:34:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:34:16.226800 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d7c1e2-cf26-45af-a72f-09db419bc1d5 service cinder] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:34:16.228418 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-49d7c1e2-cf26-45af-a72f-09db419bc1d5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:34:16.243087 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d7c1e2-cf26-45af-a72f-09db419bc1d5 service cinder] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:34:16.247794 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f599178-b925-4c5c-952e-15e7860e9eb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:34:16.248496 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f599178-b925-4c5c-952e-15e7860e9eb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:34:16.248840 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f599178-b925-4c5c-952e-15e7860e9eb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:34:16.249181 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f599178-b925-4c5c-952e-15e7860e9eb3 admin admin] PATH_INFO: `/v3/users/7fe1e310cd5b4506bc6e10a2f5742cbb` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:34:16.250334 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f599178-b925-4c5c-952e-15e7860e9eb3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7fe1e310cd5b4506bc6e10a2f5742cbb)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:34:16.252266 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f599178-b925-4c5c-952e-15e7860e9eb3 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:34:16.301841 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-5f599178-b925-4c5c-952e-15e7860e9eb3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7fe1e310cd5b4506bc6e10a2f5742cbb'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:34:16.302426 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-5f599178-b925-4c5c-952e-15e7860e9eb3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7fe1e310cd5b4506bc6e10a2f5742cbb'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:34:16.303039 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-5f599178-b925-4c5c-952e-15e7860e9eb3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7fe1e310cd5b4506bc6e10a2f5742cbb'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:34:16.310030 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-5f599178-b925-4c5c-952e-15e7860e9eb3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7fe1e310cd5b4506bc6e10a2f5742cbb'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:34:16.322851 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-5f599178-b925-4c5c-952e-15e7860e9eb3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7fe1e310cd5b4506bc6e10a2f5742cbb'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:34:16.335920 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1295/2567] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 13 15:34:16 2022] DELETE /identity/v3/users/7fe1e310cd5b4506bc6e10a2f5742cbb => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:34:16.507354 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babd6cd8-b68d-4ee4-aafd-e52cfbf2f93f service neutron] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:34:16.519697 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babd6cd8-b68d-4ee4-aafd-e52cfbf2f93f service neutron] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:34:16.576947 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd43cd7-1392-4079-8edf-87f0516cecf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:34:16.577493 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd43cd7-1392-4079-8edf-87f0516cecf0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:34:16.577797 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd43cd7-1392-4079-8edf-87f0516cecf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:34:16.578071 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd43cd7-1392-4079-8edf-87f0516cecf0 admin admin] PATH_INFO: `/v3/projects/ea3cda7ada374a97826b076da1592cab` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:34:16.579165 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd43cd7-1392-4079-8edf-87f0516cecf0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea3cda7ada374a97826b076da1592cab)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:34:16.581894 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd43cd7-1392-4079-8edf-87f0516cecf0 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:34:16.626365 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-2cd43cd7-1392-4079-8edf-87f0516cecf0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea3cda7ada374a97826b076da1592cab', 'request_id': 'req-2cd43cd7-1392-4079-8edf-87f0516cecf0'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:34:16.628801 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:34:16.633309 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-2cd43cd7-1392-4079-8edf-87f0516cecf0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea3cda7ada374a97826b076da1592cab', 'request_id': 'req-2cd43cd7-1392-4079-8edf-87f0516cecf0'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:34:16.639634 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-2cd43cd7-1392-4079-8edf-87f0516cecf0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea3cda7ada374a97826b076da1592cab', 'request_id': 'req-2cd43cd7-1392-4079-8edf-87f0516cecf0'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:34:16.652718 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-2cd43cd7-1392-4079-8edf-87f0516cecf0 admin admin] The token cache is being invalidate because project ea3cda7ada374a97826b076da1592cab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 15:34:16.653007 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-2cd43cd7-1392-4079-8edf-87f0516cecf0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:34:16.653620 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-2cd43cd7-1392-4079-8edf-87f0516cecf0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:34:16.655175 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1273/2568] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 13 15:34:16 2022] DELETE /identity/v3/projects/ea3cda7ada374a97826b076da1592cab => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:34:16.660314 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e7e8a2-22d5-43b6-a915-493d4ee44704 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:34:16.660602 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e7e8a2-22d5-43b6-a915-493d4ee44704 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:34:16.660879 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e7e8a2-22d5-43b6-a915-493d4ee44704 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:34:16.680371 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-c4e7e8a2-22d5-43b6-a915-493d4ee44704 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:34:16.681575 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-c4e7e8a2-22d5-43b6-a915-493d4ee44704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:34:16.751083 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1296/2569] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:34:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:34:16.760041 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a01d9e-8261-4cf6-8e3a-f07c72b270d5 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:34:16.760355 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a01d9e-8261-4cf6-8e3a-f07c72b270d5 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:34:16.760657 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a01d9e-8261-4cf6-8e3a-f07c72b270d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:34:16.780573 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-a5a01d9e-8261-4cf6-8e3a-f07c72b270d5 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:34:16.781823 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-a5a01d9e-8261-4cf6-8e3a-f07c72b270d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:34:16.792295 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1274/2570] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:34:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:34:16.797482 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e7e8a2-22d5-43b6-a915-493d4ee44704 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:34:16.808066 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e7e8a2-22d5-43b6-a915-493d4ee44704 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:34:16.812669 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f805063-ae2d-499b-a683-1e1f5306b5cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:34:16.813276 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f805063-ae2d-499b-a683-1e1f5306b5cb admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:34:16.813561 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f805063-ae2d-499b-a683-1e1f5306b5cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:34:16.813875 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f805063-ae2d-499b-a683-1e1f5306b5cb admin admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:34:16.814524 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f805063-ae2d-499b-a683-1e1f5306b5cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:34:16.814832 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f805063-ae2d-499b-a683-1e1f5306b5cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:34:16.816434 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f805063-ae2d-499b-a683-1e1f5306b5cb admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:34:16.828218 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1297/2571] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Sep 13 15:34:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:34:16.832992 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a01d9e-8261-4cf6-8e3a-f07c72b270d5 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:34:16.842246 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a01d9e-8261-4cf6-8e3a-f07c72b270d5 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:34:16.847589 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88b87ca-7690-491e-b86e-c6a8b741f5d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:34:16.848185 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88b87ca-7690-491e-b86e-c6a8b741f5d2 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:34:16.848467 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88b87ca-7690-491e-b86e-c6a8b741f5d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:34:16.848743 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88b87ca-7690-491e-b86e-c6a8b741f5d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:34:16.849384 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88b87ca-7690-491e-b86e-c6a8b741f5d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:34:16.851317 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88b87ca-7690-491e-b86e-c6a8b741f5d2 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:34:16.878394 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1275/2572] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 13 15:34:16 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:34:16.882614 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f805063-ae2d-499b-a683-1e1f5306b5cb admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:34:16.892504 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f805063-ae2d-499b-a683-1e1f5306b5cb admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:34:16.951182 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9256122-0c45-47ce-9097-06d0082b8d85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:34:16.951995 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9256122-0c45-47ce-9097-06d0082b8d85 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:34:16.952333 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9256122-0c45-47ce-9097-06d0082b8d85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:34:16.952609 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9256122-0c45-47ce-9097-06d0082b8d85 admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:34:16.953241 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9256122-0c45-47ce-9097-06d0082b8d85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:34:16.955296 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9256122-0c45-47ce-9097-06d0082b8d85 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:34:16.963841 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:34:16.979140 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1298/2573] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 13 15:34:16 2022] POST /identity/v3/users => generated 287 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:34:16.983321 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88b87ca-7690-491e-b86e-c6a8b741f5d2 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:34:16.994572 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88b87ca-7690-491e-b86e-c6a8b741f5d2 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:34:16.999291 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26c4412-6223-4b2f-a750-c819f2171448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:34:16.999859 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26c4412-6223-4b2f-a750-c819f2171448 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:34:17.000147 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26c4412-6223-4b2f-a750-c819f2171448 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:34:17.000420 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26c4412-6223-4b2f-a750-c819f2171448 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:34:17.001087 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26c4412-6223-4b2f-a750-c819f2171448 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:34:17.002717 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26c4412-6223-4b2f-a750-c819f2171448 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:34:17.012506 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1276/2574] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:34:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 15:34:17.016462 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9256122-0c45-47ce-9097-06d0082b8d85 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:34:17.027142 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9256122-0c45-47ce-9097-06d0082b8d85 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:34:17.031821 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9377a8cd-b24e-470a-afef-fa3528860e17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:34:17.032417 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9377a8cd-b24e-470a-afef-fa3528860e17 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:34:17.032708 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9377a8cd-b24e-470a-afef-fa3528860e17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:34:17.032991 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9377a8cd-b24e-470a-afef-fa3528860e17 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:34:17.033631 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9377a8cd-b24e-470a-afef-fa3528860e17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:34:17.035836 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9377a8cd-b24e-470a-afef-fa3528860e17 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:34:17.046454 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1299/2575] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:34:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 15:34:17.051393 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26c4412-6223-4b2f-a750-c819f2171448 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:34:17.061308 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26c4412-6223-4b2f-a750-c819f2171448 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:34:17.066919 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43489e06-c688-4b7c-a646-dab3cd0f3640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:34:17.067569 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43489e06-c688-4b7c-a646-dab3cd0f3640 admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:34:17.067857 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43489e06-c688-4b7c-a646-dab3cd0f3640 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:34:17.068137 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43489e06-c688-4b7c-a646-dab3cd0f3640 admin admin] PATH_INFO: `/v3/projects/3adec692d3b043d5a4aabeaff160bf30/users/e89a3f4390da4ee8ab6f7b9d69beca14/roles/3fae3d3a28e147d3b2bede2378ff79ae` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:34:17.083135 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43489e06-c688-4b7c-a646-dab3cd0f3640 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3adec692d3b043d5a4aabeaff160bf30, user_id=e89a3f4390da4ee8ab6f7b9d69beca14, role_id=3fae3d3a28e147d3b2bede2378ff79ae)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:34:17.085674 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43489e06-c688-4b7c-a646-dab3cd0f3640 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:34:17.098726 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1277/2576] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 13 15:34:17 2022] PUT /identity/v3/projects/3adec692d3b043d5a4aabeaff160bf30/users/e89a3f4390da4ee8ab6f7b9d69beca14/roles/3fae3d3a28e147d3b2bede2378ff79ae => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:34:17.108836 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3451caa0-2a90-4fa5-bd2b-0274c3929dba None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:34:17.109131 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3451caa0-2a90-4fa5-bd2b-0274c3929dba None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:34:17.109416 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3451caa0-2a90-4fa5-bd2b-0274c3929dba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:34:17.138802 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-3451caa0-2a90-4fa5-bd2b-0274c3929dba None None] MFA Rules not processed for user `e89a3f4390da4ee8ab6f7b9d69beca14`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:34:17.140263 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-3451caa0-2a90-4fa5-bd2b-0274c3929dba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:34:17.203348 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1300/2577] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:34:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:34:17.216849 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43489e06-c688-4b7c-a646-dab3cd0f3640 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:34:17.218578 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-43489e06-c688-4b7c-a646-dab3cd0f3640 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:34:17.313535 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43489e06-c688-4b7c-a646-dab3cd0f3640 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:34:17.319376 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57d1c0f-0b6c-4235-beca-b3e005739b3f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62aad71c6c1a4469805762bba330bf0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:34:17.319987 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57d1c0f-0b6c-4235-beca-b3e005739b3f service nova] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:34:17.320263 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57d1c0f-0b6c-4235-beca-b3e005739b3f service nova] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:34:17.320536 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57d1c0f-0b6c-4235-beca-b3e005739b3f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:34:17.328434 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57d1c0f-0b6c-4235-beca-b3e005739b3f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:34:17.330031 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57d1c0f-0b6c-4235-beca-b3e005739b3f service nova] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:34:17.339470 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1278/2578] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:34:17 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 15:34:20.013751 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3451caa0-2a90-4fa5-bd2b-0274c3929dba None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:34:20.074655 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3451caa0-2a90-4fa5-bd2b-0274c3929dba None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:34:20.079529 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f95a006-5c4d-44ad-aecb-f04e7f3c43a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:34:20.080162 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f95a006-5c4d-44ad-aecb-f04e7f3c43a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:34:20.080442 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f95a006-5c4d-44ad-aecb-f04e7f3c43a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:34:20.080761 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f95a006-5c4d-44ad-aecb-f04e7f3c43a6 admin admin] PATH_INFO: `/v3/users/e89a3f4390da4ee8ab6f7b9d69beca14` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:34:20.081939 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f95a006-5c4d-44ad-aecb-f04e7f3c43a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e89a3f4390da4ee8ab6f7b9d69beca14)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:34:20.083866 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f95a006-5c4d-44ad-aecb-f04e7f3c43a6 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:34:20.130815 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-0f95a006-5c4d-44ad-aecb-f04e7f3c43a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e89a3f4390da4ee8ab6f7b9d69beca14'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:34:20.131471 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-0f95a006-5c4d-44ad-aecb-f04e7f3c43a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e89a3f4390da4ee8ab6f7b9d69beca14'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:34:20.132084 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-0f95a006-5c4d-44ad-aecb-f04e7f3c43a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e89a3f4390da4ee8ab6f7b9d69beca14'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:34:20.139099 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-0f95a006-5c4d-44ad-aecb-f04e7f3c43a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e89a3f4390da4ee8ab6f7b9d69beca14'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:34:20.149381 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:INSERT=3,keystone:SELECT=89,keystone:DELETE=8 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:34:20.151900 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-0f95a006-5c4d-44ad-aecb-f04e7f3c43a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e89a3f4390da4ee8ab6f7b9d69beca14'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:34:20.165539 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1301/2579] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 13 15:34:20 2022] DELETE /identity/v3/users/e89a3f4390da4ee8ab6f7b9d69beca14 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:34:20.170027 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266bac68-91ef-4e0e-8ed2-6c6a151f1887 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:34:20.170555 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266bac68-91ef-4e0e-8ed2-6c6a151f1887 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:34:20.170665 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266bac68-91ef-4e0e-8ed2-6c6a151f1887 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:34:20.189857 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-266bac68-91ef-4e0e-8ed2-6c6a151f1887 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:34:20.191756 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-266bac68-91ef-4e0e-8ed2-6c6a151f1887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:34:20.249348 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1279/2580] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:34:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:34:20.260172 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f95a006-5c4d-44ad-aecb-f04e7f3c43a6 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:34:20.261654 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-0f95a006-5c4d-44ad-aecb-f04e7f3c43a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:34:20.320617 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f95a006-5c4d-44ad-aecb-f04e7f3c43a6 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:34:20.324391 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5db2c6-fc8e-473c-9422-e9b1b1e23aca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41675154bbba47388040966f75d84c3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:34:20.325003 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5db2c6-fc8e-473c-9422-e9b1b1e23aca service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:34:20.325538 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5db2c6-fc8e-473c-9422-e9b1b1e23aca service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:34:20.325873 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5db2c6-fc8e-473c-9422-e9b1b1e23aca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:34:20.335480 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5db2c6-fc8e-473c-9422-e9b1b1e23aca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:34:20.336912 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5db2c6-fc8e-473c-9422-e9b1b1e23aca service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:34:20.346789 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1302/2581] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:34:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:34:20.619835 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266bac68-91ef-4e0e-8ed2-6c6a151f1887 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:34:20.621389 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-266bac68-91ef-4e0e-8ed2-6c6a151f1887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:34:20.630858 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=94,keystone:DELETE=3,keystone:INSERT=3 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:34:20.648036 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266bac68-91ef-4e0e-8ed2-6c6a151f1887 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:34:20.653953 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbe2ae0-d0ac-4e4e-9526-ef52e3147c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:34:20.654567 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbe2ae0-d0ac-4e4e-9526-ef52e3147c40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:34:20.654854 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbe2ae0-d0ac-4e4e-9526-ef52e3147c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:34:20.655169 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbe2ae0-d0ac-4e4e-9526-ef52e3147c40 admin admin] PATH_INFO: `/v3/projects/3adec692d3b043d5a4aabeaff160bf30` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:34:20.656321 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbe2ae0-d0ac-4e4e-9526-ef52e3147c40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3adec692d3b043d5a4aabeaff160bf30)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:34:20.658299 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbe2ae0-d0ac-4e4e-9526-ef52e3147c40 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:34:20.712310 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-9dbe2ae0-d0ac-4e4e-9526-ef52e3147c40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3adec692d3b043d5a4aabeaff160bf30', 'request_id': 'req-9dbe2ae0-d0ac-4e4e-9526-ef52e3147c40'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:34:20.720354 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-9dbe2ae0-d0ac-4e4e-9526-ef52e3147c40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3adec692d3b043d5a4aabeaff160bf30', 'request_id': 'req-9dbe2ae0-d0ac-4e4e-9526-ef52e3147c40'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:34:20.726494 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-9dbe2ae0-d0ac-4e4e-9526-ef52e3147c40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3adec692d3b043d5a4aabeaff160bf30', 'request_id': 'req-9dbe2ae0-d0ac-4e4e-9526-ef52e3147c40'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:34:20.746022 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-9dbe2ae0-d0ac-4e4e-9526-ef52e3147c40 admin admin] The token cache is being invalidate because project 3adec692d3b043d5a4aabeaff160bf30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 15:34:20.746146 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-9dbe2ae0-d0ac-4e4e-9526-ef52e3147c40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:34:20.747036 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-9dbe2ae0-d0ac-4e4e-9526-ef52e3147c40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:34:20.749818 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1280/2582] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 13 15:34:20 2022] DELETE /identity/v3/projects/3adec692d3b043d5a4aabeaff160bf30 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:34:20.756042 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fbb11b-f9bc-46a1-bf5b-02ecd21579d3 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:34:20.756042 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fbb11b-f9bc-46a1-bf5b-02ecd21579d3 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:34:20.756318 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fbb11b-f9bc-46a1-bf5b-02ecd21579d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:34:20.778245 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-a8fbb11b-f9bc-46a1-bf5b-02ecd21579d3 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:34:20.779474 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-a8fbb11b-f9bc-46a1-bf5b-02ecd21579d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:34:20.841851 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1303/2583] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:34:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:34:20.849863 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ac383a-5798-4bc6-a243-839cbef01153 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:34:20.850154 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ac383a-5798-4bc6-a243-839cbef01153 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:34:20.850433 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ac383a-5798-4bc6-a243-839cbef01153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:34:20.872310 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-30ac383a-5798-4bc6-a243-839cbef01153 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:34:20.873898 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-30ac383a-5798-4bc6-a243-839cbef01153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:34:20.883606 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1281/2584] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:34:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:34:20.887875 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fbb11b-f9bc-46a1-bf5b-02ecd21579d3 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:34:20.898322 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fbb11b-f9bc-46a1-bf5b-02ecd21579d3 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:34:20.911243 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966079fc-d571-4741-9009-57fd2a8597ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:34:20.911923 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966079fc-d571-4741-9009-57fd2a8597ab admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:34:20.912285 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966079fc-d571-4741-9009-57fd2a8597ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:34:20.912760 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966079fc-d571-4741-9009-57fd2a8597ab admin admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:34:20.913405 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966079fc-d571-4741-9009-57fd2a8597ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:34:20.913990 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966079fc-d571-4741-9009-57fd2a8597ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:34:20.917558 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966079fc-d571-4741-9009-57fd2a8597ab admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:34:20.930533 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1304/2585] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Sep 13 15:34:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:34:20.935150 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ac383a-5798-4bc6-a243-839cbef01153 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:34:20.945140 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ac383a-5798-4bc6-a243-839cbef01153 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:34:20.950008 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0e86a2-6bc8-4a54-9585-eb13fb417149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:34:20.951092 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0e86a2-6bc8-4a54-9585-eb13fb417149 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:34:20.951367 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0e86a2-6bc8-4a54-9585-eb13fb417149 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:34:20.951635 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0e86a2-6bc8-4a54-9585-eb13fb417149 admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:34:20.952257 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0e86a2-6bc8-4a54-9585-eb13fb417149 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:34:20.954213 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0e86a2-6bc8-4a54-9585-eb13fb417149 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:34:20.980386 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1282/2586] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 13 15:34:20 2022] POST /identity/v3/projects => generated 401 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:34:20.984743 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966079fc-d571-4741-9009-57fd2a8597ab admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:34:20.995649 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966079fc-d571-4741-9009-57fd2a8597ab admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:34:21.051688 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b934512-6d32-41ed-ad4c-3bd455e8a03e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:34:21.052473 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b934512-6d32-41ed-ad4c-3bd455e8a03e admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:34:21.052859 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b934512-6d32-41ed-ad4c-3bd455e8a03e admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:34:21.053227 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b934512-6d32-41ed-ad4c-3bd455e8a03e admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:34:21.054053 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b934512-6d32-41ed-ad4c-3bd455e8a03e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:34:21.056686 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b934512-6d32-41ed-ad4c-3bd455e8a03e admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:34:21.082311 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1305/2587] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 13 15:34:20 2022] POST /identity/v3/users => generated 301 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:34:21.086663 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0e86a2-6bc8-4a54-9585-eb13fb417149 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:34:21.097868 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0e86a2-6bc8-4a54-9585-eb13fb417149 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:34:21.102715 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202079ea-79e9-4630-9ca6-54745712046f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:34:21.103318 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202079ea-79e9-4630-9ca6-54745712046f admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:34:21.103603 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202079ea-79e9-4630-9ca6-54745712046f admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:34:21.103881 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202079ea-79e9-4630-9ca6-54745712046f admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:34:21.104526 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202079ea-79e9-4630-9ca6-54745712046f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:34:21.106160 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202079ea-79e9-4630-9ca6-54745712046f admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:34:21.117457 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1283/2588] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:34:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 15:34:21.121397 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b934512-6d32-41ed-ad4c-3bd455e8a03e admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:34:21.131330 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b934512-6d32-41ed-ad4c-3bd455e8a03e admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:34:21.136101 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64b8dc3-8e50-4a76-81ae-8ed1a7e82746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:34:21.136726 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64b8dc3-8e50-4a76-81ae-8ed1a7e82746 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:34:21.137005 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64b8dc3-8e50-4a76-81ae-8ed1a7e82746 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:34:21.137279 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64b8dc3-8e50-4a76-81ae-8ed1a7e82746 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:34:21.137950 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64b8dc3-8e50-4a76-81ae-8ed1a7e82746 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:34:21.139541 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64b8dc3-8e50-4a76-81ae-8ed1a7e82746 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:34:21.140808 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:34:21.153149 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1306/2589] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:34:21 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 15:34:21.157331 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202079ea-79e9-4630-9ca6-54745712046f admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:34:21.167907 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202079ea-79e9-4630-9ca6-54745712046f admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:34:21.172504 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da51ce61-2336-49e9-b385-3dd22b679e5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:34:21.173147 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da51ce61-2336-49e9-b385-3dd22b679e5e admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:34:21.173438 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da51ce61-2336-49e9-b385-3dd22b679e5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:34:21.173716 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da51ce61-2336-49e9-b385-3dd22b679e5e admin admin] PATH_INFO: `/v3/projects/14b0764b26644bd38d030bc39b3a3d3c/users/9138aa1a6df14f9eb0585b4ad484f600/roles/3fae3d3a28e147d3b2bede2378ff79ae` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:34:21.188627 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da51ce61-2336-49e9-b385-3dd22b679e5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=14b0764b26644bd38d030bc39b3a3d3c, user_id=9138aa1a6df14f9eb0585b4ad484f600, role_id=3fae3d3a28e147d3b2bede2378ff79ae)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:34:21.191328 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da51ce61-2336-49e9-b385-3dd22b679e5e admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:34:21.204280 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1284/2590] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 13 15:34:21 2022] PUT /identity/v3/projects/14b0764b26644bd38d030bc39b3a3d3c/users/9138aa1a6df14f9eb0585b4ad484f600/roles/3fae3d3a28e147d3b2bede2378ff79ae => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:34:21.215999 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f23626-df1c-4e28-8357-3009195affdc None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:34:21.216296 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f23626-df1c-4e28-8357-3009195affdc None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:34:21.216572 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f23626-df1c-4e28-8357-3009195affdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:34:21.245519 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-b8f23626-df1c-4e28-8357-3009195affdc None None] MFA Rules not processed for user `9138aa1a6df14f9eb0585b4ad484f600`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:34:21.246694 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-b8f23626-df1c-4e28-8357-3009195affdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:34:21.310018 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1307/2591] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:34:21 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:34:21.314550 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da51ce61-2336-49e9-b385-3dd22b679e5e admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:34:21.375380 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da51ce61-2336-49e9-b385-3dd22b679e5e admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:34:21.380678 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0314939b-0b81-49e1-b8d0-e603bc324048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:34:21.381280 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0314939b-0b81-49e1-b8d0-e603bc324048 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:34:21.381566 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0314939b-0b81-49e1-b8d0-e603bc324048 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:34:21.381878 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0314939b-0b81-49e1-b8d0-e603bc324048 admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:34:21.382528 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0314939b-0b81-49e1-b8d0-e603bc324048 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:34:21.384414 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0314939b-0b81-49e1-b8d0-e603bc324048 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:34:21.410802 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1285/2592] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 13 15:34:21 2022] POST /identity/v3/projects => generated 401 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:34:21.414847 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f23626-df1c-4e28-8357-3009195affdc None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:34:21.425801 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f23626-df1c-4e28-8357-3009195affdc None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:34:21.482425 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9131f8-b971-4bd6-9e58-1173222f439a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:34:21.483036 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9131f8-b971-4bd6-9e58-1173222f439a admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:34:21.483349 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9131f8-b971-4bd6-9e58-1173222f439a admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:34:21.483603 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9131f8-b971-4bd6-9e58-1173222f439a admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:34:21.484247 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9131f8-b971-4bd6-9e58-1173222f439a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:34:21.486243 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9131f8-b971-4bd6-9e58-1173222f439a admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:34:21.508308 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1308/2593] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 13 15:34:21 2022] POST /identity/v3/users => generated 307 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:34:21.512249 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0314939b-0b81-49e1-b8d0-e603bc324048 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:34:21.522926 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0314939b-0b81-49e1-b8d0-e603bc324048 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:34:21.527530 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece0841c-6074-428e-8c58-7aa52f7ee8b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:34:21.528134 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece0841c-6074-428e-8c58-7aa52f7ee8b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:34:21.528417 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece0841c-6074-428e-8c58-7aa52f7ee8b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:34:21.528694 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece0841c-6074-428e-8c58-7aa52f7ee8b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:34:21.529334 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece0841c-6074-428e-8c58-7aa52f7ee8b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:34:21.530960 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece0841c-6074-428e-8c58-7aa52f7ee8b1 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:34:21.532181 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:34:21.546283 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1286/2594] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:34:21 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 15:34:21.547465 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9131f8-b971-4bd6-9e58-1173222f439a admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:34:21.557919 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9131f8-b971-4bd6-9e58-1173222f439a admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:34:21.562510 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf27356e-ac11-43e8-9065-42fd30ea0272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:34:21.563159 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf27356e-ac11-43e8-9065-42fd30ea0272 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:34:21.563444 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf27356e-ac11-43e8-9065-42fd30ea0272 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:34:21.563725 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf27356e-ac11-43e8-9065-42fd30ea0272 admin admin] PATH_INFO: `/v3/projects/d3dd9db3b5a34476bbd2230c3de747f2/users/c9f8a4520095447c9c0c01dad99417e7/roles/f34412ad29f1478cba775b033129f71f` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:34:21.578810 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf27356e-ac11-43e8-9065-42fd30ea0272 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3dd9db3b5a34476bbd2230c3de747f2, user_id=c9f8a4520095447c9c0c01dad99417e7, role_id=f34412ad29f1478cba775b033129f71f)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:34:21.581465 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf27356e-ac11-43e8-9065-42fd30ea0272 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:34:21.594580 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1309/2595] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 13 15:34:21 2022] PUT /identity/v3/projects/d3dd9db3b5a34476bbd2230c3de747f2/users/c9f8a4520095447c9c0c01dad99417e7/roles/f34412ad29f1478cba775b033129f71f => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:34:21.598655 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece0841c-6074-428e-8c58-7aa52f7ee8b1 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:34:21.608329 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece0841c-6074-428e-8c58-7aa52f7ee8b1 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:34:21.667028 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5724a83-a719-4bcb-949a-7b7d9f4050f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:34:21.667641 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5724a83-a719-4bcb-949a-7b7d9f4050f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:34:21.667925 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5724a83-a719-4bcb-949a-7b7d9f4050f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:34:21.668201 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5724a83-a719-4bcb-949a-7b7d9f4050f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:34:21.668842 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5724a83-a719-4bcb-949a-7b7d9f4050f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:34:21.670482 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5724a83-a719-4bcb-949a-7b7d9f4050f7 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:34:21.680791 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1287/2596] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:34:21 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 15:34:21.684932 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf27356e-ac11-43e8-9065-42fd30ea0272 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:34:21.695778 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf27356e-ac11-43e8-9065-42fd30ea0272 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:34:21.700630 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce907f1-b203-490f-8f48-ae4c0670ad68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:34:21.701274 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce907f1-b203-490f-8f48-ae4c0670ad68 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:34:21.701559 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce907f1-b203-490f-8f48-ae4c0670ad68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:34:21.701869 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce907f1-b203-490f-8f48-ae4c0670ad68 admin admin] PATH_INFO: `/v3/projects/d3dd9db3b5a34476bbd2230c3de747f2/users/c9f8a4520095447c9c0c01dad99417e7/roles/f34412ad29f1478cba775b033129f71f` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:34:21.703784 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce907f1-b203-490f-8f48-ae4c0670ad68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3dd9db3b5a34476bbd2230c3de747f2, user_id=c9f8a4520095447c9c0c01dad99417e7, role_id=f34412ad29f1478cba775b033129f71f)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:34:21.706575 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce907f1-b203-490f-8f48-ae4c0670ad68 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:34:21.716893 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1310/2597] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 13 15:34:21 2022] PUT /identity/v3/projects/d3dd9db3b5a34476bbd2230c3de747f2/users/c9f8a4520095447c9c0c01dad99417e7/roles/f34412ad29f1478cba775b033129f71f => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:34:21.727302 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183eab30-6252-4e66-8712-4145737cfdcc None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:34:21.727603 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183eab30-6252-4e66-8712-4145737cfdcc None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:34:21.727886 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183eab30-6252-4e66-8712-4145737cfdcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:34:21.756641 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-183eab30-6252-4e66-8712-4145737cfdcc None None] MFA Rules not processed for user `c9f8a4520095447c9c0c01dad99417e7`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:34:21.757899 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-183eab30-6252-4e66-8712-4145737cfdcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:34:21.826308 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1288/2598] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:34:21 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 15:34:21.836981 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce907f1-b203-490f-8f48-ae4c0670ad68 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:34:21.838701 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-4ce907f1-b203-490f-8f48-ae4c0670ad68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:34:21.880731 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:34:21.896511 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce907f1-b203-490f-8f48-ae4c0670ad68 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:34:21.900186 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9069591-3a06-4b4b-8556-6094574630f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97acd23097d54bf7805c3cef60626ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:34:21.900789 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9069591-3a06-4b4b-8556-6094574630f5 service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:34:21.901067 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9069591-3a06-4b4b-8556-6094574630f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:34:21.901340 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9069591-3a06-4b4b-8556-6094574630f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:34:21.910638 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9069591-3a06-4b4b-8556-6094574630f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:34:21.912065 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9069591-3a06-4b4b-8556-6094574630f5 service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:34:21.921370 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1311/2599] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:34:21 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:34:22.001171 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183eab30-6252-4e66-8712-4145737cfdcc None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:34:22.010866 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183eab30-6252-4e66-8712-4145737cfdcc None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:34:22.014598 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf68c952-cf2d-46a1-b93b-88263e66e99f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97acd23097d54bf7805c3cef60626ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:34:22.015283 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf68c952-cf2d-46a1-b93b-88263e66e99f service cinder] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:34:22.015566 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf68c952-cf2d-46a1-b93b-88263e66e99f service cinder] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:34:22.015841 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf68c952-cf2d-46a1-b93b-88263e66e99f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:34:22.074973 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf68c952-cf2d-46a1-b93b-88263e66e99f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:34:22.076723 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf68c952-cf2d-46a1-b93b-88263e66e99f service cinder] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:34:22.086771 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1289/2600] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:34:22 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:34:26.141388 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9069591-3a06-4b4b-8556-6094574630f5 service cinder] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:34:26.204093 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9069591-3a06-4b4b-8556-6094574630f5 service cinder] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:34:26.209229 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a342c3b-f02f-4d9a-b9e7-50274d0e75db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:34:26.209889 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a342c3b-f02f-4d9a-b9e7-50274d0e75db admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:34:26.210178 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a342c3b-f02f-4d9a-b9e7-50274d0e75db admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:34:26.210460 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a342c3b-f02f-4d9a-b9e7-50274d0e75db admin admin] PATH_INFO: `/v3/users/9138aa1a6df14f9eb0585b4ad484f600` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:34:26.211579 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a342c3b-f02f-4d9a-b9e7-50274d0e75db admin admin] RBAC: Authorizing `identity:delete_user(user_id=9138aa1a6df14f9eb0585b4ad484f600)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:34:26.213498 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a342c3b-f02f-4d9a-b9e7-50274d0e75db admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:34:26.259791 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-3a342c3b-f02f-4d9a-b9e7-50274d0e75db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9138aa1a6df14f9eb0585b4ad484f600'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:34:26.260375 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-3a342c3b-f02f-4d9a-b9e7-50274d0e75db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9138aa1a6df14f9eb0585b4ad484f600'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:34:26.260992 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-3a342c3b-f02f-4d9a-b9e7-50274d0e75db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9138aa1a6df14f9eb0585b4ad484f600'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:34:26.268399 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-3a342c3b-f02f-4d9a-b9e7-50274d0e75db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9138aa1a6df14f9eb0585b4ad484f600'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:34:26.280737 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-3a342c3b-f02f-4d9a-b9e7-50274d0e75db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9138aa1a6df14f9eb0585b4ad484f600'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:34:26.294069 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1312/2601] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 13 15:34:26 2022] DELETE /identity/v3/users/9138aa1a6df14f9eb0585b4ad484f600 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:34:26.298532 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a49044a-7f04-4b1f-bc0b-876051b9f512 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:34:26.299016 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a49044a-7f04-4b1f-bc0b-876051b9f512 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:34:26.299207 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a49044a-7f04-4b1f-bc0b-876051b9f512 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:34:26.318572 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-5a49044a-7f04-4b1f-bc0b-876051b9f512 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:34:26.319779 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-5a49044a-7f04-4b1f-bc0b-876051b9f512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:34:26.329097 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:34:26.379151 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1290/2602] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:34:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 15:34:26.388943 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a342c3b-f02f-4d9a-b9e7-50274d0e75db admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:34:26.390357 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-3a342c3b-f02f-4d9a-b9e7-50274d0e75db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:34:26.447442 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a342c3b-f02f-4d9a-b9e7-50274d0e75db admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:34:26.451334 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9a3d65-f4f6-4c6a-ba0a-88864c39fd9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41675154bbba47388040966f75d84c3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:34:26.451941 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9a3d65-f4f6-4c6a-ba0a-88864c39fd9b service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:34:26.452220 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9a3d65-f4f6-4c6a-ba0a-88864c39fd9b service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:34:26.452496 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9a3d65-f4f6-4c6a-ba0a-88864c39fd9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:34:26.462135 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9a3d65-f4f6-4c6a-ba0a-88864c39fd9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:34:26.463577 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9a3d65-f4f6-4c6a-ba0a-88864c39fd9b service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:34:26.473034 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1313/2603] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:34:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:34:26.749675 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a49044a-7f04-4b1f-bc0b-876051b9f512 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:34:26.751200 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-5a49044a-7f04-4b1f-bc0b-876051b9f512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:34:26.764776 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a49044a-7f04-4b1f-bc0b-876051b9f512 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:34:26.771007 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e95ea52-7cee-4330-878f-deaca234906a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:34:26.771661 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e95ea52-7cee-4330-878f-deaca234906a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:34:26.771944 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e95ea52-7cee-4330-878f-deaca234906a admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:34:26.772780 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e95ea52-7cee-4330-878f-deaca234906a admin admin] PATH_INFO: `/v3/projects/14b0764b26644bd38d030bc39b3a3d3c` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:34:26.773372 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e95ea52-7cee-4330-878f-deaca234906a admin admin] RBAC: Authorizing `identity:delete_project(project_id=14b0764b26644bd38d030bc39b3a3d3c)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:34:26.776028 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e95ea52-7cee-4330-878f-deaca234906a admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:34:26.837804 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-7e95ea52-7cee-4330-878f-deaca234906a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14b0764b26644bd38d030bc39b3a3d3c', 'request_id': 'req-7e95ea52-7cee-4330-878f-deaca234906a'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:34:26.843950 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-7e95ea52-7cee-4330-878f-deaca234906a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14b0764b26644bd38d030bc39b3a3d3c', 'request_id': 'req-7e95ea52-7cee-4330-878f-deaca234906a'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:34:26.849633 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-7e95ea52-7cee-4330-878f-deaca234906a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14b0764b26644bd38d030bc39b3a3d3c', 'request_id': 'req-7e95ea52-7cee-4330-878f-deaca234906a'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:34:26.861178 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-7e95ea52-7cee-4330-878f-deaca234906a admin admin] The token cache is being invalidate because project 14b0764b26644bd38d030bc39b3a3d3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 15:34:26.861481 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-7e95ea52-7cee-4330-878f-deaca234906a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:34:26.862142 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-7e95ea52-7cee-4330-878f-deaca234906a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:34:26.864156 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1291/2604] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 13 15:34:26 2022] DELETE /identity/v3/projects/14b0764b26644bd38d030bc39b3a3d3c => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:34:26.868311 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9a3d65-f4f6-4c6a-ba0a-88864c39fd9b service neutron] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:34:26.873185 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:34:26.880249 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9a3d65-f4f6-4c6a-ba0a-88864c39fd9b service neutron] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:34:26.936474 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e33730a-4079-4351-ac2a-49b0335595ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:34:26.937107 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e33730a-4079-4351-ac2a-49b0335595ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:34:26.937393 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e33730a-4079-4351-ac2a-49b0335595ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:34:26.937673 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e33730a-4079-4351-ac2a-49b0335595ff admin admin] PATH_INFO: `/v3/users/c9f8a4520095447c9c0c01dad99417e7` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:34:26.938827 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e33730a-4079-4351-ac2a-49b0335595ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9f8a4520095447c9c0c01dad99417e7)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:34:26.941323 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e33730a-4079-4351-ac2a-49b0335595ff admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:34:26.985277 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-5e33730a-4079-4351-ac2a-49b0335595ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9f8a4520095447c9c0c01dad99417e7'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:34:26.985966 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-5e33730a-4079-4351-ac2a-49b0335595ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9f8a4520095447c9c0c01dad99417e7'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:34:26.986610 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-5e33730a-4079-4351-ac2a-49b0335595ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9f8a4520095447c9c0c01dad99417e7'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:34:26.994081 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-5e33730a-4079-4351-ac2a-49b0335595ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9f8a4520095447c9c0c01dad99417e7'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:34:27.006397 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-5e33730a-4079-4351-ac2a-49b0335595ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9f8a4520095447c9c0c01dad99417e7'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:34:27.019063 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1314/2605] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 13 15:34:26 2022] DELETE /identity/v3/users/c9f8a4520095447c9c0c01dad99417e7 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:34:27.287913 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e95ea52-7cee-4330-878f-deaca234906a admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:34:27.289326 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-7e95ea52-7cee-4330-878f-deaca234906a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:34:27.303166 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e95ea52-7cee-4330-878f-deaca234906a admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:34:27.363182 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a34edb-6dc0-4190-8c84-a4b8df42daef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:34:27.363798 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a34edb-6dc0-4190-8c84-a4b8df42daef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:34:27.364077 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a34edb-6dc0-4190-8c84-a4b8df42daef admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:34:27.364352 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a34edb-6dc0-4190-8c84-a4b8df42daef admin admin] PATH_INFO: `/v3/projects/d3dd9db3b5a34476bbd2230c3de747f2` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:34:27.365470 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a34edb-6dc0-4190-8c84-a4b8df42daef admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3dd9db3b5a34476bbd2230c3de747f2)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:34:27.367386 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a34edb-6dc0-4190-8c84-a4b8df42daef admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:34:27.407447 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:34:27.415767 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-25a34edb-6dc0-4190-8c84-a4b8df42daef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3dd9db3b5a34476bbd2230c3de747f2', 'request_id': 'req-25a34edb-6dc0-4190-8c84-a4b8df42daef'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:34:27.422592 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-25a34edb-6dc0-4190-8c84-a4b8df42daef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3dd9db3b5a34476bbd2230c3de747f2', 'request_id': 'req-25a34edb-6dc0-4190-8c84-a4b8df42daef'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:34:27.428797 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-25a34edb-6dc0-4190-8c84-a4b8df42daef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3dd9db3b5a34476bbd2230c3de747f2', 'request_id': 'req-25a34edb-6dc0-4190-8c84-a4b8df42daef'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:34:27.441294 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-25a34edb-6dc0-4190-8c84-a4b8df42daef admin admin] The token cache is being invalidate because project d3dd9db3b5a34476bbd2230c3de747f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 15:34:27.441578 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-25a34edb-6dc0-4190-8c84-a4b8df42daef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:34:27.442249 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-25a34edb-6dc0-4190-8c84-a4b8df42daef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:34:27.443708 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1292/2606] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 13 15:34:27 2022] DELETE /identity/v3/projects/d3dd9db3b5a34476bbd2230c3de747f2 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:34:27.448578 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e462bff-f559-463e-9d23-b8d69a2f7441 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:34:27.449036 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e462bff-f559-463e-9d23-b8d69a2f7441 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:34:27.449176 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e462bff-f559-463e-9d23-b8d69a2f7441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:34:27.469403 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-2e462bff-f559-463e-9d23-b8d69a2f7441 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:34:27.470650 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-2e462bff-f559-463e-9d23-b8d69a2f7441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:34:27.530670 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1315/2607] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:34:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:34:27.540483 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b908906-99d7-40b0-bff1-1d725058600e None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:34:27.540770 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b908906-99d7-40b0-bff1-1d725058600e None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:34:27.541046 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b908906-99d7-40b0-bff1-1d725058600e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:34:27.560823 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-4b908906-99d7-40b0-bff1-1d725058600e None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:34:27.562057 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-4b908906-99d7-40b0-bff1-1d725058600e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:34:27.570336 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1293/2608] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:34:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:34:27.574439 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e462bff-f559-463e-9d23-b8d69a2f7441 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:34:27.584683 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e462bff-f559-463e-9d23-b8d69a2f7441 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:34:27.589332 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8e5f82-8c3d-46df-a704-025953c4cdb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:34:27.589971 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8e5f82-8c3d-46df-a704-025953c4cdb9 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:34:27.590256 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8e5f82-8c3d-46df-a704-025953c4cdb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:34:27.590532 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8e5f82-8c3d-46df-a704-025953c4cdb9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:34:27.591204 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8e5f82-8c3d-46df-a704-025953c4cdb9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:34:27.591510 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8e5f82-8c3d-46df-a704-025953c4cdb9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:34:27.593104 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8e5f82-8c3d-46df-a704-025953c4cdb9 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:34:27.604776 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1316/2609] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Sep 13 15:34:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:34:27.608888 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b908906-99d7-40b0-bff1-1d725058600e None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:34:27.618604 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b908906-99d7-40b0-bff1-1d725058600e None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:34:27.623109 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240ef54c-39e9-4fa8-af05-6bd9b9ffad54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:34:27.623693 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240ef54c-39e9-4fa8-af05-6bd9b9ffad54 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:34:27.623968 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240ef54c-39e9-4fa8-af05-6bd9b9ffad54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:34:27.624236 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240ef54c-39e9-4fa8-af05-6bd9b9ffad54 admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:34:27.624858 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240ef54c-39e9-4fa8-af05-6bd9b9ffad54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:34:27.626776 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240ef54c-39e9-4fa8-af05-6bd9b9ffad54 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:34:27.653446 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1294/2610] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 13 15:34:27 2022] POST /identity/v3/projects => generated 379 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 15:34:27.657602 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8e5f82-8c3d-46df-a704-025953c4cdb9 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:34:27.667506 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8e5f82-8c3d-46df-a704-025953c4cdb9 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:34:27.671989 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:34:27.725480 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c585fc3d-f543-4dd9-85c4-65a197511aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:34:27.726131 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c585fc3d-f543-4dd9-85c4-65a197511aa0 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:34:27.726415 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c585fc3d-f543-4dd9-85c4-65a197511aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:34:27.726691 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c585fc3d-f543-4dd9-85c4-65a197511aa0 admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:34:27.727337 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c585fc3d-f543-4dd9-85c4-65a197511aa0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:34:27.729324 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c585fc3d-f543-4dd9-85c4-65a197511aa0 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:34:27.750930 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1317/2611] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 13 15:34:27 2022] POST /identity/v3/users => generated 290 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 15:34:27.755700 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240ef54c-39e9-4fa8-af05-6bd9b9ffad54 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:34:27.765834 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240ef54c-39e9-4fa8-af05-6bd9b9ffad54 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:34:27.770941 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f3ef73-5a88-4ba6-bc1a-4f210985d10a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:34:27.771530 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f3ef73-5a88-4ba6-bc1a-4f210985d10a admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:34:27.771832 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f3ef73-5a88-4ba6-bc1a-4f210985d10a admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:34:27.772105 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f3ef73-5a88-4ba6-bc1a-4f210985d10a admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:34:27.772737 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f3ef73-5a88-4ba6-bc1a-4f210985d10a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:34:27.774347 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f3ef73-5a88-4ba6-bc1a-4f210985d10a admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:34:27.784887 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1295/2612] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:34:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 15:34:27.788692 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c585fc3d-f543-4dd9-85c4-65a197511aa0 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:34:27.798811 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c585fc3d-f543-4dd9-85c4-65a197511aa0 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:34:27.803639 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91950208-cc44-4427-9f25-32b21011b2b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:34:27.804235 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91950208-cc44-4427-9f25-32b21011b2b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:34:27.804514 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91950208-cc44-4427-9f25-32b21011b2b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:34:27.804791 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91950208-cc44-4427-9f25-32b21011b2b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:34:27.805435 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91950208-cc44-4427-9f25-32b21011b2b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:34:27.807075 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91950208-cc44-4427-9f25-32b21011b2b1 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:34:27.818948 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1318/2613] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:34:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 15:34:27.823281 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f3ef73-5a88-4ba6-bc1a-4f210985d10a admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:34:27.834557 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f3ef73-5a88-4ba6-bc1a-4f210985d10a admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:34:27.839589 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990e0e4f-0343-4612-873e-ebea771bfa7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:34:27.840271 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990e0e4f-0343-4612-873e-ebea771bfa7c admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:34:27.840552 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990e0e4f-0343-4612-873e-ebea771bfa7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:34:27.840825 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990e0e4f-0343-4612-873e-ebea771bfa7c admin admin] PATH_INFO: `/v3/projects/a21563e3a40f48da8c006f152045e8af/users/747c1fcd05cf4b09ac311370bc54d25c/roles/3fae3d3a28e147d3b2bede2378ff79ae` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:34:27.856389 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990e0e4f-0343-4612-873e-ebea771bfa7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a21563e3a40f48da8c006f152045e8af, user_id=747c1fcd05cf4b09ac311370bc54d25c, role_id=3fae3d3a28e147d3b2bede2378ff79ae)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:34:27.859069 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990e0e4f-0343-4612-873e-ebea771bfa7c admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:34:27.880491 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1296/2614] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 13 15:34:27 2022] PUT /identity/v3/projects/a21563e3a40f48da8c006f152045e8af/users/747c1fcd05cf4b09ac311370bc54d25c/roles/3fae3d3a28e147d3b2bede2378ff79ae => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:34:27.890202 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2e2aa9-4df2-47fc-b15d-16f7c0ffd438 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:34:27.890488 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2e2aa9-4df2-47fc-b15d-16f7c0ffd438 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:34:27.890776 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2e2aa9-4df2-47fc-b15d-16f7c0ffd438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:34:27.928030 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-1c2e2aa9-4df2-47fc-b15d-16f7c0ffd438 None None] MFA Rules not processed for user `747c1fcd05cf4b09ac311370bc54d25c`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:34:27.929308 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-1c2e2aa9-4df2-47fc-b15d-16f7c0ffd438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:34:28.006583 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1319/2615] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:34:27 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:34:28.011654 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990e0e4f-0343-4612-873e-ebea771bfa7c admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:34:28.090384 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990e0e4f-0343-4612-873e-ebea771bfa7c admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:34:28.096173 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcb33a4-eb00-4cd6-a9a6-95f3184d8a1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:34:28.097392 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcb33a4-eb00-4cd6-a9a6-95f3184d8a1e admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:34:28.097842 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcb33a4-eb00-4cd6-a9a6-95f3184d8a1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:34:28.098377 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcb33a4-eb00-4cd6-a9a6-95f3184d8a1e admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:34:28.099030 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcb33a4-eb00-4cd6-a9a6-95f3184d8a1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:34:28.101047 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcb33a4-eb00-4cd6-a9a6-95f3184d8a1e admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:34:28.128470 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1297/2616] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 13 15:34:28 2022] POST /identity/v3/projects => generated 379 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 15:34:28.132792 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2e2aa9-4df2-47fc-b15d-16f7c0ffd438 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:34:28.144015 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2e2aa9-4df2-47fc-b15d-16f7c0ffd438 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:34:28.210873 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a986a25-91c4-40fe-8cf2-aecc9b6272d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:34:28.212050 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a986a25-91c4-40fe-8cf2-aecc9b6272d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:34:28.212050 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a986a25-91c4-40fe-8cf2-aecc9b6272d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:34:28.212251 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a986a25-91c4-40fe-8cf2-aecc9b6272d9 admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:34:28.212903 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a986a25-91c4-40fe-8cf2-aecc9b6272d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:34:28.214962 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a986a25-91c4-40fe-8cf2-aecc9b6272d9 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:34:28.259617 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1320/2617] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 13 15:34:28 2022] POST /identity/v3/users => generated 290 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:34:28.261234 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcb33a4-eb00-4cd6-a9a6-95f3184d8a1e admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:34:28.273922 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcb33a4-eb00-4cd6-a9a6-95f3184d8a1e admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:34:28.279734 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c1a5ec-9c67-46b9-afa0-be8310a5a059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:34:28.280463 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c1a5ec-9c67-46b9-afa0-be8310a5a059 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:34:28.280746 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c1a5ec-9c67-46b9-afa0-be8310a5a059 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:34:28.281016 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c1a5ec-9c67-46b9-afa0-be8310a5a059 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:34:28.281654 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c1a5ec-9c67-46b9-afa0-be8310a5a059 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:34:28.283267 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c1a5ec-9c67-46b9-afa0-be8310a5a059 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:34:28.296103 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1298/2618] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:34:28 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 15:34:28.300014 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a986a25-91c4-40fe-8cf2-aecc9b6272d9 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:34:28.310991 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a986a25-91c4-40fe-8cf2-aecc9b6272d9 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:34:28.315905 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3410f0ad-2d58-49f6-933f-edba71bd38b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:34:28.316501 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3410f0ad-2d58-49f6-933f-edba71bd38b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:34:28.316776 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3410f0ad-2d58-49f6-933f-edba71bd38b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:34:28.317132 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3410f0ad-2d58-49f6-933f-edba71bd38b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:34:28.317904 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3410f0ad-2d58-49f6-933f-edba71bd38b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:34:28.319520 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3410f0ad-2d58-49f6-933f-edba71bd38b9 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:34:28.320760 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:34:28.333278 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1321/2619] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:34:28 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 15:34:28.337329 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c1a5ec-9c67-46b9-afa0-be8310a5a059 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:34:28.348377 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c1a5ec-9c67-46b9-afa0-be8310a5a059 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:34:28.352954 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4e767c-2dc4-4db6-b54f-97fc8c454a9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:34:28.353593 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4e767c-2dc4-4db6-b54f-97fc8c454a9e admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:34:28.353909 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4e767c-2dc4-4db6-b54f-97fc8c454a9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:34:28.354179 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4e767c-2dc4-4db6-b54f-97fc8c454a9e admin admin] PATH_INFO: `/v3/projects/14148d11c6434f8ab50b8d1ff59d31fe/users/8e3c8a733be742bf8d09503e93847dfc/roles/3fae3d3a28e147d3b2bede2378ff79ae` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:34:28.369848 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4e767c-2dc4-4db6-b54f-97fc8c454a9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=14148d11c6434f8ab50b8d1ff59d31fe, user_id=8e3c8a733be742bf8d09503e93847dfc, role_id=3fae3d3a28e147d3b2bede2378ff79ae)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:34:28.372561 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4e767c-2dc4-4db6-b54f-97fc8c454a9e admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:34:28.385160 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1299/2620] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 13 15:34:28 2022] PUT /identity/v3/projects/14148d11c6434f8ab50b8d1ff59d31fe/users/8e3c8a733be742bf8d09503e93847dfc/roles/3fae3d3a28e147d3b2bede2378ff79ae => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 15:34:28.396026 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69724c75-d4d7-4b4b-9123-9e3ad41c4a9b None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:34:28.396369 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69724c75-d4d7-4b4b-9123-9e3ad41c4a9b None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:34:28.396652 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69724c75-d4d7-4b4b-9123-9e3ad41c4a9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:34:28.424650 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-69724c75-d4d7-4b4b-9123-9e3ad41c4a9b None None] MFA Rules not processed for user `8e3c8a733be742bf8d09503e93847dfc`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:34:28.426493 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-69724c75-d4d7-4b4b-9123-9e3ad41c4a9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:34:28.494718 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1322/2621] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:34:28 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:34:28.499169 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4e767c-2dc4-4db6-b54f-97fc8c454a9e admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:34:28.519027 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:34:28.566658 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4e767c-2dc4-4db6-b54f-97fc8c454a9e admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:34:28.571326 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d4013d-ba89-4cb9-973e-769903a9b867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:34:28.571929 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d4013d-ba89-4cb9-973e-769903a9b867 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:34:28.572212 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d4013d-ba89-4cb9-973e-769903a9b867 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:34:28.572489 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d4013d-ba89-4cb9-973e-769903a9b867 admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:34:28.573130 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d4013d-ba89-4cb9-973e-769903a9b867 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:34:28.575331 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d4013d-ba89-4cb9-973e-769903a9b867 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:34:28.601538 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1300/2622] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 13 15:34:28 2022] POST /identity/v3/projects => generated 377 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:34:28.605591 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69724c75-d4d7-4b4b-9123-9e3ad41c4a9b None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:34:28.617168 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69724c75-d4d7-4b4b-9123-9e3ad41c4a9b None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:34:28.672168 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02147a2c-cd23-40c4-95fa-1271eb5bf848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:34:28.672694 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02147a2c-cd23-40c4-95fa-1271eb5bf848 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:34:28.672974 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02147a2c-cd23-40c4-95fa-1271eb5bf848 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:34:28.673247 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02147a2c-cd23-40c4-95fa-1271eb5bf848 admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:34:28.673912 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02147a2c-cd23-40c4-95fa-1271eb5bf848 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:34:28.676808 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02147a2c-cd23-40c4-95fa-1271eb5bf848 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:34:28.698505 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1323/2623] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 13 15:34:28 2022] POST /identity/v3/users => generated 295 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:34:28.702996 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d4013d-ba89-4cb9-973e-769903a9b867 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:34:28.713309 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d4013d-ba89-4cb9-973e-769903a9b867 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:34:28.718045 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7bcbe5-46e2-47ba-b7ad-72c99fee71a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:34:28.718651 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7bcbe5-46e2-47ba-b7ad-72c99fee71a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:34:28.718940 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7bcbe5-46e2-47ba-b7ad-72c99fee71a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:34:28.719216 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7bcbe5-46e2-47ba-b7ad-72c99fee71a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:34:28.719860 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7bcbe5-46e2-47ba-b7ad-72c99fee71a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:34:28.721463 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7bcbe5-46e2-47ba-b7ad-72c99fee71a0 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:34:28.732829 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1301/2624] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:34:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 15:34:28.736970 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02147a2c-cd23-40c4-95fa-1271eb5bf848 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:34:28.748042 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02147a2c-cd23-40c4-95fa-1271eb5bf848 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:34:28.752691 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcba5d2-e927-4a2e-bc59-6d511a1b2cdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:34:28.753904 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcba5d2-e927-4a2e-bc59-6d511a1b2cdc admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:34:28.754346 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcba5d2-e927-4a2e-bc59-6d511a1b2cdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:34:28.754629 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcba5d2-e927-4a2e-bc59-6d511a1b2cdc admin admin] PATH_INFO: `/v3/projects/1204a45e00b94a7aac1d58cc74cfcbd4/users/39793d6d3a6a4086a84ff924593b8455/roles/f34412ad29f1478cba775b033129f71f` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:34:28.770048 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcba5d2-e927-4a2e-bc59-6d511a1b2cdc admin admin] RBAC: Authorizing `identity:create_grant(project_id=1204a45e00b94a7aac1d58cc74cfcbd4, user_id=39793d6d3a6a4086a84ff924593b8455, role_id=f34412ad29f1478cba775b033129f71f)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:34:28.772689 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcba5d2-e927-4a2e-bc59-6d511a1b2cdc admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:34:28.785724 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1324/2625] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 13 15:34:28 2022] PUT /identity/v3/projects/1204a45e00b94a7aac1d58cc74cfcbd4/users/39793d6d3a6a4086a84ff924593b8455/roles/f34412ad29f1478cba775b033129f71f => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:34:28.789848 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7bcbe5-46e2-47ba-b7ad-72c99fee71a0 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:34:28.799713 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7bcbe5-46e2-47ba-b7ad-72c99fee71a0 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:34:28.856809 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331218bc-265f-4832-850f-106ca3e6200c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:34:28.857410 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331218bc-265f-4832-850f-106ca3e6200c admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:34:28.857694 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331218bc-265f-4832-850f-106ca3e6200c admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:34:28.858001 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331218bc-265f-4832-850f-106ca3e6200c admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:34:28.858640 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331218bc-265f-4832-850f-106ca3e6200c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:34:28.860228 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331218bc-265f-4832-850f-106ca3e6200c admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:34:28.869871 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1302/2626] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:34:28 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 15:34:28.873956 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcba5d2-e927-4a2e-bc59-6d511a1b2cdc admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:34:28.885085 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcba5d2-e927-4a2e-bc59-6d511a1b2cdc admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:34:28.889725 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d570c5d9-3b5d-4326-905b-fb4d43481b28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:34:28.890372 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d570c5d9-3b5d-4326-905b-fb4d43481b28 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:34:28.890651 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d570c5d9-3b5d-4326-905b-fb4d43481b28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:34:28.890922 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d570c5d9-3b5d-4326-905b-fb4d43481b28 admin admin] PATH_INFO: `/v3/projects/1204a45e00b94a7aac1d58cc74cfcbd4/users/39793d6d3a6a4086a84ff924593b8455/roles/f34412ad29f1478cba775b033129f71f` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:34:28.892841 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d570c5d9-3b5d-4326-905b-fb4d43481b28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1204a45e00b94a7aac1d58cc74cfcbd4, user_id=39793d6d3a6a4086a84ff924593b8455, role_id=f34412ad29f1478cba775b033129f71f)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:34:28.896404 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d570c5d9-3b5d-4326-905b-fb4d43481b28 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:34:28.906320 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1325/2627] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 13 15:34:28 2022] PUT /identity/v3/projects/1204a45e00b94a7aac1d58cc74cfcbd4/users/39793d6d3a6a4086a84ff924593b8455/roles/f34412ad29f1478cba775b033129f71f => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:34:28.918000 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e68e46-29f7-47e9-a896-6d736178a177 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:34:28.918293 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e68e46-29f7-47e9-a896-6d736178a177 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:34:28.918572 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e68e46-29f7-47e9-a896-6d736178a177 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:34:28.946742 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-39e68e46-29f7-47e9-a896-6d736178a177 None None] MFA Rules not processed for user `39793d6d3a6a4086a84ff924593b8455`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:34:28.947877 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-39e68e46-29f7-47e9-a896-6d736178a177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:34:29.014866 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1303/2628] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:34:28 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:34:29.026762 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d570c5d9-3b5d-4326-905b-fb4d43481b28 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:34:29.028570 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-d570c5d9-3b5d-4326-905b-fb4d43481b28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:34:29.072862 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:34:29.090250 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d570c5d9-3b5d-4326-905b-fb4d43481b28 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:34:29.093906 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9010b38-bb56-499a-9071-c5078e3e7521 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97acd23097d54bf7805c3cef60626ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:34:29.094517 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9010b38-bb56-499a-9071-c5078e3e7521 service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:34:29.094796 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9010b38-bb56-499a-9071-c5078e3e7521 service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:34:29.095071 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9010b38-bb56-499a-9071-c5078e3e7521 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:34:29.106162 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9010b38-bb56-499a-9071-c5078e3e7521 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:34:29.107646 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9010b38-bb56-499a-9071-c5078e3e7521 service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:34:29.118315 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1326/2629] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:34:29 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:34:29.160825 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e68e46-29f7-47e9-a896-6d736178a177 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:34:29.162315 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-39e68e46-29f7-47e9-a896-6d736178a177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:34:29.174419 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e68e46-29f7-47e9-a896-6d736178a177 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:34:29.178863 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dd41ea-f814-417e-b7a0-09ae77fdf417 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97acd23097d54bf7805c3cef60626ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:34:29.179486 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dd41ea-f814-417e-b7a0-09ae77fdf417 service cinder] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:34:29.179795 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dd41ea-f814-417e-b7a0-09ae77fdf417 service cinder] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:34:29.180030 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dd41ea-f814-417e-b7a0-09ae77fdf417 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:34:29.188856 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:34:29.240261 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dd41ea-f814-417e-b7a0-09ae77fdf417 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:34:29.241610 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dd41ea-f814-417e-b7a0-09ae77fdf417 service cinder] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:34:29.250411 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1304/2630] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:34:29 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:34:30.928448 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9010b38-bb56-499a-9071-c5078e3e7521 service cinder] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:34:30.929919 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-e9010b38-bb56-499a-9071-c5078e3e7521 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:34:30.996036 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9010b38-bb56-499a-9071-c5078e3e7521 service cinder] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:34:31.001517 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25eb3239-cd06-4615-8d9b-0a7b1dc56073 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41675154bbba47388040966f75d84c3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:34:31.001517 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eb3239-cd06-4615-8d9b-0a7b1dc56073 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:34:31.001517 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eb3239-cd06-4615-8d9b-0a7b1dc56073 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:34:31.001517 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eb3239-cd06-4615-8d9b-0a7b1dc56073 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:34:31.004415 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-25eb3239-cd06-4615-8d9b-0a7b1dc56073 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:34:31.015687 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25eb3239-cd06-4615-8d9b-0a7b1dc56073 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:34:31.017399 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25eb3239-cd06-4615-8d9b-0a7b1dc56073 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:34:31.027098 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1327/2631] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:34:30 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 15:34:32.136428 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dd41ea-f814-417e-b7a0-09ae77fdf417 service cinder] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:34:32.200645 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dd41ea-f814-417e-b7a0-09ae77fdf417 service cinder] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:34:32.205173 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375178dd-ee33-430b-9b70-a3f4b8457450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:34:32.206351 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375178dd-ee33-430b-9b70-a3f4b8457450 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:34:32.206624 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375178dd-ee33-430b-9b70-a3f4b8457450 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:34:32.206892 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375178dd-ee33-430b-9b70-a3f4b8457450 admin admin] PATH_INFO: `/v3/users/747c1fcd05cf4b09ac311370bc54d25c` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:34:32.208082 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375178dd-ee33-430b-9b70-a3f4b8457450 admin admin] RBAC: Authorizing `identity:delete_user(user_id=747c1fcd05cf4b09ac311370bc54d25c)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:34:32.210024 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375178dd-ee33-430b-9b70-a3f4b8457450 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:34:32.255696 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-375178dd-ee33-430b-9b70-a3f4b8457450 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '747c1fcd05cf4b09ac311370bc54d25c'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:34:32.256346 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-375178dd-ee33-430b-9b70-a3f4b8457450 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '747c1fcd05cf4b09ac311370bc54d25c'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:34:32.256953 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-375178dd-ee33-430b-9b70-a3f4b8457450 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '747c1fcd05cf4b09ac311370bc54d25c'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:34:32.263719 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-375178dd-ee33-430b-9b70-a3f4b8457450 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '747c1fcd05cf4b09ac311370bc54d25c'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:34:32.275600 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-375178dd-ee33-430b-9b70-a3f4b8457450 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '747c1fcd05cf4b09ac311370bc54d25c'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:34:32.287937 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1305/2632] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 13 15:34:32 2022] DELETE /identity/v3/users/747c1fcd05cf4b09ac311370bc54d25c => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:34:32.292721 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05abed3-d1e6-4f48-a218-9c2a537a6cd8 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:34:32.293190 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05abed3-d1e6-4f48-a218-9c2a537a6cd8 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:34:32.293313 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05abed3-d1e6-4f48-a218-9c2a537a6cd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:34:32.313957 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-f05abed3-d1e6-4f48-a218-9c2a537a6cd8 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:34:32.315077 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-f05abed3-d1e6-4f48-a218-9c2a537a6cd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:34:32.375456 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1328/2633] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:34:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:34:32.386967 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375178dd-ee33-430b-9b70-a3f4b8457450 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:34:32.388509 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-375178dd-ee33-430b-9b70-a3f4b8457450 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:34:32.421393 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:34:32.450556 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375178dd-ee33-430b-9b70-a3f4b8457450 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:34:32.454289 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2a4e4b-a592-40b0-81c3-3bfbb42d3711 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41675154bbba47388040966f75d84c3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:34:32.454895 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2a4e4b-a592-40b0-81c3-3bfbb42d3711 service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:34:32.455170 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2a4e4b-a592-40b0-81c3-3bfbb42d3711 service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:34:32.455443 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2a4e4b-a592-40b0-81c3-3bfbb42d3711 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:34:32.465650 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2a4e4b-a592-40b0-81c3-3bfbb42d3711 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:34:32.467180 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2a4e4b-a592-40b0-81c3-3bfbb42d3711 service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:34:32.477287 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1306/2634] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:34:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:34:32.832242 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05abed3-d1e6-4f48-a218-9c2a537a6cd8 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:34:32.833772 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-f05abed3-d1e6-4f48-a218-9c2a537a6cd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:34:32.849161 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05abed3-d1e6-4f48-a218-9c2a537a6cd8 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:34:32.866089 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a855d0-ac4b-45a4-ab58-79ff1cb6c953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:34:32.866813 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a855d0-ac4b-45a4-ab58-79ff1cb6c953 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:34:32.867173 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a855d0-ac4b-45a4-ab58-79ff1cb6c953 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:34:32.867517 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a855d0-ac4b-45a4-ab58-79ff1cb6c953 admin admin] PATH_INFO: `/v3/projects/a21563e3a40f48da8c006f152045e8af` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:34:32.868715 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a855d0-ac4b-45a4-ab58-79ff1cb6c953 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a21563e3a40f48da8c006f152045e8af)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:34:32.870728 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a855d0-ac4b-45a4-ab58-79ff1cb6c953 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:34:32.922566 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-99a855d0-ac4b-45a4-ab58-79ff1cb6c953 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a21563e3a40f48da8c006f152045e8af', 'request_id': 'req-99a855d0-ac4b-45a4-ab58-79ff1cb6c953'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:34:32.929643 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-99a855d0-ac4b-45a4-ab58-79ff1cb6c953 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a21563e3a40f48da8c006f152045e8af', 'request_id': 'req-99a855d0-ac4b-45a4-ab58-79ff1cb6c953'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:34:32.938559 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-99a855d0-ac4b-45a4-ab58-79ff1cb6c953 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a21563e3a40f48da8c006f152045e8af', 'request_id': 'req-99a855d0-ac4b-45a4-ab58-79ff1cb6c953'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:34:32.953450 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-99a855d0-ac4b-45a4-ab58-79ff1cb6c953 admin admin] The token cache is being invalidate because project a21563e3a40f48da8c006f152045e8af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 15:34:32.953780 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-99a855d0-ac4b-45a4-ab58-79ff1cb6c953 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:34:32.954482 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-99a855d0-ac4b-45a4-ab58-79ff1cb6c953 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:34:32.957328 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1329/2635] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 13 15:34:32 2022] DELETE /identity/v3/projects/a21563e3a40f48da8c006f152045e8af => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:34:32.960887 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2a4e4b-a592-40b0-81c3-3bfbb42d3711 service neutron] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:34:32.970566 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2a4e4b-a592-40b0-81c3-3bfbb42d3711 service neutron] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:34:33.028798 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6c1430-a65e-45ee-9f0d-99876483a630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:34:33.029539 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6c1430-a65e-45ee-9f0d-99876483a630 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:34:33.029934 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6c1430-a65e-45ee-9f0d-99876483a630 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:34:33.030212 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6c1430-a65e-45ee-9f0d-99876483a630 admin admin] PATH_INFO: `/v3/users/8e3c8a733be742bf8d09503e93847dfc` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:34:33.031369 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6c1430-a65e-45ee-9f0d-99876483a630 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e3c8a733be742bf8d09503e93847dfc)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:34:33.033292 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6c1430-a65e-45ee-9f0d-99876483a630 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:34:33.083793 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-5e6c1430-a65e-45ee-9f0d-99876483a630 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e3c8a733be742bf8d09503e93847dfc'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:34:33.084507 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-5e6c1430-a65e-45ee-9f0d-99876483a630 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e3c8a733be742bf8d09503e93847dfc'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:34:33.085541 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-5e6c1430-a65e-45ee-9f0d-99876483a630 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e3c8a733be742bf8d09503e93847dfc'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:34:33.092179 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-5e6c1430-a65e-45ee-9f0d-99876483a630 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e3c8a733be742bf8d09503e93847dfc'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:34:33.104781 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-5e6c1430-a65e-45ee-9f0d-99876483a630 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e3c8a733be742bf8d09503e93847dfc'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:34:33.120026 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1307/2636] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 13 15:34:32 2022] DELETE /identity/v3/users/8e3c8a733be742bf8d09503e93847dfc => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:34:33.401323 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a855d0-ac4b-45a4-ab58-79ff1cb6c953 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:34:33.402834 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-99a855d0-ac4b-45a4-ab58-79ff1cb6c953 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:34:33.416559 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a855d0-ac4b-45a4-ab58-79ff1cb6c953 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:34:33.420382 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:34:33.477846 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ea4efc-ae49-44eb-bb02-346f1b4ebe9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:34:33.478500 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ea4efc-ae49-44eb-bb02-346f1b4ebe9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:34:33.478779 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ea4efc-ae49-44eb-bb02-346f1b4ebe9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:34:33.479052 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ea4efc-ae49-44eb-bb02-346f1b4ebe9a admin admin] PATH_INFO: `/v3/projects/14148d11c6434f8ab50b8d1ff59d31fe` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:34:33.480169 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ea4efc-ae49-44eb-bb02-346f1b4ebe9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=14148d11c6434f8ab50b8d1ff59d31fe)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:34:33.482104 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ea4efc-ae49-44eb-bb02-346f1b4ebe9a admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:34:33.532832 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-58ea4efc-ae49-44eb-bb02-346f1b4ebe9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14148d11c6434f8ab50b8d1ff59d31fe', 'request_id': 'req-58ea4efc-ae49-44eb-bb02-346f1b4ebe9a'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:34:33.540396 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-58ea4efc-ae49-44eb-bb02-346f1b4ebe9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14148d11c6434f8ab50b8d1ff59d31fe', 'request_id': 'req-58ea4efc-ae49-44eb-bb02-346f1b4ebe9a'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:34:33.548278 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-58ea4efc-ae49-44eb-bb02-346f1b4ebe9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14148d11c6434f8ab50b8d1ff59d31fe', 'request_id': 'req-58ea4efc-ae49-44eb-bb02-346f1b4ebe9a'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:34:33.560249 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-58ea4efc-ae49-44eb-bb02-346f1b4ebe9a admin admin] The token cache is being invalidate because project 14148d11c6434f8ab50b8d1ff59d31fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 15:34:33.560542 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-58ea4efc-ae49-44eb-bb02-346f1b4ebe9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:34:33.561170 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-58ea4efc-ae49-44eb-bb02-346f1b4ebe9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:34:33.562725 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1330/2637] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 13 15:34:33 2022] DELETE /identity/v3/projects/14148d11c6434f8ab50b8d1ff59d31fe => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:34:33.567597 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6c1430-a65e-45ee-9f0d-99876483a630 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:34:33.569436 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-5e6c1430-a65e-45ee-9f0d-99876483a630 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:34:33.584406 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6c1430-a65e-45ee-9f0d-99876483a630 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:34:33.636678 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:34:33.649033 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01df1de-bb90-4057-a1a7-09c253479711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:34:33.649684 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01df1de-bb90-4057-a1a7-09c253479711 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:34:33.650007 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01df1de-bb90-4057-a1a7-09c253479711 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:34:33.650550 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01df1de-bb90-4057-a1a7-09c253479711 admin admin] PATH_INFO: `/v3/users/39793d6d3a6a4086a84ff924593b8455` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:34:33.651777 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01df1de-bb90-4057-a1a7-09c253479711 admin admin] RBAC: Authorizing `identity:delete_user(user_id=39793d6d3a6a4086a84ff924593b8455)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:34:33.653853 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01df1de-bb90-4057-a1a7-09c253479711 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:34:33.704317 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-c01df1de-bb90-4057-a1a7-09c253479711 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39793d6d3a6a4086a84ff924593b8455'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:34:33.704972 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-c01df1de-bb90-4057-a1a7-09c253479711 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39793d6d3a6a4086a84ff924593b8455'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:34:33.705577 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-c01df1de-bb90-4057-a1a7-09c253479711 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39793d6d3a6a4086a84ff924593b8455'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:34:33.713276 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-c01df1de-bb90-4057-a1a7-09c253479711 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39793d6d3a6a4086a84ff924593b8455'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:34:33.727210 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-c01df1de-bb90-4057-a1a7-09c253479711 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39793d6d3a6a4086a84ff924593b8455'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:34:33.740824 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1308/2638] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 13 15:34:33 2022] DELETE /identity/v3/users/39793d6d3a6a4086a84ff924593b8455 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:34:34.051032 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ea4efc-ae49-44eb-bb02-346f1b4ebe9a admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:34:34.052662 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-58ea4efc-ae49-44eb-bb02-346f1b4ebe9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:34:34.064859 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01df1de-bb90-4057-a1a7-09c253479711 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:34:34.067403 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-c01df1de-bb90-4057-a1a7-09c253479711 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:34:34.125297 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ea4efc-ae49-44eb-bb02-346f1b4ebe9a admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:34:34.135769 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01df1de-bb90-4057-a1a7-09c253479711 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:34:34.140460 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc32819-d7de-4587-9ff4-49c211ff5bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:34:34.141087 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc32819-d7de-4587-9ff4-49c211ff5bd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:34:34.141369 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc32819-d7de-4587-9ff4-49c211ff5bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:34:34.141643 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc32819-d7de-4587-9ff4-49c211ff5bd1 admin admin] PATH_INFO: `/v3/projects/1204a45e00b94a7aac1d58cc74cfcbd4` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:34:34.142895 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc32819-d7de-4587-9ff4-49c211ff5bd1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1204a45e00b94a7aac1d58cc74cfcbd4)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:34:34.145417 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc32819-d7de-4587-9ff4-49c211ff5bd1 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:34:34.177788 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ce436f-2e17-4c17-8161-4d94ea8aa3d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41675154bbba47388040966f75d84c3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:34:34.178406 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ce436f-2e17-4c17-8161-4d94ea8aa3d9 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:34:34.178687 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ce436f-2e17-4c17-8161-4d94ea8aa3d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:34:34.178991 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ce436f-2e17-4c17-8161-4d94ea8aa3d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:34:34.180776 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-f9ce436f-2e17-4c17-8161-4d94ea8aa3d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:34:34.188047 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:34:34.191094 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ce436f-2e17-4c17-8161-4d94ea8aa3d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:34:34.193140 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ce436f-2e17-4c17-8161-4d94ea8aa3d9 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:34:34.194905 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-6cc32819-d7de-4587-9ff4-49c211ff5bd1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1204a45e00b94a7aac1d58cc74cfcbd4', 'request_id': 'req-6cc32819-d7de-4587-9ff4-49c211ff5bd1'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:34:34.201555 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-6cc32819-d7de-4587-9ff4-49c211ff5bd1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1204a45e00b94a7aac1d58cc74cfcbd4', 'request_id': 'req-6cc32819-d7de-4587-9ff4-49c211ff5bd1'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:34:34.204528 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1331/2639] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:34:34 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:34:34.207810 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-6cc32819-d7de-4587-9ff4-49c211ff5bd1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1204a45e00b94a7aac1d58cc74cfcbd4', 'request_id': 'req-6cc32819-d7de-4587-9ff4-49c211ff5bd1'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:34:34.217333 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:34:34.223048 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-6cc32819-d7de-4587-9ff4-49c211ff5bd1 admin admin] The token cache is being invalidate because project 1204a45e00b94a7aac1d58cc74cfcbd4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 15:34:34.223681 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-6cc32819-d7de-4587-9ff4-49c211ff5bd1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:34:34.224635 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-6cc32819-d7de-4587-9ff4-49c211ff5bd1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:34:34.227323 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1309/2640] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 13 15:34:34 2022] DELETE /identity/v3/projects/1204a45e00b94a7aac1d58cc74cfcbd4 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 15:34:34.233261 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb9bb2a-2cf7-4c48-aefd-d72f1cf1ff73 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:34:34.233555 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb9bb2a-2cf7-4c48-aefd-d72f1cf1ff73 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:34:34.233869 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb9bb2a-2cf7-4c48-aefd-d72f1cf1ff73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:34:34.255302 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-0eb9bb2a-2cf7-4c48-aefd-d72f1cf1ff73 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:34:34.256524 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-0eb9bb2a-2cf7-4c48-aefd-d72f1cf1ff73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:34:34.319694 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1332/2641] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:34:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:34:34.328290 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9c16bf-78d8-4629-8a29-799a78fa4a73 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:34:34.328689 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9c16bf-78d8-4629-8a29-799a78fa4a73 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:34:34.328970 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9c16bf-78d8-4629-8a29-799a78fa4a73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:34:34.345260 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d939ea8b-4dbf-47e2-ab7b-e3ddb148ae7d None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:34:34.345872 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d939ea8b-4dbf-47e2-ab7b-e3ddb148ae7d None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:34:34.346302 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d939ea8b-4dbf-47e2-ab7b-e3ddb148ae7d None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:34:34.350082 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1333/2642] 10.222.0.27 () {54 vars in 921 bytes} [Tue Sep 13 15:34:34 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:34:34.354436 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-aa9c16bf-78d8-4629-8a29-799a78fa4a73 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:34:34.355945 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-aa9c16bf-78d8-4629-8a29-799a78fa4a73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:34:34.359273 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ffddb5-f4d0-42d6-b615-f0b0dc570ff4 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:34:34.359631 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ffddb5-f4d0-42d6-b615-f0b0dc570ff4 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:34:34.360005 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ffddb5-f4d0-42d6-b615-f0b0dc570ff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:34:34.364696 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1310/2643] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:34:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:34:34.368826 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9c16bf-78d8-4629-8a29-799a78fa4a73 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:34:34.378327 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9c16bf-78d8-4629-8a29-799a78fa4a73 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:34:34.385522 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-24ffddb5-f4d0-42d6-b615-f0b0dc570ff4 None None] MFA Rules not processed for user `41675154bbba47388040966f75d84c3c`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:34:34.386050 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcb41dc-635a-4b92-9fbb-0052430a2bb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:34:34.386659 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcb41dc-635a-4b92-9fbb-0052430a2bb4 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:34:34.386829 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-24ffddb5-f4d0-42d6-b615-f0b0dc570ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:34:34.386950 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcb41dc-635a-4b92-9fbb-0052430a2bb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:34:34.387202 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcb41dc-635a-4b92-9fbb-0052430a2bb4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:34:34.387853 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcb41dc-635a-4b92-9fbb-0052430a2bb4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:34:34.388146 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcb41dc-635a-4b92-9fbb-0052430a2bb4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:34:34.389735 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcb41dc-635a-4b92-9fbb-0052430a2bb4 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:34:34.405667 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1311/2644] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Sep 13 15:34:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 15:34:34.406679 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcb41dc-635a-4b92-9fbb-0052430a2bb4 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:34:34.420627 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcb41dc-635a-4b92-9fbb-0052430a2bb4 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:34:34.425407 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca105de0-7381-4a47-af78-2a283de262c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:34:34.426047 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca105de0-7381-4a47-af78-2a283de262c5 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:34:34.426336 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca105de0-7381-4a47-af78-2a283de262c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:34:34.426615 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca105de0-7381-4a47-af78-2a283de262c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:34:34.427245 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca105de0-7381-4a47-af78-2a283de262c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:34:34.429186 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca105de0-7381-4a47-af78-2a283de262c5 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:34:34.447630 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1334/2645] 10.222.0.27 () {58 vars in 1018 bytes} [Tue Sep 13 15:34:34 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:34:34.462391 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1312/2646] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 13 15:34:34 2022] POST /identity/v3/projects => generated 383 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 15:34:34.463531 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ffddb5-f4d0-42d6-b615-f0b0dc570ff4 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:34:34.466090 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca105de0-7381-4a47-af78-2a283de262c5 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:34:34.468165 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-ca105de0-7381-4a47-af78-2a283de262c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:34:34.476476 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ffddb5-f4d0-42d6-b615-f0b0dc570ff4 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:34:34.537997 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097a6d1a-0fbf-48a7-9907-67ddd86f6a17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:34:34.538621 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097a6d1a-0fbf-48a7-9907-67ddd86f6a17 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:34:34.538906 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097a6d1a-0fbf-48a7-9907-67ddd86f6a17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:34:34.539183 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097a6d1a-0fbf-48a7-9907-67ddd86f6a17 admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:34:34.539848 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097a6d1a-0fbf-48a7-9907-67ddd86f6a17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:34:34.541805 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097a6d1a-0fbf-48a7-9907-67ddd86f6a17 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:34:34.542457 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca105de0-7381-4a47-af78-2a283de262c5 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:34:34.546170 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99768d9-3c27-4733-9b1c-4de2f9513d81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41675154bbba47388040966f75d84c3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:34:34.546843 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99768d9-3c27-4733-9b1c-4de2f9513d81 service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:34:34.547197 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99768d9-3c27-4733-9b1c-4de2f9513d81 service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:34:34.547537 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99768d9-3c27-4733-9b1c-4de2f9513d81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:34:34.555753 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99768d9-3c27-4733-9b1c-4de2f9513d81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:34:34.557180 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99768d9-3c27-4733-9b1c-4de2f9513d81 service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:34:34.564560 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1335/2647] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 13 15:34:34 2022] POST /identity/v3/users => generated 292 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 15:34:34.566478 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1313/2648] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:34:34 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 15:34:34.569626 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097a6d1a-0fbf-48a7-9907-67ddd86f6a17 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:34:34.579903 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097a6d1a-0fbf-48a7-9907-67ddd86f6a17 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:34:34.584846 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71aabd3f-0442-4256-9fda-17ca3e7e7f4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:34:34.585485 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aabd3f-0442-4256-9fda-17ca3e7e7f4a admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:34:34.585805 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aabd3f-0442-4256-9fda-17ca3e7e7f4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:34:34.586086 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aabd3f-0442-4256-9fda-17ca3e7e7f4a admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:34:34.586857 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71aabd3f-0442-4256-9fda-17ca3e7e7f4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:34:34.588465 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71aabd3f-0442-4256-9fda-17ca3e7e7f4a admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:34:34.599267 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1336/2649] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:34:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 15:34:34.604861 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99768d9-3c27-4733-9b1c-4de2f9513d81 service neutron] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:34:34.617281 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99768d9-3c27-4733-9b1c-4de2f9513d81 service neutron] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:34:34.622200 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5c6a31-7951-459f-8dc5-8c85f8ddbb2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:34:34.622801 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5c6a31-7951-459f-8dc5-8c85f8ddbb2f admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:34:34.623108 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5c6a31-7951-459f-8dc5-8c85f8ddbb2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:34:34.623382 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5c6a31-7951-459f-8dc5-8c85f8ddbb2f admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:34:34.624018 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5c6a31-7951-459f-8dc5-8c85f8ddbb2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:34:34.625609 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5c6a31-7951-459f-8dc5-8c85f8ddbb2f admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:34:34.636165 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1314/2650] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:34:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 15:34:34.640296 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71aabd3f-0442-4256-9fda-17ca3e7e7f4a admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:34:34.650942 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71aabd3f-0442-4256-9fda-17ca3e7e7f4a admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:34:34.652932 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792c9b16-da4a-4b26-9994-9ff824721255 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:34:34.653219 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792c9b16-da4a-4b26-9994-9ff824721255 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:34:34.653523 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792c9b16-da4a-4b26-9994-9ff824721255 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:34:34.654871 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1315/2651] 10.222.0.27 () {54 vars in 921 bytes} [Tue Sep 13 15:34:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 15:34:34.655710 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e932a9-dd5b-4f36-9dcc-e62cbfcc2f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:34:34.656369 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e932a9-dd5b-4f36-9dcc-e62cbfcc2f96 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:34:34.656653 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e932a9-dd5b-4f36-9dcc-e62cbfcc2f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:34:34.656927 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e932a9-dd5b-4f36-9dcc-e62cbfcc2f96 admin admin] PATH_INFO: `/v3/projects/28a2c1aaf8374e7c8194c405ff973511/users/d855b6ebc2624b8586f86af13d7a978f/roles/3fae3d3a28e147d3b2bede2378ff79ae` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:34:34.661056 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b664e0-e0a0-4d26-bf24-c160518ff968 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:34:34.661405 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b664e0-e0a0-4d26-bf24-c160518ff968 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:34:34.661863 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b664e0-e0a0-4d26-bf24-c160518ff968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:34:34.672973 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e932a9-dd5b-4f36-9dcc-e62cbfcc2f96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28a2c1aaf8374e7c8194c405ff973511, user_id=d855b6ebc2624b8586f86af13d7a978f, role_id=3fae3d3a28e147d3b2bede2378ff79ae)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:34:34.676653 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e932a9-dd5b-4f36-9dcc-e62cbfcc2f96 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:34:34.682187 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-e3b664e0-e0a0-4d26-bf24-c160518ff968 None None] MFA Rules not processed for user `62aad71c6c1a4469805762bba330bf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:34:34.683404 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-e3b664e0-e0a0-4d26-bf24-c160518ff968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:34:34.685864 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:34:34.691417 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1337/2652] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 13 15:34:34 2022] PUT /identity/v3/projects/28a2c1aaf8374e7c8194c405ff973511/users/d855b6ebc2624b8586f86af13d7a978f/roles/3fae3d3a28e147d3b2bede2378ff79ae => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:34:34.703581 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189a9f7d-e070-483a-97d8-e9054c8aa3ee None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:34:34.703870 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189a9f7d-e070-483a-97d8-e9054c8aa3ee None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:34:34.704139 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189a9f7d-e070-483a-97d8-e9054c8aa3ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:34:34.733940 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-189a9f7d-e070-483a-97d8-e9054c8aa3ee None None] MFA Rules not processed for user `d855b6ebc2624b8586f86af13d7a978f`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:34:34.735152 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-189a9f7d-e070-483a-97d8-e9054c8aa3ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:34:34.763603 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1316/2653] 10.222.0.27 () {58 vars in 1018 bytes} [Tue Sep 13 15:34:34 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:34:34.774087 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b664e0-e0a0-4d26-bf24-c160518ff968 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:34:34.809328 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1338/2654] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:34:34 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 15:34:34.821898 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189a9f7d-e070-483a-97d8-e9054c8aa3ee None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:34:34.824090 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-189a9f7d-e070-483a-97d8-e9054c8aa3ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:34:34.835026 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:34:34.841947 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b664e0-e0a0-4d26-bf24-c160518ff968 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:34:34.846051 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983dd8ab-4311-4c1c-8608-5b6c8de3a75d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41675154bbba47388040966f75d84c3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:34:34.847396 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983dd8ab-4311-4c1c-8608-5b6c8de3a75d service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:34:34.847863 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983dd8ab-4311-4c1c-8608-5b6c8de3a75d service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:34:34.848337 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983dd8ab-4311-4c1c-8608-5b6c8de3a75d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:34:34.860594 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983dd8ab-4311-4c1c-8608-5b6c8de3a75d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:34:34.863089 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983dd8ab-4311-4c1c-8608-5b6c8de3a75d service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:34:34.875094 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1317/2655] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:34:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 15:34:34.898757 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189a9f7d-e070-483a-97d8-e9054c8aa3ee None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:34:34.902869 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e53708-e446-44f1-a5ae-eac9e13a8dd0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97acd23097d54bf7805c3cef60626ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:34:34.903158 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e53708-e446-44f1-a5ae-eac9e13a8dd0 service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:34:34.903513 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e53708-e446-44f1-a5ae-eac9e13a8dd0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:34:34.903863 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e53708-e446-44f1-a5ae-eac9e13a8dd0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:34:34.913452 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e53708-e446-44f1-a5ae-eac9e13a8dd0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:34:34.915404 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e53708-e446-44f1-a5ae-eac9e13a8dd0 service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:34:34.926009 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1339/2656] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:34:34 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 15:34:34.941855 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983dd8ab-4311-4c1c-8608-5b6c8de3a75d service neutron] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:34:34.943272 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-983dd8ab-4311-4c1c-8608-5b6c8de3a75d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:34:34.948518 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e53708-e446-44f1-a5ae-eac9e13a8dd0 service cinder] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:34:35.012887 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e53708-e446-44f1-a5ae-eac9e13a8dd0 service cinder] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:34:35.017588 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25fae78-6f82-4ed9-b70b-1a4f053eea24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:34:35.018310 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25fae78-6f82-4ed9-b70b-1a4f053eea24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:34:35.018616 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25fae78-6f82-4ed9-b70b-1a4f053eea24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:34:35.018997 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25fae78-6f82-4ed9-b70b-1a4f053eea24 admin admin] PATH_INFO: `/v3/users/d855b6ebc2624b8586f86af13d7a978f` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:34:35.020058 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983dd8ab-4311-4c1c-8608-5b6c8de3a75d service neutron] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:34:35.020196 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25fae78-6f82-4ed9-b70b-1a4f053eea24 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d855b6ebc2624b8586f86af13d7a978f)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:34:35.022022 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25fae78-6f82-4ed9-b70b-1a4f053eea24 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:34:35.025065 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d8d19c-32fc-434f-bb00-b1b34f5936de service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b56f96cb3184a3ba82c8a0c3427e268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:34:35.025662 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d8d19c-32fc-434f-bb00-b1b34f5936de service placement] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:34:35.025972 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d8d19c-32fc-434f-bb00-b1b34f5936de service placement] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:34:35.026245 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d8d19c-32fc-434f-bb00-b1b34f5936de service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:34:35.027982 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-b0d8d19c-32fc-434f-bb00-b1b34f5936de service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:34:35.042497 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d8d19c-32fc-434f-bb00-b1b34f5936de service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:34:35.044144 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d8d19c-32fc-434f-bb00-b1b34f5936de service placement] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:34:35.056818 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1318/2657] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:34:34 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:34:35.061280 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:34:35.071719 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-f25fae78-6f82-4ed9-b70b-1a4f053eea24 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd855b6ebc2624b8586f86af13d7a978f'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:34:35.072403 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-f25fae78-6f82-4ed9-b70b-1a4f053eea24 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd855b6ebc2624b8586f86af13d7a978f'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:34:35.073023 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-f25fae78-6f82-4ed9-b70b-1a4f053eea24 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd855b6ebc2624b8586f86af13d7a978f'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:34:35.080358 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-f25fae78-6f82-4ed9-b70b-1a4f053eea24 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd855b6ebc2624b8586f86af13d7a978f'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:34:35.092155 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-f25fae78-6f82-4ed9-b70b-1a4f053eea24 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd855b6ebc2624b8586f86af13d7a978f'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:34:35.104966 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1340/2658] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 13 15:34:34 2022] DELETE /identity/v3/users/d855b6ebc2624b8586f86af13d7a978f => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:34:35.109477 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fcc669-4c08-4b0a-96d4-f72ccce9b74c None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:34:35.109816 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fcc669-4c08-4b0a-96d4-f72ccce9b74c None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:34:35.110098 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fcc669-4c08-4b0a-96d4-f72ccce9b74c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:34:35.133433 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-74fcc669-4c08-4b0a-96d4-f72ccce9b74c None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:34:35.134912 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-74fcc669-4c08-4b0a-96d4-f72ccce9b74c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:34:35.197261 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1319/2659] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:34:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:34:35.208637 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25fae78-6f82-4ed9-b70b-1a4f053eea24 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:34:35.210624 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-f25fae78-6f82-4ed9-b70b-1a4f053eea24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:34:35.273574 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25fae78-6f82-4ed9-b70b-1a4f053eea24 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:34:35.277308 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8d2dd6-8410-445a-a4e1-50048699dcfc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41675154bbba47388040966f75d84c3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:34:35.277955 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8d2dd6-8410-445a-a4e1-50048699dcfc service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:34:35.278239 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8d2dd6-8410-445a-a4e1-50048699dcfc service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:34:35.278512 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8d2dd6-8410-445a-a4e1-50048699dcfc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:34:35.288649 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8d2dd6-8410-445a-a4e1-50048699dcfc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:34:35.290133 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8d2dd6-8410-445a-a4e1-50048699dcfc service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:34:35.299699 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1341/2660] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:34:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:34:35.602965 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fcc669-4c08-4b0a-96d4-f72ccce9b74c None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:34:35.604488 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-74fcc669-4c08-4b0a-96d4-f72ccce9b74c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:34:35.616876 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fcc669-4c08-4b0a-96d4-f72ccce9b74c None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:34:35.622165 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be6a2ef-84d9-4481-bec4-957a026a8dde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:34:35.622758 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be6a2ef-84d9-4481-bec4-957a026a8dde admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:34:35.623044 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be6a2ef-84d9-4481-bec4-957a026a8dde admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:34:35.623347 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be6a2ef-84d9-4481-bec4-957a026a8dde admin admin] PATH_INFO: `/v3/projects/28a2c1aaf8374e7c8194c405ff973511` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:34:35.624582 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be6a2ef-84d9-4481-bec4-957a026a8dde admin admin] RBAC: Authorizing `identity:delete_project(project_id=28a2c1aaf8374e7c8194c405ff973511)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:34:35.627292 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be6a2ef-84d9-4481-bec4-957a026a8dde admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:34:35.685260 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-0be6a2ef-84d9-4481-bec4-957a026a8dde admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28a2c1aaf8374e7c8194c405ff973511', 'request_id': 'req-0be6a2ef-84d9-4481-bec4-957a026a8dde'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:34:35.693040 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-0be6a2ef-84d9-4481-bec4-957a026a8dde admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28a2c1aaf8374e7c8194c405ff973511', 'request_id': 'req-0be6a2ef-84d9-4481-bec4-957a026a8dde'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:34:35.702145 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-0be6a2ef-84d9-4481-bec4-957a026a8dde admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28a2c1aaf8374e7c8194c405ff973511', 'request_id': 'req-0be6a2ef-84d9-4481-bec4-957a026a8dde'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:34:35.726403 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:34:35.732285 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-0be6a2ef-84d9-4481-bec4-957a026a8dde admin admin] The token cache is being invalidate because project 28a2c1aaf8374e7c8194c405ff973511 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 15:34:35.732818 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-0be6a2ef-84d9-4481-bec4-957a026a8dde admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:34:35.734043 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-0be6a2ef-84d9-4481-bec4-957a026a8dde admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:34:35.735599 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1320/2661] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 13 15:34:35 2022] DELETE /identity/v3/projects/28a2c1aaf8374e7c8194c405ff973511 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:34:35.741268 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608c0d97-ea95-4908-9ec3-e91adb747147 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:34:35.741794 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608c0d97-ea95-4908-9ec3-e91adb747147 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:34:35.741921 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608c0d97-ea95-4908-9ec3-e91adb747147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:34:35.762843 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-608c0d97-ea95-4908-9ec3-e91adb747147 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:34:35.764087 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-608c0d97-ea95-4908-9ec3-e91adb747147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:34:35.825974 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1342/2662] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:34:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:34:35.834706 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb9b88e-0950-4ff6-af1d-7aeccd2dc543 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:34:35.835015 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb9b88e-0950-4ff6-af1d-7aeccd2dc543 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:34:35.835301 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb9b88e-0950-4ff6-af1d-7aeccd2dc543 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:34:35.855811 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-bfb9b88e-0950-4ff6-af1d-7aeccd2dc543 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:34:35.857045 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-bfb9b88e-0950-4ff6-af1d-7aeccd2dc543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:34:35.866402 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1321/2663] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:34:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:34:35.870928 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608c0d97-ea95-4908-9ec3-e91adb747147 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:34:35.885392 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608c0d97-ea95-4908-9ec3-e91adb747147 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:34:35.890352 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3d48e1-0a41-4a14-a201-59f8e085e735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:34:35.890963 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3d48e1-0a41-4a14-a201-59f8e085e735 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:34:35.891246 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3d48e1-0a41-4a14-a201-59f8e085e735 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:34:35.891522 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3d48e1-0a41-4a14-a201-59f8e085e735 admin admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:34:35.892181 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3d48e1-0a41-4a14-a201-59f8e085e735 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:34:35.892545 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3d48e1-0a41-4a14-a201-59f8e085e735 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:34:35.894384 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3d48e1-0a41-4a14-a201-59f8e085e735 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:34:35.906805 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1343/2664] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Sep 13 15:34:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:34:35.910751 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb9b88e-0950-4ff6-af1d-7aeccd2dc543 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:34:35.920168 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb9b88e-0950-4ff6-af1d-7aeccd2dc543 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:34:35.926992 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f551493-24f2-41c3-a4b9-394aaf0ea9e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:34:35.927670 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f551493-24f2-41c3-a4b9-394aaf0ea9e4 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:34:35.927967 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f551493-24f2-41c3-a4b9-394aaf0ea9e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:34:35.928245 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f551493-24f2-41c3-a4b9-394aaf0ea9e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:34:35.929022 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f551493-24f2-41c3-a4b9-394aaf0ea9e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:34:35.930967 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f551493-24f2-41c3-a4b9-394aaf0ea9e4 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:34:35.960511 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1322/2665] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 13 15:34:35 2022] POST /identity/v3/projects => generated 377 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 15:34:35.964898 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3d48e1-0a41-4a14-a201-59f8e085e735 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:34:35.975969 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3d48e1-0a41-4a14-a201-59f8e085e735 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:34:36.021812 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:34:36.042133 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab57947-8516-415b-a49c-3114f625a122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:34:36.042913 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab57947-8516-415b-a49c-3114f625a122 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:34:36.043302 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab57947-8516-415b-a49c-3114f625a122 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:34:36.044045 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab57947-8516-415b-a49c-3114f625a122 admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:34:36.044431 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab57947-8516-415b-a49c-3114f625a122 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:34:36.046598 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab57947-8516-415b-a49c-3114f625a122 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:34:36.071476 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1344/2666] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 13 15:34:35 2022] POST /identity/v3/users => generated 289 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:34:36.075340 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f551493-24f2-41c3-a4b9-394aaf0ea9e4 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:34:36.086357 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f551493-24f2-41c3-a4b9-394aaf0ea9e4 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:34:36.091323 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081fbd80-8573-46a9-8b79-7f35905e15da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:34:36.091820 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081fbd80-8573-46a9-8b79-7f35905e15da admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:34:36.092107 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081fbd80-8573-46a9-8b79-7f35905e15da admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:34:36.092385 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081fbd80-8573-46a9-8b79-7f35905e15da admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:34:36.093033 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081fbd80-8573-46a9-8b79-7f35905e15da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:34:36.094686 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081fbd80-8573-46a9-8b79-7f35905e15da admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:34:36.106410 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1323/2667] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:34:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 15:34:36.110756 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab57947-8516-415b-a49c-3114f625a122 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:34:36.124140 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab57947-8516-415b-a49c-3114f625a122 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:34:36.129677 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f64fc9-7659-45fc-8905-37dd00fae6a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:34:36.130319 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f64fc9-7659-45fc-8905-37dd00fae6a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:34:36.130600 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f64fc9-7659-45fc-8905-37dd00fae6a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:34:36.130876 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f64fc9-7659-45fc-8905-37dd00fae6a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:34:36.131520 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f64fc9-7659-45fc-8905-37dd00fae6a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:34:36.133571 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f64fc9-7659-45fc-8905-37dd00fae6a2 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:34:36.151515 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1345/2668] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:34:36 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 15:34:36.155665 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081fbd80-8573-46a9-8b79-7f35905e15da admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:34:36.167402 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081fbd80-8573-46a9-8b79-7f35905e15da admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:34:36.173564 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2f4f36-3143-4658-b9f5-f6c3e57b8f9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:34:36.174269 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2f4f36-3143-4658-b9f5-f6c3e57b8f9e admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:34:36.175161 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2f4f36-3143-4658-b9f5-f6c3e57b8f9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:34:36.176868 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2f4f36-3143-4658-b9f5-f6c3e57b8f9e admin admin] PATH_INFO: `/v3/projects/7dfe9c649cbf475cad78e38aa2d3a7f3/users/e393c5ad6af74457b1f8a1b3d9aceafe/roles/3fae3d3a28e147d3b2bede2378ff79ae` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:34:36.192962 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2f4f36-3143-4658-b9f5-f6c3e57b8f9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7dfe9c649cbf475cad78e38aa2d3a7f3, user_id=e393c5ad6af74457b1f8a1b3d9aceafe, role_id=3fae3d3a28e147d3b2bede2378ff79ae)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:34:36.195949 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2f4f36-3143-4658-b9f5-f6c3e57b8f9e admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:34:36.209782 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1324/2669] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 13 15:34:36 2022] PUT /identity/v3/projects/7dfe9c649cbf475cad78e38aa2d3a7f3/users/e393c5ad6af74457b1f8a1b3d9aceafe/roles/3fae3d3a28e147d3b2bede2378ff79ae => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:34:36.220032 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e12345-5d69-41cd-ba64-5c1b6db450c5 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:34:36.220322 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e12345-5d69-41cd-ba64-5c1b6db450c5 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:34:36.220604 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e12345-5d69-41cd-ba64-5c1b6db450c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:34:36.247977 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-f7e12345-5d69-41cd-ba64-5c1b6db450c5 None None] MFA Rules not processed for user `e393c5ad6af74457b1f8a1b3d9aceafe`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:34:36.249200 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-f7e12345-5d69-41cd-ba64-5c1b6db450c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:34:36.312355 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1346/2670] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:34:36 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:34:36.324120 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2f4f36-3143-4658-b9f5-f6c3e57b8f9e admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:34:36.326143 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-5f2f4f36-3143-4658-b9f5-f6c3e57b8f9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:34:36.383485 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2f4f36-3143-4658-b9f5-f6c3e57b8f9e admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:34:36.387282 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fbd6c1-26b2-4afd-bb6f-07ce54b4c2e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97acd23097d54bf7805c3cef60626ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:34:36.387892 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fbd6c1-26b2-4afd-bb6f-07ce54b4c2e5 service cinder] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:34:36.388172 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fbd6c1-26b2-4afd-bb6f-07ce54b4c2e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:34:36.388447 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fbd6c1-26b2-4afd-bb6f-07ce54b4c2e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:34:36.397145 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fbd6c1-26b2-4afd-bb6f-07ce54b4c2e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:34:36.398640 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fbd6c1-26b2-4afd-bb6f-07ce54b4c2e5 service cinder] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:34:36.407924 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1325/2671] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:34:36 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:34:36.753808 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e12345-5d69-41cd-ba64-5c1b6db450c5 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:34:36.756310 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-f7e12345-5d69-41cd-ba64-5c1b6db450c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:34:36.881979 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e12345-5d69-41cd-ba64-5c1b6db450c5 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:34:36.888243 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44953cc7-0364-4df1-8e9d-1616649930ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62aad71c6c1a4469805762bba330bf0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:34:36.889007 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44953cc7-0364-4df1-8e9d-1616649930ac service nova] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:34:36.889295 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44953cc7-0364-4df1-8e9d-1616649930ac service nova] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:34:36.889566 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44953cc7-0364-4df1-8e9d-1616649930ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:34:36.891375 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-44953cc7-0364-4df1-8e9d-1616649930ac service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:34:36.906088 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44953cc7-0364-4df1-8e9d-1616649930ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:34:36.907685 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44953cc7-0364-4df1-8e9d-1616649930ac service nova] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:34:36.919130 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1347/2672] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:34:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:34:46.403881 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=54,keystone:INSERT=2 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:34:46.914562 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=81,keystone:INSERT=3 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:34:47.927345 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fbd6c1-26b2-4afd-bb6f-07ce54b4c2e5 service cinder] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:34:47.991761 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a74b798-5824-4261-a6a5-c250d04bdc79 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:34:47.992433 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a74b798-5824-4261-a6a5-c250d04bdc79 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:34:47.992812 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a74b798-5824-4261-a6a5-c250d04bdc79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:34:48.001229 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fbd6c1-26b2-4afd-bb6f-07ce54b4c2e5 service cinder] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:34:48.008339 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1f5d69-c60f-4b10-bfe1-80ca47b3a8d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:34:48.009226 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1f5d69-c60f-4b10-bfe1-80ca47b3a8d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:34:48.009226 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1f5d69-c60f-4b10-bfe1-80ca47b3a8d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:34:48.009522 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1f5d69-c60f-4b10-bfe1-80ca47b3a8d4 admin admin] PATH_INFO: `/v3/users/e393c5ad6af74457b1f8a1b3d9aceafe` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:34:48.011171 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1f5d69-c60f-4b10-bfe1-80ca47b3a8d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e393c5ad6af74457b1f8a1b3d9aceafe)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:34:48.013723 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1f5d69-c60f-4b10-bfe1-80ca47b3a8d4 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:34:48.017239 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-5a74b798-5824-4261-a6a5-c250d04bdc79 None None] MFA Rules not processed for user `e97bcdb20f1e416ea41b99c226617faf`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:34:48.018873 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-5a74b798-5824-4261-a6a5-c250d04bdc79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:34:48.067438 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-5c1f5d69-c60f-4b10-bfe1-80ca47b3a8d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e393c5ad6af74457b1f8a1b3d9aceafe'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:34:48.068092 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-5c1f5d69-c60f-4b10-bfe1-80ca47b3a8d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e393c5ad6af74457b1f8a1b3d9aceafe'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:34:48.068720 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-5c1f5d69-c60f-4b10-bfe1-80ca47b3a8d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e393c5ad6af74457b1f8a1b3d9aceafe'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:34:48.075944 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-5c1f5d69-c60f-4b10-bfe1-80ca47b3a8d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e393c5ad6af74457b1f8a1b3d9aceafe'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:34:48.088505 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-5c1f5d69-c60f-4b10-bfe1-80ca47b3a8d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e393c5ad6af74457b1f8a1b3d9aceafe'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:34:48.102145 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1348/2673] 10.222.0.27 () {58 vars in 1009 bytes} [Tue Sep 13 15:34:47 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 15:34:48.106864 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1326/2674] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 13 15:34:47 2022] DELETE /identity/v3/users/e393c5ad6af74457b1f8a1b3d9aceafe => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:34:48.111485 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087984d6-555d-40a1-9c53-4b129e0df2ee None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:34:48.112305 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087984d6-555d-40a1-9c53-4b129e0df2ee None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:34:48.112541 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087984d6-555d-40a1-9c53-4b129e0df2ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:34:48.132407 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-087984d6-555d-40a1-9c53-4b129e0df2ee None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:34:48.133614 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-087984d6-555d-40a1-9c53-4b129e0df2ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:34:48.152111 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1f5d69-c60f-4b10-bfe1-80ca47b3a8d4 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:34:48.153633 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-5c1f5d69-c60f-4b10-bfe1-80ca47b3a8d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:34:48.196414 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1349/2675] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:34:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:34:48.207038 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087984d6-555d-40a1-9c53-4b129e0df2ee None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:34:48.208414 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-087984d6-555d-40a1-9c53-4b129e0df2ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:34:48.230741 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1f5d69-c60f-4b10-bfe1-80ca47b3a8d4 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:34:48.236239 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b14c21-35a5-4293-bfda-f7ac9ff6ee20 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc735644be394e0abe73e709373e2003', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:34:48.236882 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b14c21-35a5-4293-bfda-f7ac9ff6ee20 service swift] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:34:48.237160 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b14c21-35a5-4293-bfda-f7ac9ff6ee20 service swift] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:34:48.237431 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b14c21-35a5-4293-bfda-f7ac9ff6ee20 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:34:48.257042 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:34:48.271498 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087984d6-555d-40a1-9c53-4b129e0df2ee None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:34:48.275211 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f73f06-91d2-4615-9c0b-f662310c9d76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41675154bbba47388040966f75d84c3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:34:48.275820 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f73f06-91d2-4615-9c0b-f662310c9d76 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:34:48.276096 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f73f06-91d2-4615-9c0b-f662310c9d76 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:34:48.276369 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f73f06-91d2-4615-9c0b-f662310c9d76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:34:48.287313 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f73f06-91d2-4615-9c0b-f662310c9d76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:34:48.288749 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f73f06-91d2-4615-9c0b-f662310c9d76 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:34:48.298347 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1350/2676] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:34:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 15:34:48.300525 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b14c21-35a5-4293-bfda-f7ac9ff6ee20 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:34:48.302243 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b14c21-35a5-4293-bfda-f7ac9ff6ee20 service swift] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:34:48.310840 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1327/2677] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Sep 13 15:34:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 13 15:34:48.654337 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f73f06-91d2-4615-9c0b-f662310c9d76 service neutron] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:34:48.655788 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-02f73f06-91d2-4615-9c0b-f662310c9d76 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:34:48.673787 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f73f06-91d2-4615-9c0b-f662310c9d76 service neutron] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:34:48.680606 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282a0d23-2a68-4d03-a86e-1f5086e92b0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:34:48.681409 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282a0d23-2a68-4d03-a86e-1f5086e92b0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:34:48.681833 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282a0d23-2a68-4d03-a86e-1f5086e92b0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:34:48.682217 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282a0d23-2a68-4d03-a86e-1f5086e92b0a admin admin] PATH_INFO: `/v3/projects/7dfe9c649cbf475cad78e38aa2d3a7f3` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:34:48.683983 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282a0d23-2a68-4d03-a86e-1f5086e92b0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=7dfe9c649cbf475cad78e38aa2d3a7f3)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:34:48.686771 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282a0d23-2a68-4d03-a86e-1f5086e92b0a admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:34:48.887172 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:34:48.892178 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-282a0d23-2a68-4d03-a86e-1f5086e92b0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7dfe9c649cbf475cad78e38aa2d3a7f3', 'request_id': 'req-282a0d23-2a68-4d03-a86e-1f5086e92b0a'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:34:48.902019 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-282a0d23-2a68-4d03-a86e-1f5086e92b0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7dfe9c649cbf475cad78e38aa2d3a7f3', 'request_id': 'req-282a0d23-2a68-4d03-a86e-1f5086e92b0a'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:34:48.922614 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-282a0d23-2a68-4d03-a86e-1f5086e92b0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7dfe9c649cbf475cad78e38aa2d3a7f3', 'request_id': 'req-282a0d23-2a68-4d03-a86e-1f5086e92b0a'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:34:48.950174 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-282a0d23-2a68-4d03-a86e-1f5086e92b0a admin admin] The token cache is being invalidate because project 7dfe9c649cbf475cad78e38aa2d3a7f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 15:34:48.950836 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-282a0d23-2a68-4d03-a86e-1f5086e92b0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:34:48.951731 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-282a0d23-2a68-4d03-a86e-1f5086e92b0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:34:48.955936 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1351/2678] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 13 15:34:48 2022] DELETE /identity/v3/projects/7dfe9c649cbf475cad78e38aa2d3a7f3 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:34:48.961178 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707c41a3-f10a-46c6-a660-0b84c4471292 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:34:48.961761 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707c41a3-f10a-46c6-a660-0b84c4471292 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:34:48.961761 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707c41a3-f10a-46c6-a660-0b84c4471292 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:34:48.986925 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-707c41a3-f10a-46c6-a660-0b84c4471292 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:34:48.988285 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-707c41a3-f10a-46c6-a660-0b84c4471292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:34:49.081880 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1328/2679] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:34:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:34:49.087285 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d353b2-86ab-4dff-8861-6c053b800686 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:34:49.087773 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d353b2-86ab-4dff-8861-6c053b800686 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:34:49.087983 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d353b2-86ab-4dff-8861-6c053b800686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:34:49.111319 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-66d353b2-86ab-4dff-8861-6c053b800686 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:34:49.113265 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-66d353b2-86ab-4dff-8861-6c053b800686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:34:49.122583 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1352/2680] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:34:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:34:49.126910 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707c41a3-f10a-46c6-a660-0b84c4471292 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:34:49.145842 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707c41a3-f10a-46c6-a660-0b84c4471292 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:34:49.150876 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584a6b40-56f8-414e-a592-99e006345abc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:34:49.151568 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584a6b40-56f8-414e-a592-99e006345abc admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:34:49.151920 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584a6b40-56f8-414e-a592-99e006345abc admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:34:49.152264 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584a6b40-56f8-414e-a592-99e006345abc admin admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:34:49.152990 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584a6b40-56f8-414e-a592-99e006345abc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:34:49.153356 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584a6b40-56f8-414e-a592-99e006345abc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:34:49.155922 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584a6b40-56f8-414e-a592-99e006345abc admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:34:49.173758 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1329/2681] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Sep 13 15:34:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 15:34:49.176205 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d353b2-86ab-4dff-8861-6c053b800686 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:34:49.188732 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d353b2-86ab-4dff-8861-6c053b800686 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:34:49.194684 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c907dd-2512-4450-ac66-ac8e0d4adf14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:34:49.196236 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c907dd-2512-4450-ac66-ac8e0d4adf14 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:34:49.196605 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c907dd-2512-4450-ac66-ac8e0d4adf14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:34:49.197028 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c907dd-2512-4450-ac66-ac8e0d4adf14 admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:34:49.199497 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c907dd-2512-4450-ac66-ac8e0d4adf14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:34:49.202103 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c907dd-2512-4450-ac66-ac8e0d4adf14 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:34:49.241176 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1353/2682] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 13 15:34:49 2022] POST /identity/v3/projects => generated 371 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:34:49.245400 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584a6b40-56f8-414e-a592-99e006345abc admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:34:49.256212 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584a6b40-56f8-414e-a592-99e006345abc admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:34:49.326754 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a6e225-1cec-40d5-bdc3-8ce10e23ae55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:34:49.327367 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a6e225-1cec-40d5-bdc3-8ce10e23ae55 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:34:49.327651 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a6e225-1cec-40d5-bdc3-8ce10e23ae55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:34:49.327927 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a6e225-1cec-40d5-bdc3-8ce10e23ae55 admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:34:49.328578 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a6e225-1cec-40d5-bdc3-8ce10e23ae55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:34:49.331210 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a6e225-1cec-40d5-bdc3-8ce10e23ae55 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:34:49.363426 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c907dd-2512-4450-ac66-ac8e0d4adf14 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:34:49.365382 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1330/2683] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 13 15:34:49 2022] POST /identity/v3/users => generated 286 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:34:49.379788 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c907dd-2512-4450-ac66-ac8e0d4adf14 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:34:49.384795 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22586cd-9c51-44fd-8f9a-4ce43f620fb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:34:49.385485 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22586cd-9c51-44fd-8f9a-4ce43f620fb6 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:34:49.385883 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22586cd-9c51-44fd-8f9a-4ce43f620fb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:34:49.386235 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22586cd-9c51-44fd-8f9a-4ce43f620fb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:34:49.386946 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22586cd-9c51-44fd-8f9a-4ce43f620fb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:34:49.388618 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22586cd-9c51-44fd-8f9a-4ce43f620fb6 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:34:49.404840 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1354/2684] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:34:49 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 15:34:49.409886 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a6e225-1cec-40d5-bdc3-8ce10e23ae55 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:34:49.422118 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a6e225-1cec-40d5-bdc3-8ce10e23ae55 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:34:49.432546 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5eeaf8d-bfae-48e0-bd1b-5d916f2baece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:34:49.433225 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eeaf8d-bfae-48e0-bd1b-5d916f2baece admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:34:49.433509 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eeaf8d-bfae-48e0-bd1b-5d916f2baece admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:34:49.433817 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eeaf8d-bfae-48e0-bd1b-5d916f2baece admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:34:49.434672 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5eeaf8d-bfae-48e0-bd1b-5d916f2baece admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:34:49.436465 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5eeaf8d-bfae-48e0-bd1b-5d916f2baece admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:34:49.450392 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1331/2685] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:34:49 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 15:34:49.453837 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22586cd-9c51-44fd-8f9a-4ce43f620fb6 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:34:49.467491 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22586cd-9c51-44fd-8f9a-4ce43f620fb6 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:34:49.472724 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3896b2e-69c4-45e7-98c9-d0e48f1397f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:34:49.473501 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3896b2e-69c4-45e7-98c9-d0e48f1397f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:34:49.473926 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3896b2e-69c4-45e7-98c9-d0e48f1397f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:34:49.474215 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3896b2e-69c4-45e7-98c9-d0e48f1397f1 admin admin] PATH_INFO: `/v3/projects/637fce4b397c46828a4d5c42626c64e5/users/6ab947dc19904df195e7df6d8951a208/roles/3fae3d3a28e147d3b2bede2378ff79ae` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:34:49.492816 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3896b2e-69c4-45e7-98c9-d0e48f1397f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=637fce4b397c46828a4d5c42626c64e5, user_id=6ab947dc19904df195e7df6d8951a208, role_id=3fae3d3a28e147d3b2bede2378ff79ae)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:34:49.495563 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3896b2e-69c4-45e7-98c9-d0e48f1397f1 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:34:49.514614 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1355/2686] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 13 15:34:49 2022] PUT /identity/v3/projects/637fce4b397c46828a4d5c42626c64e5/users/6ab947dc19904df195e7df6d8951a208/roles/3fae3d3a28e147d3b2bede2378ff79ae => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 15:34:49.529739 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef76587-1389-4b16-abf7-4b496ac3710e None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:34:49.530203 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef76587-1389-4b16-abf7-4b496ac3710e None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:34:49.530667 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef76587-1389-4b16-abf7-4b496ac3710e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:34:49.570213 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-fef76587-1389-4b16-abf7-4b496ac3710e None None] MFA Rules not processed for user `6ab947dc19904df195e7df6d8951a208`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:34:49.571484 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-fef76587-1389-4b16-abf7-4b496ac3710e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:34:49.589262 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:34:49.666043 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1332/2687] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:34:49 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:34:49.668986 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3896b2e-69c4-45e7-98c9-d0e48f1397f1 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:34:49.671277 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-d3896b2e-69c4-45e7-98c9-d0e48f1397f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:34:49.753233 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3896b2e-69c4-45e7-98c9-d0e48f1397f1 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:34:49.757173 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4575d6f2-203e-45b1-b92b-4ecfc9e97741 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97acd23097d54bf7805c3cef60626ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:34:49.758902 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4575d6f2-203e-45b1-b92b-4ecfc9e97741 service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:34:49.759298 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4575d6f2-203e-45b1-b92b-4ecfc9e97741 service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:34:49.759696 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4575d6f2-203e-45b1-b92b-4ecfc9e97741 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:34:49.771537 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4575d6f2-203e-45b1-b92b-4ecfc9e97741 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:34:49.773167 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4575d6f2-203e-45b1-b92b-4ecfc9e97741 service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:34:49.782697 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1356/2688] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:34:49 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:34:49.810949 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef76587-1389-4b16-abf7-4b496ac3710e None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:34:49.889174 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef76587-1389-4b16-abf7-4b496ac3710e None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:34:49.893998 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40d42be-8651-4af2-b682-6390cd29ec9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:34:49.894674 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40d42be-8651-4af2-b682-6390cd29ec9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:34:49.894956 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40d42be-8651-4af2-b682-6390cd29ec9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:34:49.895233 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40d42be-8651-4af2-b682-6390cd29ec9f admin admin] PATH_INFO: `/v3/users/6ab947dc19904df195e7df6d8951a208` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:34:49.896393 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40d42be-8651-4af2-b682-6390cd29ec9f admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ab947dc19904df195e7df6d8951a208)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:34:49.898362 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40d42be-8651-4af2-b682-6390cd29ec9f admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:34:49.964427 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-b40d42be-8651-4af2-b682-6390cd29ec9f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ab947dc19904df195e7df6d8951a208'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:34:49.965223 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-b40d42be-8651-4af2-b682-6390cd29ec9f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ab947dc19904df195e7df6d8951a208'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:34:49.965942 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-b40d42be-8651-4af2-b682-6390cd29ec9f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ab947dc19904df195e7df6d8951a208'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:34:49.974389 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-b40d42be-8651-4af2-b682-6390cd29ec9f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ab947dc19904df195e7df6d8951a208'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:34:49.988183 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-b40d42be-8651-4af2-b682-6390cd29ec9f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ab947dc19904df195e7df6d8951a208'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:34:50.016402 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6717118-fd1e-42f2-9600-d4e69e0f4140 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:34:50.016731 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6717118-fd1e-42f2-9600-d4e69e0f4140 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:34:50.016955 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6717118-fd1e-42f2-9600-d4e69e0f4140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:34:50.021540 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1333/2689] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 13 15:34:49 2022] DELETE /identity/v3/users/6ab947dc19904df195e7df6d8951a208 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:34:50.041327 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-c6717118-fd1e-42f2-9600-d4e69e0f4140 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:34:50.042587 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-c6717118-fd1e-42f2-9600-d4e69e0f4140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:34:50.115628 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1357/2690] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:34:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:34:50.125797 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40d42be-8651-4af2-b682-6390cd29ec9f admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:34:50.128172 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-b40d42be-8651-4af2-b682-6390cd29ec9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:34:50.175782 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:34:50.199209 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40d42be-8651-4af2-b682-6390cd29ec9f admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:34:50.203774 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd8fc5d-4236-4d81-91f4-fd925a4f2eb0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41675154bbba47388040966f75d84c3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:34:50.204386 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd8fc5d-4236-4d81-91f4-fd925a4f2eb0 service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:34:50.204691 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd8fc5d-4236-4d81-91f4-fd925a4f2eb0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:34:50.204972 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd8fc5d-4236-4d81-91f4-fd925a4f2eb0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:34:50.216004 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd8fc5d-4236-4d81-91f4-fd925a4f2eb0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:34:50.217473 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd8fc5d-4236-4d81-91f4-fd925a4f2eb0 service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:34:50.228579 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1334/2691] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:34:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 15:34:50.652973 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6717118-fd1e-42f2-9600-d4e69e0f4140 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:34:50.654211 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-c6717118-fd1e-42f2-9600-d4e69e0f4140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:34:50.666553 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6717118-fd1e-42f2-9600-d4e69e0f4140 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:34:50.685226 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e75c286-45ca-4d16-94fa-f385e2b68114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:34:50.685226 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e75c286-45ca-4d16-94fa-f385e2b68114 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:34:50.685454 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e75c286-45ca-4d16-94fa-f385e2b68114 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:34:50.685750 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e75c286-45ca-4d16-94fa-f385e2b68114 admin admin] PATH_INFO: `/v3/projects/637fce4b397c46828a4d5c42626c64e5` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:34:50.687398 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e75c286-45ca-4d16-94fa-f385e2b68114 admin admin] RBAC: Authorizing `identity:delete_project(project_id=637fce4b397c46828a4d5c42626c64e5)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:34:50.689194 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e75c286-45ca-4d16-94fa-f385e2b68114 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:34:50.700612 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:34:50.760914 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-0e75c286-45ca-4d16-94fa-f385e2b68114 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '637fce4b397c46828a4d5c42626c64e5', 'request_id': 'req-0e75c286-45ca-4d16-94fa-f385e2b68114'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:34:50.770453 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-0e75c286-45ca-4d16-94fa-f385e2b68114 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '637fce4b397c46828a4d5c42626c64e5', 'request_id': 'req-0e75c286-45ca-4d16-94fa-f385e2b68114'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:34:50.778700 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-0e75c286-45ca-4d16-94fa-f385e2b68114 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '637fce4b397c46828a4d5c42626c64e5', 'request_id': 'req-0e75c286-45ca-4d16-94fa-f385e2b68114'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:34:50.795147 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-0e75c286-45ca-4d16-94fa-f385e2b68114 admin admin] The token cache is being invalidate because project 637fce4b397c46828a4d5c42626c64e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 15:34:50.795693 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-0e75c286-45ca-4d16-94fa-f385e2b68114 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:34:50.796604 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-0e75c286-45ca-4d16-94fa-f385e2b68114 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:34:50.798140 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1358/2692] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 13 15:34:50 2022] DELETE /identity/v3/projects/637fce4b397c46828a4d5c42626c64e5 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:34:50.803823 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88380b8-f0d2-48e9-94a8-dad4087da963 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:34:50.804142 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88380b8-f0d2-48e9-94a8-dad4087da963 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:34:50.804424 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88380b8-f0d2-48e9-94a8-dad4087da963 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:34:50.831180 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-c88380b8-f0d2-48e9-94a8-dad4087da963 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:34:50.832427 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-c88380b8-f0d2-48e9-94a8-dad4087da963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:34:50.904851 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1335/2693] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:34:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:34:50.914754 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f74c9d-a8c8-4258-a8db-f03d1b6951ad None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:34:50.915051 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f74c9d-a8c8-4258-a8db-f03d1b6951ad None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:34:50.919004 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f74c9d-a8c8-4258-a8db-f03d1b6951ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:34:50.952830 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-89f74c9d-a8c8-4258-a8db-f03d1b6951ad None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:34:50.955025 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-89f74c9d-a8c8-4258-a8db-f03d1b6951ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:34:50.967731 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1359/2694] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:34:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:34:50.968738 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88380b8-f0d2-48e9-94a8-dad4087da963 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:34:50.981309 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88380b8-f0d2-48e9-94a8-dad4087da963 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:34:50.987386 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b05847-5b35-46b8-a1a7-bb6d085b79e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:34:50.988215 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b05847-5b35-46b8-a1a7-bb6d085b79e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:34:50.988559 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b05847-5b35-46b8-a1a7-bb6d085b79e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:34:50.988903 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b05847-5b35-46b8-a1a7-bb6d085b79e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:34:50.989661 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b05847-5b35-46b8-a1a7-bb6d085b79e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:34:50.990074 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b05847-5b35-46b8-a1a7-bb6d085b79e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:34:50.991731 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b05847-5b35-46b8-a1a7-bb6d085b79e7 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:34:51.005281 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1336/2695] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Sep 13 15:34:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:34:51.009915 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f74c9d-a8c8-4258-a8db-f03d1b6951ad None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:34:51.021023 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f74c9d-a8c8-4258-a8db-f03d1b6951ad None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:34:51.025945 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754f9133-f54c-4080-aab8-4b30a8e2c293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:34:51.026727 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754f9133-f54c-4080-aab8-4b30a8e2c293 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:34:51.027013 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754f9133-f54c-4080-aab8-4b30a8e2c293 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:34:51.027282 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754f9133-f54c-4080-aab8-4b30a8e2c293 admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:34:51.027931 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754f9133-f54c-4080-aab8-4b30a8e2c293 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:34:51.029992 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754f9133-f54c-4080-aab8-4b30a8e2c293 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:34:51.061406 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1360/2696] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 13 15:34:51 2022] POST /identity/v3/projects => generated 381 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:34:51.066795 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b05847-5b35-46b8-a1a7-bb6d085b79e7 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:34:51.078661 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b05847-5b35-46b8-a1a7-bb6d085b79e7 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:34:51.164634 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315e3058-e00a-4188-a4f2-de6a73d8ef71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:34:51.174242 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315e3058-e00a-4188-a4f2-de6a73d8ef71 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:34:51.174242 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315e3058-e00a-4188-a4f2-de6a73d8ef71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:34:51.174242 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315e3058-e00a-4188-a4f2-de6a73d8ef71 admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:34:51.174242 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315e3058-e00a-4188-a4f2-de6a73d8ef71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:34:51.174242 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315e3058-e00a-4188-a4f2-de6a73d8ef71 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:34:51.201535 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1337/2697] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 13 15:34:51 2022] POST /identity/v3/users => generated 291 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:34:51.206641 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754f9133-f54c-4080-aab8-4b30a8e2c293 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:34:51.216945 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754f9133-f54c-4080-aab8-4b30a8e2c293 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:34:51.221784 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6be4277-873d-4393-a94e-4e4712ee9ad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:34:51.222417 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6be4277-873d-4393-a94e-4e4712ee9ad1 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:34:51.222763 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6be4277-873d-4393-a94e-4e4712ee9ad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:34:51.223043 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6be4277-873d-4393-a94e-4e4712ee9ad1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:34:51.223690 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6be4277-873d-4393-a94e-4e4712ee9ad1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:34:51.225389 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6be4277-873d-4393-a94e-4e4712ee9ad1 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:34:51.236519 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1361/2698] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:34:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 15:34:51.241493 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315e3058-e00a-4188-a4f2-de6a73d8ef71 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:34:51.255739 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315e3058-e00a-4188-a4f2-de6a73d8ef71 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:34:51.261022 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa4aa48-6ad6-4a8a-8339-53684b27cdc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:34:51.261729 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa4aa48-6ad6-4a8a-8339-53684b27cdc4 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:34:51.262028 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa4aa48-6ad6-4a8a-8339-53684b27cdc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:34:51.262301 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa4aa48-6ad6-4a8a-8339-53684b27cdc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:34:51.262940 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa4aa48-6ad6-4a8a-8339-53684b27cdc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:34:51.264529 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa4aa48-6ad6-4a8a-8339-53684b27cdc4 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:34:51.281432 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1338/2699] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:34:51 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 15:34:51.285635 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6be4277-873d-4393-a94e-4e4712ee9ad1 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:34:51.300817 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6be4277-873d-4393-a94e-4e4712ee9ad1 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:34:51.306020 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaa1b12-7eca-4e89-b0b4-300a72fac019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:34:51.306835 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaa1b12-7eca-4e89-b0b4-300a72fac019 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:34:51.307228 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaa1b12-7eca-4e89-b0b4-300a72fac019 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:34:51.307600 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaa1b12-7eca-4e89-b0b4-300a72fac019 admin admin] PATH_INFO: `/v3/projects/100ea974545841ef96736e4abb457867/users/8b474059d7a84a90b7d6adf996992e7d/roles/3fae3d3a28e147d3b2bede2378ff79ae` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:34:51.325869 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfaa1b12-7eca-4e89-b0b4-300a72fac019 admin admin] RBAC: Authorizing `identity:create_grant(project_id=100ea974545841ef96736e4abb457867, user_id=8b474059d7a84a90b7d6adf996992e7d, role_id=3fae3d3a28e147d3b2bede2378ff79ae)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:34:51.328792 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfaa1b12-7eca-4e89-b0b4-300a72fac019 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:34:51.345802 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1362/2700] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 13 15:34:51 2022] PUT /identity/v3/projects/100ea974545841ef96736e4abb457867/users/8b474059d7a84a90b7d6adf996992e7d/roles/3fae3d3a28e147d3b2bede2378ff79ae => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:34:51.350967 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d29bc4b-5672-45ce-901a-5593c84cf6a1 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:34:51.351252 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d29bc4b-5672-45ce-901a-5593c84cf6a1 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:34:51.351534 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d29bc4b-5672-45ce-901a-5593c84cf6a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:34:51.371878 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-1d29bc4b-5672-45ce-901a-5593c84cf6a1 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:34:51.373111 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-1d29bc4b-5672-45ce-901a-5593c84cf6a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:34:51.430919 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:34:51.461771 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1339/2701] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:34:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 15:34:51.468764 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaa1b12-7eca-4e89-b0b4-300a72fac019 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:34:51.471461 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-cfaa1b12-7eca-4e89-b0b4-300a72fac019 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:34:51.545480 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaa1b12-7eca-4e89-b0b4-300a72fac019 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:34:51.551992 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac3b701-5c36-4b9f-93a2-fc8e248b6ff6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41675154bbba47388040966f75d84c3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:34:51.552817 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac3b701-5c36-4b9f-93a2-fc8e248b6ff6 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:34:51.553821 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac3b701-5c36-4b9f-93a2-fc8e248b6ff6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:34:51.554202 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac3b701-5c36-4b9f-93a2-fc8e248b6ff6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:34:51.565835 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac3b701-5c36-4b9f-93a2-fc8e248b6ff6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:34:51.567293 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac3b701-5c36-4b9f-93a2-fc8e248b6ff6 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:34:51.581038 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1363/2702] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:34:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 15:34:52.509040 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7be621-fedc-4d40-b7a4-f67ccb6f5b2d None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:34:52.510001 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7be621-fedc-4d40-b7a4-f67ccb6f5b2d None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:34:52.510437 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7be621-fedc-4d40-b7a4-f67ccb6f5b2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:34:52.542576 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-0c7be621-fedc-4d40-b7a4-f67ccb6f5b2d None None] MFA Rules not processed for user `8b474059d7a84a90b7d6adf996992e7d`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:34:52.544124 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-0c7be621-fedc-4d40-b7a4-f67ccb6f5b2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:34:52.637995 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1340/2703] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:34:52 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:34:52.645322 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac3b701-5c36-4b9f-93a2-fc8e248b6ff6 service neutron] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:34:52.651510 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-bac3b701-5c36-4b9f-93a2-fc8e248b6ff6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:34:52.702088 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:34:52.748218 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac3b701-5c36-4b9f-93a2-fc8e248b6ff6 service neutron] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:34:52.753007 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b19b15-e8ae-45a4-a154-3e7bca7426f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97acd23097d54bf7805c3cef60626ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:34:52.754176 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b19b15-e8ae-45a4-a154-3e7bca7426f4 service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:34:52.754632 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b19b15-e8ae-45a4-a154-3e7bca7426f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:34:52.755080 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b19b15-e8ae-45a4-a154-3e7bca7426f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:34:52.766055 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b19b15-e8ae-45a4-a154-3e7bca7426f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:34:52.767601 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b19b15-e8ae-45a4-a154-3e7bca7426f4 service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:34:52.779802 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1364/2704] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:34:52 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:34:54.231053 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8c4f4f-1f54-41b4-becc-fabce169d94a None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:34:54.231604 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8c4f4f-1f54-41b4-becc-fabce169d94a None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:34:54.231604 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8c4f4f-1f54-41b4-becc-fabce169d94a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:34:54.256911 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-3b8c4f4f-1f54-41b4-becc-fabce169d94a None None] MFA Rules not processed for user `8b474059d7a84a90b7d6adf996992e7d`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:34:54.258507 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-3b8c4f4f-1f54-41b4-becc-fabce169d94a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:34:54.275029 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1341/2705] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:34:54 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:34:57.950699 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b19b15-e8ae-45a4-a154-3e7bca7426f4 service cinder] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:34:57.952238 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-49b19b15-e8ae-45a4-a154-3e7bca7426f4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:34:58.066680 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b19b15-e8ae-45a4-a154-3e7bca7426f4 service cinder] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:34:58.072652 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cde42d-9605-499a-969d-2c6c990e192e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62aad71c6c1a4469805762bba330bf0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:34:58.073192 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cde42d-9605-499a-969d-2c6c990e192e service nova] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:34:58.073478 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cde42d-9605-499a-969d-2c6c990e192e service nova] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:34:58.073827 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cde42d-9605-499a-969d-2c6c990e192e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:34:58.075896 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-10cde42d-9605-499a-969d-2c6c990e192e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:34:58.089534 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cde42d-9605-499a-969d-2c6c990e192e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:34:58.091215 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cde42d-9605-499a-969d-2c6c990e192e service nova] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:34:58.102802 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1365/2706] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:34:57 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:35:03.468629 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8c4f4f-1f54-41b4-becc-fabce169d94a None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:35:03.478528 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8c4f4f-1f54-41b4-becc-fabce169d94a None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:35:03.482145 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e368c70-781b-463b-8844-a8d24e51eff0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41675154bbba47388040966f75d84c3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:35:03.482743 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e368c70-781b-463b-8844-a8d24e51eff0 service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:35:03.483024 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e368c70-781b-463b-8844-a8d24e51eff0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:35:03.483303 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e368c70-781b-463b-8844-a8d24e51eff0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:35:03.485027 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-8e368c70-781b-463b-8844-a8d24e51eff0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:35:03.496813 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e368c70-781b-463b-8844-a8d24e51eff0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:35:03.498259 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e368c70-781b-463b-8844-a8d24e51eff0 service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:35:03.506993 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1342/2707] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:35:03 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:35:03.619772 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edea3f6b-915b-417b-9d0d-0fd908caab13 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:35:03.620272 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edea3f6b-915b-417b-9d0d-0fd908caab13 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:35:03.620392 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edea3f6b-915b-417b-9d0d-0fd908caab13 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:35:03.621809 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1366/2708] 10.222.0.27 () {54 vars in 921 bytes} [Tue Sep 13 15:35:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:35:03.626465 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955b5590-2468-4e4b-bb8f-50fb7ebc47e3 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:35:03.626853 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955b5590-2468-4e4b-bb8f-50fb7ebc47e3 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:35:03.627358 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955b5590-2468-4e4b-bb8f-50fb7ebc47e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:35:03.647646 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-955b5590-2468-4e4b-bb8f-50fb7ebc47e3 None None] MFA Rules not processed for user `62aad71c6c1a4469805762bba330bf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:35:03.648865 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-955b5590-2468-4e4b-bb8f-50fb7ebc47e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:35:03.659284 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1343/2709] 10.222.0.27 () {58 vars in 1018 bytes} [Tue Sep 13 15:35:03 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 15:35:03.671024 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edea3f6b-915b-417b-9d0d-0fd908caab13 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:35:03.672722 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-edea3f6b-915b-417b-9d0d-0fd908caab13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:35:03.738015 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edea3f6b-915b-417b-9d0d-0fd908caab13 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:35:03.741508 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcf3dce-8775-47d7-a263-fadf15ce03b4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef26a5203094c83b52f10b930dfc453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:35:03.742148 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcf3dce-8775-47d7-a263-fadf15ce03b4 service glance] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:35:03.742432 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcf3dce-8775-47d7-a263-fadf15ce03b4 service glance] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:35:03.742709 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcf3dce-8775-47d7-a263-fadf15ce03b4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:35:03.753935 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcf3dce-8775-47d7-a263-fadf15ce03b4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:35:03.755376 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcf3dce-8775-47d7-a263-fadf15ce03b4 service glance] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:35:03.772060 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1367/2710] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:35:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:35:06.520433 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13bc257-4cbb-4b9a-b4e0-1b512ad33f82 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:35:06.520953 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13bc257-4cbb-4b9a-b4e0-1b512ad33f82 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:35:06.521118 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13bc257-4cbb-4b9a-b4e0-1b512ad33f82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:35:06.541451 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-d13bc257-4cbb-4b9a-b4e0-1b512ad33f82 None None] MFA Rules not processed for user `e97bcdb20f1e416ea41b99c226617faf`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:35:06.542751 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-d13bc257-4cbb-4b9a-b4e0-1b512ad33f82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:35:06.599551 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1344/2711] 10.222.0.27 () {58 vars in 1009 bytes} [Tue Sep 13 15:35:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:35:06.612076 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcf3dce-8775-47d7-a263-fadf15ce03b4 service glance] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:35:06.613547 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-edcf3dce-8775-47d7-a263-fadf15ce03b4 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:35:06.684205 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcf3dce-8775-47d7-a263-fadf15ce03b4 service glance] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:35:06.689763 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c34421f-3338-4815-924e-6c99fe99d3e5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc735644be394e0abe73e709373e2003', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:35:06.690379 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c34421f-3338-4815-924e-6c99fe99d3e5 service swift] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:35:06.690659 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c34421f-3338-4815-924e-6c99fe99d3e5 service swift] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:35:06.690932 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c34421f-3338-4815-924e-6c99fe99d3e5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:35:06.695999 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:35:06.700870 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c34421f-3338-4815-924e-6c99fe99d3e5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:35:06.702486 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c34421f-3338-4815-924e-6c99fe99d3e5 service swift] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:35:06.711444 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1368/2712] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Sep 13 15:35:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 15:35:16.592460 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=76 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:35:16.707709 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=3 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:35:22.929420 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496eb872-35ae-453a-90dd-1fd5478ec392 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:35:22.930067 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496eb872-35ae-453a-90dd-1fd5478ec392 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:35:22.930067 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496eb872-35ae-453a-90dd-1fd5478ec392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:35:22.949231 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-496eb872-35ae-453a-90dd-1fd5478ec392 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:35:22.950718 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-496eb872-35ae-453a-90dd-1fd5478ec392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:35:22.958990 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1345/2713] 10.222.0.15 () {58 vars in 1016 bytes} [Tue Sep 13 15:35:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:35:22.979313 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c34421f-3338-4815-924e-6c99fe99d3e5 service swift] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:35:22.980733 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-1c34421f-3338-4815-924e-6c99fe99d3e5 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:35:22.997879 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c34421f-3338-4815-924e-6c99fe99d3e5 service swift] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:35:23.003601 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c339ed78-f473-434c-b6f9-88fa343a9707 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62aad71c6c1a4469805762bba330bf0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:35:23.004374 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c339ed78-f473-434c-b6f9-88fa343a9707 service nova] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:35:23.004548 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c339ed78-f473-434c-b6f9-88fa343a9707 service nova] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:35:23.004826 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c339ed78-f473-434c-b6f9-88fa343a9707 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:35:23.013076 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c339ed78-f473-434c-b6f9-88fa343a9707 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:35:23.014675 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c339ed78-f473-434c-b6f9-88fa343a9707 service nova] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:35:23.025028 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1369/2714] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:35:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:35:23.298306 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7d9107-761b-49c4-8738-e57033a9b6f5 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:35:23.298731 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7d9107-761b-49c4-8738-e57033a9b6f5 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:35:23.299017 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7d9107-761b-49c4-8738-e57033a9b6f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:35:23.318925 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-da7d9107-761b-49c4-8738-e57033a9b6f5 None None] MFA Rules not processed for user `e97bcdb20f1e416ea41b99c226617faf`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:35:23.320227 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-da7d9107-761b-49c4-8738-e57033a9b6f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:35:23.329977 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1346/2715] 10.222.0.27 () {58 vars in 967 bytes} [Tue Sep 13 15:35:23 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:35:23.342971 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c339ed78-f473-434c-b6f9-88fa343a9707 service nova] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:35:23.354419 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c339ed78-f473-434c-b6f9-88fa343a9707 service nova] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:35:23.359452 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785017a9-c2ca-4dd5-ae58-be321a8a9306 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc735644be394e0abe73e709373e2003', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:35:23.360119 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785017a9-c2ca-4dd5-ae58-be321a8a9306 service swift] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:35:23.360401 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785017a9-c2ca-4dd5-ae58-be321a8a9306 service swift] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:35:23.360673 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785017a9-c2ca-4dd5-ae58-be321a8a9306 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:35:23.368582 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785017a9-c2ca-4dd5-ae58-be321a8a9306 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:35:23.370189 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785017a9-c2ca-4dd5-ae58-be321a8a9306 service swift] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:35:23.378587 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1370/2716] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Sep 13 15:35:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 15:35:25.891023 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54a47ef-7289-40f9-b04d-1e59c8b27425 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:35:25.892372 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54a47ef-7289-40f9-b04d-1e59c8b27425 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:35:25.892372 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54a47ef-7289-40f9-b04d-1e59c8b27425 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:35:25.911704 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-c54a47ef-7289-40f9-b04d-1e59c8b27425 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:35:25.912895 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-c54a47ef-7289-40f9-b04d-1e59c8b27425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:35:25.921332 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1347/2717] 10.222.0.15 () {58 vars in 1016 bytes} [Tue Sep 13 15:35:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:35:25.936155 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785017a9-c2ca-4dd5-ae58-be321a8a9306 service swift] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:35:25.948496 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785017a9-c2ca-4dd5-ae58-be321a8a9306 service swift] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:35:25.954116 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d5645b-5895-4eed-9f4c-ffba77a9a66e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62aad71c6c1a4469805762bba330bf0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:35:25.954705 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d5645b-5895-4eed-9f4c-ffba77a9a66e service nova] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:35:25.954986 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d5645b-5895-4eed-9f4c-ffba77a9a66e service nova] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:35:25.955258 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d5645b-5895-4eed-9f4c-ffba77a9a66e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:35:25.963424 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d5645b-5895-4eed-9f4c-ffba77a9a66e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:35:25.964991 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d5645b-5895-4eed-9f4c-ffba77a9a66e service nova] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:35:25.974616 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1371/2718] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:35:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:35:29.137330 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c716c5f2-2f0d-4697-b38e-7c2dde2acf37 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:35:29.137914 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c716c5f2-2f0d-4697-b38e-7c2dde2acf37 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:35:29.137914 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c716c5f2-2f0d-4697-b38e-7c2dde2acf37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:35:29.157016 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-c716c5f2-2f0d-4697-b38e-7c2dde2acf37 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:35:29.158252 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-c716c5f2-2f0d-4697-b38e-7c2dde2acf37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:35:29.166078 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1348/2719] 10.222.0.15 () {58 vars in 1016 bytes} [Tue Sep 13 15:35:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:35:29.186752 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d5645b-5895-4eed-9f4c-ffba77a9a66e service nova] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:35:29.198342 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d5645b-5895-4eed-9f4c-ffba77a9a66e service nova] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:35:29.204081 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87c898b-522b-4b55-9e5d-ce2f020be9b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62aad71c6c1a4469805762bba330bf0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:35:29.204672 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87c898b-522b-4b55-9e5d-ce2f020be9b3 service nova] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:35:29.204956 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87c898b-522b-4b55-9e5d-ce2f020be9b3 service nova] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:35:29.205231 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87c898b-522b-4b55-9e5d-ce2f020be9b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:35:29.213750 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87c898b-522b-4b55-9e5d-ce2f020be9b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:35:29.215390 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87c898b-522b-4b55-9e5d-ce2f020be9b3 service nova] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:35:29.224942 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1372/2720] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:35:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:35:32.229861 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dc2483-9cae-41bc-8cc3-4cc8b0e7dfdd None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:35:32.230353 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dc2483-9cae-41bc-8cc3-4cc8b0e7dfdd None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:35:32.230451 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dc2483-9cae-41bc-8cc3-4cc8b0e7dfdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:35:32.250043 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-51dc2483-9cae-41bc-8cc3-4cc8b0e7dfdd None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:35:32.251460 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-51dc2483-9cae-41bc-8cc3-4cc8b0e7dfdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:35:32.259213 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1349/2721] 10.222.0.15 () {58 vars in 1016 bytes} [Tue Sep 13 15:35:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:35:32.274855 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87c898b-522b-4b55-9e5d-ce2f020be9b3 service nova] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:35:32.286967 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87c898b-522b-4b55-9e5d-ce2f020be9b3 service nova] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:35:32.292471 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a8e59f-8c24-4be7-b7f6-05ab0d286d54 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62aad71c6c1a4469805762bba330bf0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:35:32.293117 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a8e59f-8c24-4be7-b7f6-05ab0d286d54 service nova] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:35:32.293400 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a8e59f-8c24-4be7-b7f6-05ab0d286d54 service nova] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:35:32.293674 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a8e59f-8c24-4be7-b7f6-05ab0d286d54 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:35:32.301853 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a8e59f-8c24-4be7-b7f6-05ab0d286d54 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:35:32.303414 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a8e59f-8c24-4be7-b7f6-05ab0d286d54 service nova] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:35:32.312742 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1373/2722] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:35:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:35:35.421827 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aeed3e-42ba-4a0a-bc08-f15d2e98277f None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:35:35.422345 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aeed3e-42ba-4a0a-bc08-f15d2e98277f None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:35:35.422466 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aeed3e-42ba-4a0a-bc08-f15d2e98277f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:35:35.442490 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-99aeed3e-42ba-4a0a-bc08-f15d2e98277f None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:35:35.443672 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-99aeed3e-42ba-4a0a-bc08-f15d2e98277f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:35:35.451630 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1350/2723] 10.222.0.15 () {58 vars in 1016 bytes} [Tue Sep 13 15:35:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:35:35.468492 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a8e59f-8c24-4be7-b7f6-05ab0d286d54 service nova] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:35:35.480199 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a8e59f-8c24-4be7-b7f6-05ab0d286d54 service nova] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:35:35.486860 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86202f70-63a0-4812-8ee4-cbaac080c2c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62aad71c6c1a4469805762bba330bf0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:35:35.487456 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86202f70-63a0-4812-8ee4-cbaac080c2c8 service nova] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:35:35.487734 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86202f70-63a0-4812-8ee4-cbaac080c2c8 service nova] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:35:35.488003 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86202f70-63a0-4812-8ee4-cbaac080c2c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:35:35.496253 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86202f70-63a0-4812-8ee4-cbaac080c2c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:35:35.497828 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86202f70-63a0-4812-8ee4-cbaac080c2c8 service nova] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:35:35.507842 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1374/2724] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:35:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:35:38.546666 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef18cb5-0dc1-482c-915f-f5cc8de1d426 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:35:38.547243 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef18cb5-0dc1-482c-915f-f5cc8de1d426 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:35:38.547243 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef18cb5-0dc1-482c-915f-f5cc8de1d426 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:35:38.567004 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-eef18cb5-0dc1-482c-915f-f5cc8de1d426 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:35:38.568202 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-eef18cb5-0dc1-482c-915f-f5cc8de1d426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:35:38.576198 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1351/2725] 10.222.0.15 () {58 vars in 1016 bytes} [Tue Sep 13 15:35:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:35:38.601930 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86202f70-63a0-4812-8ee4-cbaac080c2c8 service nova] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:35:38.613508 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86202f70-63a0-4812-8ee4-cbaac080c2c8 service nova] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:35:38.618913 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e15817-8464-4df9-8080-3c3350ccafec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62aad71c6c1a4469805762bba330bf0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:35:38.619506 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e15817-8464-4df9-8080-3c3350ccafec service nova] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:35:38.619787 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e15817-8464-4df9-8080-3c3350ccafec service nova] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:35:38.620059 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e15817-8464-4df9-8080-3c3350ccafec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:35:38.628143 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e15817-8464-4df9-8080-3c3350ccafec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:35:38.629721 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e15817-8464-4df9-8080-3c3350ccafec service nova] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:35:38.638972 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1375/2726] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:35:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:35:48.561656 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=21 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:35:48.634921 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=42 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:35:48.785652 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef18cb5-0dc1-482c-915f-f5cc8de1d426 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:35:48.801313 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef18cb5-0dc1-482c-915f-f5cc8de1d426 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:35:48.807634 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3153f67d-0c5b-4654-ae17-55055ceccdc9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62aad71c6c1a4469805762bba330bf0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:35:48.808307 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3153f67d-0c5b-4654-ae17-55055ceccdc9 service nova] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:35:48.808592 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3153f67d-0c5b-4654-ae17-55055ceccdc9 service nova] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:35:48.808870 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3153f67d-0c5b-4654-ae17-55055ceccdc9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:35:48.810660 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-3153f67d-0c5b-4654-ae17-55055ceccdc9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:35:48.823341 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3153f67d-0c5b-4654-ae17-55055ceccdc9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:35:48.825300 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3153f67d-0c5b-4654-ae17-55055ceccdc9 service nova] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:35:48.836440 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1352/2727] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:35:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:35:53.689499 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcb17e5-35c4-4c4d-9318-82cf0808e72f None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:35:53.690079 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcb17e5-35c4-4c4d-9318-82cf0808e72f None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:35:53.690180 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcb17e5-35c4-4c4d-9318-82cf0808e72f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:35:53.709961 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-5fcb17e5-35c4-4c4d-9318-82cf0808e72f None None] MFA Rules not processed for user `8b474059d7a84a90b7d6adf996992e7d`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:35:53.711163 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-5fcb17e5-35c4-4c4d-9318-82cf0808e72f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:35:53.717964 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1376/2728] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:35:53 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:35:58.831687 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=6 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:36:03.704800 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=3 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:36:07.366669 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3153f67d-0c5b-4654-ae17-55055ceccdc9 service nova] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:36:07.368230 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-3153f67d-0c5b-4654-ae17-55055ceccdc9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:36:07.490678 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3153f67d-0c5b-4654-ae17-55055ceccdc9 service nova] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:36:07.495937 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6b2ce8-3ff1-4563-ad50-4691eba643cb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b56f96cb3184a3ba82c8a0c3427e268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:36:07.496781 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6b2ce8-3ff1-4563-ad50-4691eba643cb service placement] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:36:07.497241 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6b2ce8-3ff1-4563-ad50-4691eba643cb service placement] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:36:07.497665 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6b2ce8-3ff1-4563-ad50-4691eba643cb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:36:07.500102 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-5a6b2ce8-3ff1-4563-ad50-4691eba643cb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:36:07.517638 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6b2ce8-3ff1-4563-ad50-4691eba643cb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:36:07.519839 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6b2ce8-3ff1-4563-ad50-4691eba643cb service placement] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:36:07.532558 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1353/2729] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:36:07 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:36:07.881588 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a4c35c-9ab8-472b-9a47-564a54bcef9a None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:36:07.882261 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a4c35c-9ab8-472b-9a47-564a54bcef9a None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:36:07.882261 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a4c35c-9ab8-472b-9a47-564a54bcef9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:36:07.927748 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-14a4c35c-9ab8-472b-9a47-564a54bcef9a None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:36:07.931314 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-14a4c35c-9ab8-472b-9a47-564a54bcef9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:36:07.951738 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1377/2730] 10.222.0.15 () {58 vars in 1016 bytes} [Tue Sep 13 15:36:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 15:36:07.967820 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6b2ce8-3ff1-4563-ad50-4691eba643cb service placement] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:36:07.992461 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6b2ce8-3ff1-4563-ad50-4691eba643cb service placement] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:36:08.002376 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92396379-a939-45be-975b-a0014134df56 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62aad71c6c1a4469805762bba330bf0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:36:08.004975 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92396379-a939-45be-975b-a0014134df56 service nova] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:36:08.006165 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92396379-a939-45be-975b-a0014134df56 service nova] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:36:08.006463 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92396379-a939-45be-975b-a0014134df56 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:36:08.022273 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92396379-a939-45be-975b-a0014134df56 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:36:08.024580 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92396379-a939-45be-975b-a0014134df56 service nova] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:36:08.041292 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1354/2731] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:36:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:36:11.219936 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba27c8e0-9ed1-4a9c-9155-1515a2deb198 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:36:11.220415 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba27c8e0-9ed1-4a9c-9155-1515a2deb198 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:36:11.220503 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba27c8e0-9ed1-4a9c-9155-1515a2deb198 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:36:11.247121 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-ba27c8e0-9ed1-4a9c-9155-1515a2deb198 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:36:11.248343 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-ba27c8e0-9ed1-4a9c-9155-1515a2deb198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:36:11.263277 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1378/2732] 10.222.0.15 () {58 vars in 1016 bytes} [Tue Sep 13 15:36:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:36:11.277675 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92396379-a939-45be-975b-a0014134df56 service nova] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:36:11.300201 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92396379-a939-45be-975b-a0014134df56 service nova] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:36:11.316371 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6aaec4-dd64-4cc5-b48a-2092d8e18279 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62aad71c6c1a4469805762bba330bf0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:36:11.317001 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6aaec4-dd64-4cc5-b48a-2092d8e18279 service nova] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:36:11.317285 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6aaec4-dd64-4cc5-b48a-2092d8e18279 service nova] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:36:11.317560 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6aaec4-dd64-4cc5-b48a-2092d8e18279 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:36:11.327800 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6aaec4-dd64-4cc5-b48a-2092d8e18279 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:36:11.330062 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6aaec4-dd64-4cc5-b48a-2092d8e18279 service nova] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:36:11.341034 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1355/2733] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:36:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:36:11.580326 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba27c8e0-9ed1-4a9c-9155-1515a2deb198 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:36:11.581947 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-ba27c8e0-9ed1-4a9c-9155-1515a2deb198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:36:11.595265 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba27c8e0-9ed1-4a9c-9155-1515a2deb198 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:36:11.603598 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e16dba8-8a54-4000-a880-8c404ec9920f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:36:11.604280 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e16dba8-8a54-4000-a880-8c404ec9920f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:36:11.604559 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e16dba8-8a54-4000-a880-8c404ec9920f admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:36:11.604832 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e16dba8-8a54-4000-a880-8c404ec9920f admin admin] PATH_INFO: `/v3/users/25faadaedd724585ac50358a5a234835` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:36:11.606043 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e16dba8-8a54-4000-a880-8c404ec9920f admin admin] RBAC: Authorizing `identity:delete_user(user_id=25faadaedd724585ac50358a5a234835)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:36:11.609395 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e16dba8-8a54-4000-a880-8c404ec9920f admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:36:11.660819 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-7e16dba8-8a54-4000-a880-8c404ec9920f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25faadaedd724585ac50358a5a234835'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:36:11.661512 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-7e16dba8-8a54-4000-a880-8c404ec9920f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25faadaedd724585ac50358a5a234835'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:36:11.662153 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-7e16dba8-8a54-4000-a880-8c404ec9920f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25faadaedd724585ac50358a5a234835'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:36:11.669529 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-7e16dba8-8a54-4000-a880-8c404ec9920f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25faadaedd724585ac50358a5a234835'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:36:11.684082 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-7e16dba8-8a54-4000-a880-8c404ec9920f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25faadaedd724585ac50358a5a234835'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:36:11.697850 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1379/2734] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 13 15:36:11 2022] DELETE /identity/v3/users/25faadaedd724585ac50358a5a234835 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:36:11.895682 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6aaec4-dd64-4cc5-b48a-2092d8e18279 service nova] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:36:11.912692 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6aaec4-dd64-4cc5-b48a-2092d8e18279 service nova] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:36:11.977179 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440f3ca5-d567-402d-a72e-4c0371b4bc18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:36:11.978141 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440f3ca5-d567-402d-a72e-4c0371b4bc18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:36:11.978556 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440f3ca5-d567-402d-a72e-4c0371b4bc18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:36:11.978841 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440f3ca5-d567-402d-a72e-4c0371b4bc18 admin admin] PATH_INFO: `/v3/projects/fed73134b1c8412fb7eba1cb4a286b33` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:36:11.979979 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440f3ca5-d567-402d-a72e-4c0371b4bc18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fed73134b1c8412fb7eba1cb4a286b33)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:36:11.981960 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440f3ca5-d567-402d-a72e-4c0371b4bc18 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:36:12.029408 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-440f3ca5-d567-402d-a72e-4c0371b4bc18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fed73134b1c8412fb7eba1cb4a286b33', 'request_id': 'req-440f3ca5-d567-402d-a72e-4c0371b4bc18'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:36:12.035947 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-440f3ca5-d567-402d-a72e-4c0371b4bc18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fed73134b1c8412fb7eba1cb4a286b33', 'request_id': 'req-440f3ca5-d567-402d-a72e-4c0371b4bc18'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:36:12.041895 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-440f3ca5-d567-402d-a72e-4c0371b4bc18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fed73134b1c8412fb7eba1cb4a286b33', 'request_id': 'req-440f3ca5-d567-402d-a72e-4c0371b4bc18'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:36:12.044566 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:36:12.057936 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-440f3ca5-d567-402d-a72e-4c0371b4bc18 admin admin] The token cache is being invalidate because project fed73134b1c8412fb7eba1cb4a286b33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 15:36:12.058379 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-440f3ca5-d567-402d-a72e-4c0371b4bc18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:36:12.059173 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-440f3ca5-d567-402d-a72e-4c0371b4bc18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:36:12.060873 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1356/2735] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 13 15:36:11 2022] DELETE /identity/v3/projects/fed73134b1c8412fb7eba1cb4a286b33 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:36:12.065549 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e16dba8-8a54-4000-a880-8c404ec9920f admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:36:12.067105 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-7e16dba8-8a54-4000-a880-8c404ec9920f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:36:12.084902 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e16dba8-8a54-4000-a880-8c404ec9920f admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:36:12.153551 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb1c737-e815-4d25-b1b8-fc1110a30d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:36:12.154081 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb1c737-e815-4d25-b1b8-fc1110a30d6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:36:12.154359 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb1c737-e815-4d25-b1b8-fc1110a30d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:36:12.154634 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb1c737-e815-4d25-b1b8-fc1110a30d6d admin admin] PATH_INFO: `/v3/users/5ce47fbaa0a849b294be1d81fc68b9cb` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:36:12.155781 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb1c737-e815-4d25-b1b8-fc1110a30d6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ce47fbaa0a849b294be1d81fc68b9cb)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:36:12.158317 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb1c737-e815-4d25-b1b8-fc1110a30d6d admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:36:12.210026 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-4eb1c737-e815-4d25-b1b8-fc1110a30d6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ce47fbaa0a849b294be1d81fc68b9cb'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:36:12.210703 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-4eb1c737-e815-4d25-b1b8-fc1110a30d6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ce47fbaa0a849b294be1d81fc68b9cb'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:36:12.211314 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-4eb1c737-e815-4d25-b1b8-fc1110a30d6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ce47fbaa0a849b294be1d81fc68b9cb'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:36:12.219489 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-4eb1c737-e815-4d25-b1b8-fc1110a30d6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ce47fbaa0a849b294be1d81fc68b9cb'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:36:12.224316 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:36:12.234924 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-4eb1c737-e815-4d25-b1b8-fc1110a30d6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ce47fbaa0a849b294be1d81fc68b9cb'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:36:12.248545 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1380/2736] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 13 15:36:12 2022] DELETE /identity/v3/users/5ce47fbaa0a849b294be1d81fc68b9cb => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:36:12.353800 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a046f4-1100-458d-b1cb-f9cc96df67de None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:36:12.354329 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a046f4-1100-458d-b1cb-f9cc96df67de None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:36:12.354458 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a046f4-1100-458d-b1cb-f9cc96df67de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:36:12.376235 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-a5a046f4-1100-458d-b1cb-f9cc96df67de None None] MFA Rules not processed for user `fc1649ee0b274411aec5c7cd993b4e95`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:36:12.377555 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-a5a046f4-1100-458d-b1cb-f9cc96df67de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:36:12.438756 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb1c737-e815-4d25-b1b8-fc1110a30d6d admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:36:12.440247 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-4eb1c737-e815-4d25-b1b8-fc1110a30d6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:36:12.453845 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1357/2737] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:36:12 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:36:12.535891 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb1c737-e815-4d25-b1b8-fc1110a30d6d admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:36:12.540598 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dd8cb3-aa2f-41a5-b78c-ac16c69923cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:36:12.541237 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dd8cb3-aa2f-41a5-b78c-ac16c69923cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:36:12.541523 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dd8cb3-aa2f-41a5-b78c-ac16c69923cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:36:12.541842 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dd8cb3-aa2f-41a5-b78c-ac16c69923cd admin admin] PATH_INFO: `/v3/projects/bdba2bc3117d4be297aca9125dca9d78` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:36:12.542991 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dd8cb3-aa2f-41a5-b78c-ac16c69923cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=bdba2bc3117d4be297aca9125dca9d78)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:36:12.544902 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dd8cb3-aa2f-41a5-b78c-ac16c69923cd admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:36:12.595186 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-a6dd8cb3-aa2f-41a5-b78c-ac16c69923cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bdba2bc3117d4be297aca9125dca9d78', 'request_id': 'req-a6dd8cb3-aa2f-41a5-b78c-ac16c69923cd'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:36:12.601544 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-a6dd8cb3-aa2f-41a5-b78c-ac16c69923cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bdba2bc3117d4be297aca9125dca9d78', 'request_id': 'req-a6dd8cb3-aa2f-41a5-b78c-ac16c69923cd'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:36:12.610923 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-a6dd8cb3-aa2f-41a5-b78c-ac16c69923cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bdba2bc3117d4be297aca9125dca9d78', 'request_id': 'req-a6dd8cb3-aa2f-41a5-b78c-ac16c69923cd'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:36:12.621641 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-a6dd8cb3-aa2f-41a5-b78c-ac16c69923cd admin admin] The token cache is being invalidate because project bdba2bc3117d4be297aca9125dca9d78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 15:36:12.621945 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-a6dd8cb3-aa2f-41a5-b78c-ac16c69923cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:36:12.622579 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-a6dd8cb3-aa2f-41a5-b78c-ac16c69923cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:36:12.624079 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1381/2738] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 13 15:36:12 2022] DELETE /identity/v3/projects/bdba2bc3117d4be297aca9125dca9d78 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:36:14.319144 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8895b4a3-2057-460f-8ed8-dfe5b6368081 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:36:14.319655 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8895b4a3-2057-460f-8ed8-dfe5b6368081 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:36:14.319842 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8895b4a3-2057-460f-8ed8-dfe5b6368081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:36:14.340213 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-8895b4a3-2057-460f-8ed8-dfe5b6368081 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:36:14.341513 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-8895b4a3-2057-460f-8ed8-dfe5b6368081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:36:14.402964 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1358/2739] 10.222.0.15 () {58 vars in 1016 bytes} [Tue Sep 13 15:36:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:36:14.418436 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dd8cb3-aa2f-41a5-b78c-ac16c69923cd admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:36:14.420052 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-a6dd8cb3-aa2f-41a5-b78c-ac16c69923cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:36:14.496404 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dd8cb3-aa2f-41a5-b78c-ac16c69923cd admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:36:14.502115 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aac3019-584a-4edc-b46a-cd62e4152dcd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62aad71c6c1a4469805762bba330bf0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:36:14.502831 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aac3019-584a-4edc-b46a-cd62e4152dcd service nova] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:36:14.503143 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aac3019-584a-4edc-b46a-cd62e4152dcd service nova] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:36:14.503390 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aac3019-584a-4edc-b46a-cd62e4152dcd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:36:14.509672 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:36:14.515944 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aac3019-584a-4edc-b46a-cd62e4152dcd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:36:14.518807 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aac3019-584a-4edc-b46a-cd62e4152dcd service nova] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:36:14.528597 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1382/2740] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:36:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:36:17.472792 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe33f83e-df2d-4a4e-9cc0-0d1cb8994326 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:36:17.473285 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe33f83e-df2d-4a4e-9cc0-0d1cb8994326 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:36:17.473399 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe33f83e-df2d-4a4e-9cc0-0d1cb8994326 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:36:17.492881 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-fe33f83e-df2d-4a4e-9cc0-0d1cb8994326 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:36:17.494103 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-fe33f83e-df2d-4a4e-9cc0-0d1cb8994326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:36:17.501866 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1359/2741] 10.222.0.15 () {58 vars in 1016 bytes} [Tue Sep 13 15:36:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:36:17.517371 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aac3019-584a-4edc-b46a-cd62e4152dcd service nova] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:36:17.529263 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aac3019-584a-4edc-b46a-cd62e4152dcd service nova] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:36:17.535005 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94db6d7e-3e8e-4fa9-aafc-5299e0a1b4c3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62aad71c6c1a4469805762bba330bf0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:36:17.535619 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94db6d7e-3e8e-4fa9-aafc-5299e0a1b4c3 service nova] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:36:17.535881 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94db6d7e-3e8e-4fa9-aafc-5299e0a1b4c3 service nova] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:36:17.536155 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94db6d7e-3e8e-4fa9-aafc-5299e0a1b4c3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:36:17.544321 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94db6d7e-3e8e-4fa9-aafc-5299e0a1b4c3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:36:17.545920 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94db6d7e-3e8e-4fa9-aafc-5299e0a1b4c3 service nova] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:36:17.555455 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1383/2742] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:36:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 15:36:20.660748 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdee47a-c3b5-43f2-855a-02ccc8b9d46b None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:36:20.661226 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdee47a-c3b5-43f2-855a-02ccc8b9d46b None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:36:20.661341 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdee47a-c3b5-43f2-855a-02ccc8b9d46b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:36:20.681149 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-2bdee47a-c3b5-43f2-855a-02ccc8b9d46b None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:36:20.682380 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-2bdee47a-c3b5-43f2-855a-02ccc8b9d46b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:36:20.691332 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1360/2743] 10.222.0.15 () {58 vars in 1016 bytes} [Tue Sep 13 15:36:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:36:20.705800 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94db6d7e-3e8e-4fa9-aafc-5299e0a1b4c3 service nova] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:36:20.719158 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94db6d7e-3e8e-4fa9-aafc-5299e0a1b4c3 service nova] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:36:20.725471 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a502a5ac-173e-445c-8d97-62ecdbf48b90 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62aad71c6c1a4469805762bba330bf0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:36:20.726215 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a502a5ac-173e-445c-8d97-62ecdbf48b90 service nova] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:36:20.726535 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a502a5ac-173e-445c-8d97-62ecdbf48b90 service nova] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:36:20.726835 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a502a5ac-173e-445c-8d97-62ecdbf48b90 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:36:20.736268 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a502a5ac-173e-445c-8d97-62ecdbf48b90 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:36:20.738626 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a502a5ac-173e-445c-8d97-62ecdbf48b90 service nova] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:36:20.748976 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1384/2744] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:36:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:36:30.676298 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:DELETE=1,keystone:SELECT=60 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:36:30.744142 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=15 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:36:48.529391 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdee47a-c3b5-43f2-855a-02ccc8b9d46b None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:36:48.530803 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-2bdee47a-c3b5-43f2-855a-02ccc8b9d46b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:36:48.595708 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a502a5ac-173e-445c-8d97-62ecdbf48b90 service nova] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:36:48.597928 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-a502a5ac-173e-445c-8d97-62ecdbf48b90 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:36:48.607537 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdee47a-c3b5-43f2-855a-02ccc8b9d46b None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:36:48.612878 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06595181-a07d-487c-9eb7-82b6530d979d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b56f96cb3184a3ba82c8a0c3427e268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:36:48.613576 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06595181-a07d-487c-9eb7-82b6530d979d service placement] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:36:48.614069 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06595181-a07d-487c-9eb7-82b6530d979d service placement] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:36:48.614352 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06595181-a07d-487c-9eb7-82b6530d979d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:36:48.616104 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-06595181-a07d-487c-9eb7-82b6530d979d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:36:48.616233 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a502a5ac-173e-445c-8d97-62ecdbf48b90 service nova] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:36:48.621194 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57e3802-48b0-4fac-8c03-1a5793708f0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:36:48.621838 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57e3802-48b0-4fac-8c03-1a5793708f0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:36:48.622126 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57e3802-48b0-4fac-8c03-1a5793708f0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:36:48.622387 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57e3802-48b0-4fac-8c03-1a5793708f0d admin admin] PATH_INFO: `/v3/users/8b474059d7a84a90b7d6adf996992e7d` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:36:48.623491 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57e3802-48b0-4fac-8c03-1a5793708f0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b474059d7a84a90b7d6adf996992e7d)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:36:48.625391 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57e3802-48b0-4fac-8c03-1a5793708f0d admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:36:48.628526 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06595181-a07d-487c-9eb7-82b6530d979d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:36:48.630250 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06595181-a07d-487c-9eb7-82b6530d979d service placement] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:36:48.640896 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1361/2745] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:36:48 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:36:48.674380 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-f57e3802-48b0-4fac-8c03-1a5793708f0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b474059d7a84a90b7d6adf996992e7d'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:36:48.675119 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-f57e3802-48b0-4fac-8c03-1a5793708f0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b474059d7a84a90b7d6adf996992e7d'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:36:48.675732 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-f57e3802-48b0-4fac-8c03-1a5793708f0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b474059d7a84a90b7d6adf996992e7d'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:36:48.682912 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-f57e3802-48b0-4fac-8c03-1a5793708f0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b474059d7a84a90b7d6adf996992e7d'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:36:48.695146 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-f57e3802-48b0-4fac-8c03-1a5793708f0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b474059d7a84a90b7d6adf996992e7d'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:36:48.712601 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1385/2746] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 13 15:36:48 2022] DELETE /identity/v3/users/8b474059d7a84a90b7d6adf996992e7d => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 15:36:48.877825 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06595181-a07d-487c-9eb7-82b6530d979d service placement] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:36:48.889946 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06595181-a07d-487c-9eb7-82b6530d979d service placement] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:36:48.948882 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945b6e0b-60ad-4785-bd2c-a9ab6f502306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:36:48.949513 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945b6e0b-60ad-4785-bd2c-a9ab6f502306 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:36:48.949851 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945b6e0b-60ad-4785-bd2c-a9ab6f502306 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:36:48.950123 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945b6e0b-60ad-4785-bd2c-a9ab6f502306 admin admin] PATH_INFO: `/v3/projects/100ea974545841ef96736e4abb457867` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:36:48.951221 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945b6e0b-60ad-4785-bd2c-a9ab6f502306 admin admin] RBAC: Authorizing `identity:delete_project(project_id=100ea974545841ef96736e4abb457867)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:36:48.953134 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945b6e0b-60ad-4785-bd2c-a9ab6f502306 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:36:49.001215 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-945b6e0b-60ad-4785-bd2c-a9ab6f502306 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '100ea974545841ef96736e4abb457867', 'request_id': 'req-945b6e0b-60ad-4785-bd2c-a9ab6f502306'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:36:49.007485 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-945b6e0b-60ad-4785-bd2c-a9ab6f502306 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '100ea974545841ef96736e4abb457867', 'request_id': 'req-945b6e0b-60ad-4785-bd2c-a9ab6f502306'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:36:49.012843 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-945b6e0b-60ad-4785-bd2c-a9ab6f502306 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '100ea974545841ef96736e4abb457867', 'request_id': 'req-945b6e0b-60ad-4785-bd2c-a9ab6f502306'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:36:49.025246 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-945b6e0b-60ad-4785-bd2c-a9ab6f502306 admin admin] The token cache is being invalidate because project 100ea974545841ef96736e4abb457867 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 15:36:49.025538 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-945b6e0b-60ad-4785-bd2c-a9ab6f502306 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:36:49.026209 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-945b6e0b-60ad-4785-bd2c-a9ab6f502306 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:36:49.027686 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1362/2747] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 13 15:36:48 2022] DELETE /identity/v3/projects/100ea974545841ef96736e4abb457867 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:36:58.704538 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=29,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:36:59.022337 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=83,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:37:20.290336 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8c6bc7-183a-4eaf-84bd-cdc69ec75e65 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:37:20.290843 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8c6bc7-183a-4eaf-84bd-cdc69ec75e65 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:37:20.290947 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8c6bc7-183a-4eaf-84bd-cdc69ec75e65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:37:20.330955 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-8f8c6bc7-183a-4eaf-84bd-cdc69ec75e65 None None] MFA Rules not processed for user `e97bcdb20f1e416ea41b99c226617faf`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:37:20.332171 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-8f8c6bc7-183a-4eaf-84bd-cdc69ec75e65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:37:20.412783 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1386/2748] 10.222.0.27 () {58 vars in 1009 bytes} [Tue Sep 13 15:37:20 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:37:20.460848 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945b6e0b-60ad-4785-bd2c-a9ab6f502306 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:37:20.462313 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-945b6e0b-60ad-4785-bd2c-a9ab6f502306 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:37:20.558891 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945b6e0b-60ad-4785-bd2c-a9ab6f502306 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:37:20.563940 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ade1ee-771c-4bd0-9c53-9c508f6accab service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc735644be394e0abe73e709373e2003', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:37:20.565131 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ade1ee-771c-4bd0-9c53-9c508f6accab service swift] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:37:20.565414 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ade1ee-771c-4bd0-9c53-9c508f6accab service swift] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:37:20.565812 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ade1ee-771c-4bd0-9c53-9c508f6accab service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:37:20.574006 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ade1ee-771c-4bd0-9c53-9c508f6accab service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:37:20.575585 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ade1ee-771c-4bd0-9c53-9c508f6accab service swift] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:37:20.583662 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1363/2749] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Sep 13 15:37:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 15:37:30.410843 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=45 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:37:30.580425 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=43 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:37:32.100202 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8c6bc7-183a-4eaf-84bd-cdc69ec75e65 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:37:32.101612 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-8f8c6bc7-183a-4eaf-84bd-cdc69ec75e65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:37:32.190570 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8c6bc7-183a-4eaf-84bd-cdc69ec75e65 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:37:32.195563 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5d786b-6401-40af-8258-9bb38dbe55bc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b56f96cb3184a3ba82c8a0c3427e268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:37:32.196165 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5d786b-6401-40af-8258-9bb38dbe55bc service placement] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:37:32.196447 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5d786b-6401-40af-8258-9bb38dbe55bc service placement] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:37:32.196719 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5d786b-6401-40af-8258-9bb38dbe55bc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:37:32.198706 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-5a5d786b-6401-40af-8258-9bb38dbe55bc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:37:32.210543 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5d786b-6401-40af-8258-9bb38dbe55bc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:37:32.212103 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5d786b-6401-40af-8258-9bb38dbe55bc service placement] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:37:32.222017 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1387/2750] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:37:32 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:37:33.405668 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e683c2-8807-4ae6-bcaa-90cfc24968b1 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:37:33.406237 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e683c2-8807-4ae6-bcaa-90cfc24968b1 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:37:33.406237 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e683c2-8807-4ae6-bcaa-90cfc24968b1 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:37:33.408714 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1364/2751] 10.222.0.27 () {54 vars in 921 bytes} [Tue Sep 13 15:37:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:37:33.414517 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb67c62a-fc25-4538-a4bb-48eddd7a99ff None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:37:33.414985 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb67c62a-fc25-4538-a4bb-48eddd7a99ff None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:37:33.415216 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb67c62a-fc25-4538-a4bb-48eddd7a99ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:37:33.461750 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-cb67c62a-fc25-4538-a4bb-48eddd7a99ff None None] MFA Rules not processed for user `62aad71c6c1a4469805762bba330bf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:37:33.463066 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-cb67c62a-fc25-4538-a4bb-48eddd7a99ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:37:33.563079 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1388/2752] 10.222.0.27 () {58 vars in 1018 bytes} [Tue Sep 13 15:37:33 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 15:37:33.577228 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e683c2-8807-4ae6-bcaa-90cfc24968b1 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:37:33.579072 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-95e683c2-8807-4ae6-bcaa-90cfc24968b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:37:33.639281 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e683c2-8807-4ae6-bcaa-90cfc24968b1 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:37:33.643004 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21d4c02-a5a6-4772-96d8-da0bcf9fe90f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef26a5203094c83b52f10b930dfc453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:37:33.643605 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21d4c02-a5a6-4772-96d8-da0bcf9fe90f service glance] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:37:33.643891 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21d4c02-a5a6-4772-96d8-da0bcf9fe90f service glance] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:37:33.644169 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21d4c02-a5a6-4772-96d8-da0bcf9fe90f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:37:33.654262 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21d4c02-a5a6-4772-96d8-da0bcf9fe90f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:37:33.655695 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21d4c02-a5a6-4772-96d8-da0bcf9fe90f service glance] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:37:33.666933 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1365/2753] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:37:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:37:33.738258 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df717b14-2a4c-4d22-bf6c-30949520345f None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:37:33.738548 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df717b14-2a4c-4d22-bf6c-30949520345f None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:37:33.738830 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df717b14-2a4c-4d22-bf6c-30949520345f None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:37:33.740195 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1389/2754] 10.222.0.27 () {54 vars in 921 bytes} [Tue Sep 13 15:37:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:37:33.744891 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3945c4-b87f-4dbe-af66-33cb158d8245 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:37:33.745179 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3945c4-b87f-4dbe-af66-33cb158d8245 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:37:33.745453 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3945c4-b87f-4dbe-af66-33cb158d8245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:37:33.779428 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-8f3945c4-b87f-4dbe-af66-33cb158d8245 None None] MFA Rules not processed for user `41675154bbba47388040966f75d84c3c`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:37:33.780631 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-8f3945c4-b87f-4dbe-af66-33cb158d8245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:37:33.839650 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1366/2755] 10.222.0.27 () {58 vars in 1018 bytes} [Tue Sep 13 15:37:33 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:37:33.852118 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df717b14-2a4c-4d22-bf6c-30949520345f None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:37:33.853971 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-df717b14-2a4c-4d22-bf6c-30949520345f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:37:33.867835 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df717b14-2a4c-4d22-bf6c-30949520345f None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:37:33.871453 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabcfbba-b345-45d2-bd7e-6d7aea716ae5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41675154bbba47388040966f75d84c3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:37:33.872041 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabcfbba-b345-45d2-bd7e-6d7aea716ae5 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:37:33.872317 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabcfbba-b345-45d2-bd7e-6d7aea716ae5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:37:33.872585 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabcfbba-b345-45d2-bd7e-6d7aea716ae5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:37:33.879790 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabcfbba-b345-45d2-bd7e-6d7aea716ae5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:37:33.881193 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabcfbba-b345-45d2-bd7e-6d7aea716ae5 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:37:33.889326 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1390/2756] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:37:33 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:37:33.976310 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289daa42-7184-438b-a6e1-de4efb1c660c None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:37:33.976599 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289daa42-7184-438b-a6e1-de4efb1c660c None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:37:33.976884 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289daa42-7184-438b-a6e1-de4efb1c660c None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:37:33.978266 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1367/2757] 10.222.0.27 () {54 vars in 921 bytes} [Tue Sep 13 15:37:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 15:37:33.983555 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c56b3f-36ff-4750-97bd-d731ee37be65 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:37:33.983844 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c56b3f-36ff-4750-97bd-d731ee37be65 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:37:33.984119 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c56b3f-36ff-4750-97bd-d731ee37be65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:37:34.004018 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-03c56b3f-36ff-4750-97bd-d731ee37be65 None None] MFA Rules not processed for user `62aad71c6c1a4469805762bba330bf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:37:34.005211 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-03c56b3f-36ff-4750-97bd-d731ee37be65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:37:34.014333 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1391/2758] 10.222.0.27 () {58 vars in 1018 bytes} [Tue Sep 13 15:37:33 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:37:34.026538 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289daa42-7184-438b-a6e1-de4efb1c660c None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:37:34.038422 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289daa42-7184-438b-a6e1-de4efb1c660c None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:37:34.042018 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21cc36b-0c74-442a-a31b-ff8bf819eee1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41675154bbba47388040966f75d84c3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:37:34.042615 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21cc36b-0c74-442a-a31b-ff8bf819eee1 service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:37:34.042901 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21cc36b-0c74-442a-a31b-ff8bf819eee1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:37:34.043180 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21cc36b-0c74-442a-a31b-ff8bf819eee1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:37:34.053606 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21cc36b-0c74-442a-a31b-ff8bf819eee1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:37:34.055061 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21cc36b-0c74-442a-a31b-ff8bf819eee1 service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:37:34.066085 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1368/2759] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:37:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:37:35.619747 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba3312a-1fbd-4ccf-8823-7e3dc738a1bc None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:37:35.620236 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba3312a-1fbd-4ccf-8823-7e3dc738a1bc None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:37:35.620349 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba3312a-1fbd-4ccf-8823-7e3dc738a1bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:37:35.639567 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-6ba3312a-1fbd-4ccf-8823-7e3dc738a1bc None None] MFA Rules not processed for user `e97bcdb20f1e416ea41b99c226617faf`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:37:35.640765 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-6ba3312a-1fbd-4ccf-8823-7e3dc738a1bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:37:35.647906 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1392/2760] 10.222.0.27 () {58 vars in 1009 bytes} [Tue Sep 13 15:37:35 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:37:35.659963 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21cc36b-0c74-442a-a31b-ff8bf819eee1 service neutron] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:37:35.671254 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21cc36b-0c74-442a-a31b-ff8bf819eee1 service neutron] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:37:35.676789 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2663a859-130d-4db4-ac25-c9abaa7b9875 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc735644be394e0abe73e709373e2003', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:37:35.677383 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2663a859-130d-4db4-ac25-c9abaa7b9875 service swift] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:37:35.677664 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2663a859-130d-4db4-ac25-c9abaa7b9875 service swift] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:37:35.677969 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2663a859-130d-4db4-ac25-c9abaa7b9875 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:37:35.685946 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2663a859-130d-4db4-ac25-c9abaa7b9875 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:37:35.687507 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2663a859-130d-4db4-ac25-c9abaa7b9875 service swift] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:37:35.696138 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1369/2761] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Sep 13 15:37:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 15:37:45.634338 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=97 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:37:45.692933 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=70 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:37:48.980865 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d89ead-30c1-42f0-ade5-e690aeeda1ea None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:37:48.981370 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d89ead-30c1-42f0-ade5-e690aeeda1ea None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:37:48.981492 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d89ead-30c1-42f0-ade5-e690aeeda1ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:37:49.000284 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-25d89ead-30c1-42f0-ade5-e690aeeda1ea None None] MFA Rules not processed for user `e97bcdb20f1e416ea41b99c226617faf`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:37:49.001488 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-25d89ead-30c1-42f0-ade5-e690aeeda1ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:37:49.008769 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1393/2762] 10.222.0.27 () {58 vars in 967 bytes} [Tue Sep 13 15:37:48 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:37:49.021463 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2663a859-130d-4db4-ac25-c9abaa7b9875 service swift] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:37:49.031987 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2663a859-130d-4db4-ac25-c9abaa7b9875 service swift] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:37:49.037839 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba800c97-7a04-4469-b4f5-178d4b4fa353 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc735644be394e0abe73e709373e2003', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:37:49.038431 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba800c97-7a04-4469-b4f5-178d4b4fa353 service swift] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:37:49.038712 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba800c97-7a04-4469-b4f5-178d4b4fa353 service swift] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:37:49.038986 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba800c97-7a04-4469-b4f5-178d4b4fa353 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:37:49.046846 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba800c97-7a04-4469-b4f5-178d4b4fa353 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:37:49.048402 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba800c97-7a04-4469-b4f5-178d4b4fa353 service swift] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:37:49.056340 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1370/2763] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Sep 13 15:37:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 15:37:58.995161 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=3 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:37:59.053141 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=6 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:38:28.848233 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d89ead-30c1-42f0-ade5-e690aeeda1ea None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:38:28.849813 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-25d89ead-30c1-42f0-ade5-e690aeeda1ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:38:28.947901 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d89ead-30c1-42f0-ade5-e690aeeda1ea None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:38:28.952514 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c906e4e-aff3-437c-b590-ce306c202c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:38:28.953135 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c906e4e-aff3-437c-b590-ce306c202c22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:38:28.953414 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c906e4e-aff3-437c-b590-ce306c202c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:38:28.953686 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c906e4e-aff3-437c-b590-ce306c202c22 admin admin] PATH_INFO: `/v3/users/fc1649ee0b274411aec5c7cd993b4e95` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:38:28.954844 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c906e4e-aff3-437c-b590-ce306c202c22 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc1649ee0b274411aec5c7cd993b4e95)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:38:28.956746 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c906e4e-aff3-437c-b590-ce306c202c22 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:38:29.001499 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-3c906e4e-aff3-437c-b590-ce306c202c22 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc1649ee0b274411aec5c7cd993b4e95'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:38:29.002206 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-3c906e4e-aff3-437c-b590-ce306c202c22 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc1649ee0b274411aec5c7cd993b4e95'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:38:29.002818 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-3c906e4e-aff3-437c-b590-ce306c202c22 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc1649ee0b274411aec5c7cd993b4e95'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:38:29.010219 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-3c906e4e-aff3-437c-b590-ce306c202c22 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc1649ee0b274411aec5c7cd993b4e95'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:38:29.021792 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-3c906e4e-aff3-437c-b590-ce306c202c22 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc1649ee0b274411aec5c7cd993b4e95'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:38:29.034775 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1394/2764] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 13 15:38:28 2022] DELETE /identity/v3/users/fc1649ee0b274411aec5c7cd993b4e95 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:38:29.219837 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba800c97-7a04-4469-b4f5-178d4b4fa353 service swift] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:38:29.232000 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba800c97-7a04-4469-b4f5-178d4b4fa353 service swift] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:38:29.290811 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10c2d29-a3d5-4098-9656-e089bf8c1dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:38:29.291437 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10c2d29-a3d5-4098-9656-e089bf8c1dc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:38:29.291716 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10c2d29-a3d5-4098-9656-e089bf8c1dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:38:29.291986 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10c2d29-a3d5-4098-9656-e089bf8c1dc7 admin admin] PATH_INFO: `/v3/projects/716964a4c18745b0b650752d01a8e14e` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:38:29.293203 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10c2d29-a3d5-4098-9656-e089bf8c1dc7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=716964a4c18745b0b650752d01a8e14e)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:38:29.295133 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10c2d29-a3d5-4098-9656-e089bf8c1dc7 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:38:29.340773 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-a10c2d29-a3d5-4098-9656-e089bf8c1dc7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '716964a4c18745b0b650752d01a8e14e', 'request_id': 'req-a10c2d29-a3d5-4098-9656-e089bf8c1dc7'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:38:29.346715 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-a10c2d29-a3d5-4098-9656-e089bf8c1dc7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '716964a4c18745b0b650752d01a8e14e', 'request_id': 'req-a10c2d29-a3d5-4098-9656-e089bf8c1dc7'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:38:29.352474 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-a10c2d29-a3d5-4098-9656-e089bf8c1dc7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '716964a4c18745b0b650752d01a8e14e', 'request_id': 'req-a10c2d29-a3d5-4098-9656-e089bf8c1dc7'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:38:29.364407 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-a10c2d29-a3d5-4098-9656-e089bf8c1dc7 admin admin] The token cache is being invalidate because project 716964a4c18745b0b650752d01a8e14e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 15:38:29.364696 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-a10c2d29-a3d5-4098-9656-e089bf8c1dc7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:38:29.365312 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-a10c2d29-a3d5-4098-9656-e089bf8c1dc7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:38:29.366813 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1371/2765] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 13 15:38:29 2022] DELETE /identity/v3/projects/716964a4c18745b0b650752d01a8e14e => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:38:29.372651 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63277a20-4e1b-4116-abed-75a40d250b6d None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:38:29.372936 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63277a20-4e1b-4116-abed-75a40d250b6d None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:38:29.373212 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63277a20-4e1b-4116-abed-75a40d250b6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:38:29.421022 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-63277a20-4e1b-4116-abed-75a40d250b6d None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:38:29.422445 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-63277a20-4e1b-4116-abed-75a40d250b6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:38:29.447879 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:38:29.483129 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1395/2766] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:38:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:38:29.490956 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8172823-21e7-4d0b-aa70-b0f5639b5637 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:38:29.491234 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8172823-21e7-4d0b-aa70-b0f5639b5637 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:38:29.491512 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8172823-21e7-4d0b-aa70-b0f5639b5637 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:38:29.512475 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-b8172823-21e7-4d0b-aa70-b0f5639b5637 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:38:29.513678 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-b8172823-21e7-4d0b-aa70-b0f5639b5637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:38:29.521901 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1372/2767] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:38:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:38:29.526114 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63277a20-4e1b-4116-abed-75a40d250b6d None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:38:29.535816 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63277a20-4e1b-4116-abed-75a40d250b6d None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:38:29.540797 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e34e002-6d60-4e73-b1b8-07beb087c825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:38:29.541430 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e34e002-6d60-4e73-b1b8-07beb087c825 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:38:29.541732 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e34e002-6d60-4e73-b1b8-07beb087c825 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:38:29.542052 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e34e002-6d60-4e73-b1b8-07beb087c825 admin admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:38:29.542697 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e34e002-6d60-4e73-b1b8-07beb087c825 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:38:29.543006 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e34e002-6d60-4e73-b1b8-07beb087c825 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:38:29.544636 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e34e002-6d60-4e73-b1b8-07beb087c825 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:38:29.556506 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1396/2768] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Sep 13 15:38:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:38:29.560861 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8172823-21e7-4d0b-aa70-b0f5639b5637 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:38:29.570129 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8172823-21e7-4d0b-aa70-b0f5639b5637 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:38:29.575763 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7df3e3-b394-48a0-b554-dbdafabef9d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:38:29.576414 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7df3e3-b394-48a0-b554-dbdafabef9d8 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:38:29.576696 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7df3e3-b394-48a0-b554-dbdafabef9d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:38:29.576968 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7df3e3-b394-48a0-b554-dbdafabef9d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:38:29.577600 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7df3e3-b394-48a0-b554-dbdafabef9d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:38:29.579519 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7df3e3-b394-48a0-b554-dbdafabef9d8 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:38:29.606100 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1373/2769] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 13 15:38:29 2022] POST /identity/v3/projects => generated 377 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:38:29.610185 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e34e002-6d60-4e73-b1b8-07beb087c825 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:38:29.621354 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e34e002-6d60-4e73-b1b8-07beb087c825 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:38:29.676788 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151716a6-3f3c-4331-bcd3-74bb2fcbfd0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:38:29.677392 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151716a6-3f3c-4331-bcd3-74bb2fcbfd0b admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:38:29.677678 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151716a6-3f3c-4331-bcd3-74bb2fcbfd0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:38:29.677987 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151716a6-3f3c-4331-bcd3-74bb2fcbfd0b admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:38:29.678614 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151716a6-3f3c-4331-bcd3-74bb2fcbfd0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:38:29.681142 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151716a6-3f3c-4331-bcd3-74bb2fcbfd0b admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:38:29.702187 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1397/2770] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 13 15:38:29 2022] POST /identity/v3/users => generated 289 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 15:38:29.706337 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7df3e3-b394-48a0-b554-dbdafabef9d8 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:38:29.717726 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7df3e3-b394-48a0-b554-dbdafabef9d8 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:38:29.722396 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8342f69-4636-4b52-8c9a-6fe304c3ca5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:38:29.722998 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8342f69-4636-4b52-8c9a-6fe304c3ca5c admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:38:29.723279 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8342f69-4636-4b52-8c9a-6fe304c3ca5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:38:29.723549 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8342f69-4636-4b52-8c9a-6fe304c3ca5c admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:38:29.724185 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8342f69-4636-4b52-8c9a-6fe304c3ca5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:38:29.725802 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8342f69-4636-4b52-8c9a-6fe304c3ca5c admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:38:29.736638 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1374/2771] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:38:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 15:38:29.740626 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151716a6-3f3c-4331-bcd3-74bb2fcbfd0b admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:38:29.751142 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151716a6-3f3c-4331-bcd3-74bb2fcbfd0b admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:38:29.755761 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7c4699-d91b-49e3-9751-4014919af8bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:38:29.756363 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7c4699-d91b-49e3-9751-4014919af8bd admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:38:29.756646 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7c4699-d91b-49e3-9751-4014919af8bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:38:29.756926 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7c4699-d91b-49e3-9751-4014919af8bd admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:38:29.758397 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7c4699-d91b-49e3-9751-4014919af8bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:38:29.760312 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7c4699-d91b-49e3-9751-4014919af8bd admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:38:29.770957 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1398/2772] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:38:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 15:38:29.775573 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8342f69-4636-4b52-8c9a-6fe304c3ca5c admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:38:29.785522 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8342f69-4636-4b52-8c9a-6fe304c3ca5c admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:38:29.790262 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e08ffed-f55f-44c4-b211-818676aee4e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:38:29.791314 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e08ffed-f55f-44c4-b211-818676aee4e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:38:29.791314 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e08ffed-f55f-44c4-b211-818676aee4e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:38:29.791521 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e08ffed-f55f-44c4-b211-818676aee4e2 admin admin] PATH_INFO: `/v3/projects/e3274d419beb4f41806d91fb21fe7e8a/users/dbf71991a7b94249a51f9238b854228f/roles/3fae3d3a28e147d3b2bede2378ff79ae` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:38:29.807034 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e08ffed-f55f-44c4-b211-818676aee4e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3274d419beb4f41806d91fb21fe7e8a, user_id=dbf71991a7b94249a51f9238b854228f, role_id=3fae3d3a28e147d3b2bede2378ff79ae)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:38:29.809681 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e08ffed-f55f-44c4-b211-818676aee4e2 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:38:29.825514 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1375/2773] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 13 15:38:29 2022] PUT /identity/v3/projects/e3274d419beb4f41806d91fb21fe7e8a/users/dbf71991a7b94249a51f9238b854228f/roles/3fae3d3a28e147d3b2bede2378ff79ae => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:38:29.830597 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751eaa6b-8e57-4cbb-970a-ad01485aa441 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:38:29.830962 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751eaa6b-8e57-4cbb-970a-ad01485aa441 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:38:29.831330 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751eaa6b-8e57-4cbb-970a-ad01485aa441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:38:29.852804 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-751eaa6b-8e57-4cbb-970a-ad01485aa441 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:38:29.854052 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-751eaa6b-8e57-4cbb-970a-ad01485aa441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:38:29.915349 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1399/2774] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:38:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:38:29.924957 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e08ffed-f55f-44c4-b211-818676aee4e2 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:38:29.926656 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-0e08ffed-f55f-44c4-b211-818676aee4e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:38:29.958708 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:38:29.987284 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e08ffed-f55f-44c4-b211-818676aee4e2 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:38:29.991073 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0d56d5-6a36-45cb-b020-5754ad8cc71a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41675154bbba47388040966f75d84c3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:38:29.991688 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0d56d5-6a36-45cb-b020-5754ad8cc71a service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:38:29.992614 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0d56d5-6a36-45cb-b020-5754ad8cc71a service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:38:29.992905 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0d56d5-6a36-45cb-b020-5754ad8cc71a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:38:30.002087 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0d56d5-6a36-45cb-b020-5754ad8cc71a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:38:30.003517 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0d56d5-6a36-45cb-b020-5754ad8cc71a service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:38:30.013288 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1376/2775] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:38:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:38:33.978905 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c66123-ab35-4ae1-a6de-faeb09e74fe5 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:38:33.979707 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c66123-ab35-4ae1-a6de-faeb09e74fe5 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:38:33.980223 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c66123-ab35-4ae1-a6de-faeb09e74fe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:38:34.029936 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-d7c66123-ab35-4ae1-a6de-faeb09e74fe5 None None] MFA Rules not processed for user `dbf71991a7b94249a51f9238b854228f`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:38:34.031537 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-d7c66123-ab35-4ae1-a6de-faeb09e74fe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:38:34.060435 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:38:34.116042 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1400/2776] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:38:33 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:38:34.130780 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0d56d5-6a36-45cb-b020-5754ad8cc71a service neutron] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:38:34.133311 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-8f0d56d5-6a36-45cb-b020-5754ad8cc71a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:38:34.211487 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0d56d5-6a36-45cb-b020-5754ad8cc71a service neutron] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:38:34.217454 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa83088d-4c33-4476-978b-328717eee984 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62aad71c6c1a4469805762bba330bf0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:38:34.218155 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa83088d-4c33-4476-978b-328717eee984 service nova] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:38:34.218444 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa83088d-4c33-4476-978b-328717eee984 service nova] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:38:34.218716 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa83088d-4c33-4476-978b-328717eee984 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:38:34.228328 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa83088d-4c33-4476-978b-328717eee984 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:38:34.229964 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa83088d-4c33-4476-978b-328717eee984 service nova] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:38:34.239662 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1377/2777] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:38:34 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:38:36.548992 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb07556-5bd2-4b53-bedd-0f9181aabb25 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:38:36.549510 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb07556-5bd2-4b53-bedd-0f9181aabb25 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:38:36.549510 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb07556-5bd2-4b53-bedd-0f9181aabb25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:38:36.568746 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-8eb07556-5bd2-4b53-bedd-0f9181aabb25 None None] MFA Rules not processed for user `dbf71991a7b94249a51f9238b854228f`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:38:36.570682 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-8eb07556-5bd2-4b53-bedd-0f9181aabb25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:38:36.579090 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1401/2778] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:38:36 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:38:44.235771 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=48 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:38:46.562871 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=19 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:39:26.416362 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa83088d-4c33-4476-978b-328717eee984 service nova] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:39:26.417805 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-aa83088d-4c33-4476-978b-328717eee984 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:39:26.495427 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa83088d-4c33-4476-978b-328717eee984 service nova] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:39:26.499757 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba2cba4-ae82-46cf-87b2-38f24e03de72 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97acd23097d54bf7805c3cef60626ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:39:26.500358 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba2cba4-ae82-46cf-87b2-38f24e03de72 service cinder] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:39:26.500641 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba2cba4-ae82-46cf-87b2-38f24e03de72 service cinder] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:39:26.500919 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba2cba4-ae82-46cf-87b2-38f24e03de72 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:39:26.502637 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-dba2cba4-ae82-46cf-87b2-38f24e03de72 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:39:26.516155 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba2cba4-ae82-46cf-87b2-38f24e03de72 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:39:26.517581 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba2cba4-ae82-46cf-87b2-38f24e03de72 service cinder] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:39:26.529041 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1378/2779] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:39:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:39:29.277081 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb07556-5bd2-4b53-bedd-0f9181aabb25 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:39:29.287415 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb07556-5bd2-4b53-bedd-0f9181aabb25 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:39:29.291081 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbac69f-44a4-449e-bcf5-726b94efcf38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41675154bbba47388040966f75d84c3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:39:29.291675 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbac69f-44a4-449e-bcf5-726b94efcf38 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:39:29.291957 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbac69f-44a4-449e-bcf5-726b94efcf38 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:39:29.292232 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbac69f-44a4-449e-bcf5-726b94efcf38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:39:29.293991 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-8cbac69f-44a4-449e-bcf5-726b94efcf38 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:39:29.307884 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbac69f-44a4-449e-bcf5-726b94efcf38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:39:29.309314 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbac69f-44a4-449e-bcf5-726b94efcf38 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:39:29.320159 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1402/2780] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:39:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:39:36.523865 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=35 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:39:39.205133 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba2cba4-ae82-46cf-87b2-38f24e03de72 service cinder] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:39:39.206678 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-dba2cba4-ae82-46cf-87b2-38f24e03de72 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:39:39.219101 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba2cba4-ae82-46cf-87b2-38f24e03de72 service cinder] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:39:39.222750 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9278b2c-24b1-4e11-a59a-3a62c9661a34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41675154bbba47388040966f75d84c3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:39:39.223383 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9278b2c-24b1-4e11-a59a-3a62c9661a34 service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:39:39.224270 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9278b2c-24b1-4e11-a59a-3a62c9661a34 service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:39:39.224561 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9278b2c-24b1-4e11-a59a-3a62c9661a34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:39:39.226526 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-f9278b2c-24b1-4e11-a59a-3a62c9661a34 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:39:39.237338 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9278b2c-24b1-4e11-a59a-3a62c9661a34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:39:39.238838 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9278b2c-24b1-4e11-a59a-3a62c9661a34 service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:39:39.247465 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1379/2781] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:39:39 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:39:39.315338 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=6 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:39:49.243402 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=6 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:41:02.649358 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbac69f-44a4-449e-bcf5-726b94efcf38 service neutron] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:41:02.651190 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-8cbac69f-44a4-449e-bcf5-726b94efcf38 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:41:02.666037 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbac69f-44a4-449e-bcf5-726b94efcf38 service neutron] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:41:02.672926 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cea49b5-ba49-4f78-bae8-381fff85e930 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62aad71c6c1a4469805762bba330bf0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:41:02.673526 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cea49b5-ba49-4f78-bae8-381fff85e930 service nova] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:41:02.673840 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cea49b5-ba49-4f78-bae8-381fff85e930 service nova] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:41:02.674117 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cea49b5-ba49-4f78-bae8-381fff85e930 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:41:02.676045 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-1cea49b5-ba49-4f78-bae8-381fff85e930 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:41:02.694794 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cea49b5-ba49-4f78-bae8-381fff85e930 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:41:02.696490 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cea49b5-ba49-4f78-bae8-381fff85e930 service nova] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:41:02.713206 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1403/2782] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:41:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 15:41:06.848284 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceb72f3-6be8-4c90-8779-6b07cdc8bfa6 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:41:06.848790 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceb72f3-6be8-4c90-8779-6b07cdc8bfa6 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:41:06.848893 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceb72f3-6be8-4c90-8779-6b07cdc8bfa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:41:06.869684 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-9ceb72f3-6be8-4c90-8779-6b07cdc8bfa6 None None] MFA Rules not processed for user `dbf71991a7b94249a51f9238b854228f`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:41:06.870916 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-9ceb72f3-6be8-4c90-8779-6b07cdc8bfa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:41:06.877676 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1380/2783] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:41:06 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:41:07.182743 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cea49b5-ba49-4f78-bae8-381fff85e930 service nova] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:41:07.191987 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cea49b5-ba49-4f78-bae8-381fff85e930 service nova] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:41:07.195679 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d013e16-d709-4c2c-a994-926cee448cd1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41675154bbba47388040966f75d84c3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:41:07.196272 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d013e16-d709-4c2c-a994-926cee448cd1 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:41:07.196554 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d013e16-d709-4c2c-a994-926cee448cd1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:41:07.196830 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d013e16-d709-4c2c-a994-926cee448cd1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:41:07.198571 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-4d013e16-d709-4c2c-a994-926cee448cd1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:41:07.208145 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d013e16-d709-4c2c-a994-926cee448cd1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:41:07.210260 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d013e16-d709-4c2c-a994-926cee448cd1 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:41:07.218108 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1404/2784] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:41:07 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:41:07.769894 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ceb72f3-6be8-4c90-8779-6b07cdc8bfa6 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:41:07.771350 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-9ceb72f3-6be8-4c90-8779-6b07cdc8bfa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:41:07.842513 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ceb72f3-6be8-4c90-8779-6b07cdc8bfa6 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:41:07.847597 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb58527-7003-4887-9f02-7ea3f7f99a58 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b56f96cb3184a3ba82c8a0c3427e268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:41:07.848204 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb58527-7003-4887-9f02-7ea3f7f99a58 service placement] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:41:07.848490 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb58527-7003-4887-9f02-7ea3f7f99a58 service placement] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:41:07.849040 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb58527-7003-4887-9f02-7ea3f7f99a58 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:41:07.851161 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-7eb58527-7003-4887-9f02-7ea3f7f99a58 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:41:07.862489 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb58527-7003-4887-9f02-7ea3f7f99a58 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:41:07.864071 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb58527-7003-4887-9f02-7ea3f7f99a58 service placement] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:41:07.874990 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1381/2785] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:41:07 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:41:14.754563 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d013e16-d709-4c2c-a994-926cee448cd1 service neutron] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:41:14.771643 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d013e16-d709-4c2c-a994-926cee448cd1 service neutron] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:41:14.777679 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f9ec77-e150-4352-8924-bccfb73f0899 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62aad71c6c1a4469805762bba330bf0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:41:14.778708 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f9ec77-e150-4352-8924-bccfb73f0899 service nova] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:41:14.778708 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f9ec77-e150-4352-8924-bccfb73f0899 service nova] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:41:14.779064 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f9ec77-e150-4352-8924-bccfb73f0899 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:41:14.780904 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-02f9ec77-e150-4352-8924-bccfb73f0899 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:41:14.794725 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f9ec77-e150-4352-8924-bccfb73f0899 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:41:14.796356 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f9ec77-e150-4352-8924-bccfb73f0899 service nova] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:41:14.808705 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1405/2786] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:41:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:41:17.870485 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=35 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:41:18.184477 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb58527-7003-4887-9f02-7ea3f7f99a58 service placement] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:41:18.198476 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb58527-7003-4887-9f02-7ea3f7f99a58 service placement] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:41:18.204964 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19603b59-d36c-434a-a80b-8a08bde7dfb6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62aad71c6c1a4469805762bba330bf0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:41:18.205587 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19603b59-d36c-434a-a80b-8a08bde7dfb6 service nova] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:41:18.205896 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19603b59-d36c-434a-a80b-8a08bde7dfb6 service nova] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:41:18.206175 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19603b59-d36c-434a-a80b-8a08bde7dfb6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:41:18.207936 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-19603b59-d36c-434a-a80b-8a08bde7dfb6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:41:18.222170 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19603b59-d36c-434a-a80b-8a08bde7dfb6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:41:18.223762 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19603b59-d36c-434a-a80b-8a08bde7dfb6 service nova] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:41:18.234950 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1382/2787] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:41:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:41:24.804256 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=18 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:41:28.230312 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=6 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:42:15.011417 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f9ec77-e150-4352-8924-bccfb73f0899 service nova] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:42:15.023914 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f9ec77-e150-4352-8924-bccfb73f0899 service nova] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:42:15.032107 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8103c9-740a-4e37-af89-71abb06205db service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b56f96cb3184a3ba82c8a0c3427e268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:42:15.033157 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8103c9-740a-4e37-af89-71abb06205db service placement] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:42:15.033900 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8103c9-740a-4e37-af89-71abb06205db service placement] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:42:15.034407 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8103c9-740a-4e37-af89-71abb06205db service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:42:15.037439 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-1a8103c9-740a-4e37-af89-71abb06205db service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:42:15.057578 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8103c9-740a-4e37-af89-71abb06205db service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:42:15.060039 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8103c9-740a-4e37-af89-71abb06205db service placement] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:42:15.069435 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19603b59-d36c-434a-a80b-8a08bde7dfb6 service nova] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:42:15.071537 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1406/2788] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:42:15 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:42:15.083181 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19603b59-d36c-434a-a80b-8a08bde7dfb6 service nova] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:42:15.088654 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300dadcf-4bdc-411d-8cf7-40a690fcaee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:42:15.089246 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300dadcf-4bdc-411d-8cf7-40a690fcaee9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:42:15.089533 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300dadcf-4bdc-411d-8cf7-40a690fcaee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:42:15.089840 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300dadcf-4bdc-411d-8cf7-40a690fcaee9 admin admin] PATH_INFO: `/v3/users/dbf71991a7b94249a51f9238b854228f` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:42:15.091011 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300dadcf-4bdc-411d-8cf7-40a690fcaee9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dbf71991a7b94249a51f9238b854228f)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:42:15.092926 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300dadcf-4bdc-411d-8cf7-40a690fcaee9 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:42:15.141136 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-300dadcf-4bdc-411d-8cf7-40a690fcaee9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dbf71991a7b94249a51f9238b854228f'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:42:15.141825 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-300dadcf-4bdc-411d-8cf7-40a690fcaee9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dbf71991a7b94249a51f9238b854228f'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:42:15.142444 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-300dadcf-4bdc-411d-8cf7-40a690fcaee9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dbf71991a7b94249a51f9238b854228f'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:42:15.149904 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-300dadcf-4bdc-411d-8cf7-40a690fcaee9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dbf71991a7b94249a51f9238b854228f'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:42:15.161623 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-300dadcf-4bdc-411d-8cf7-40a690fcaee9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dbf71991a7b94249a51f9238b854228f'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:42:15.173945 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1383/2789] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 13 15:42:15 2022] DELETE /identity/v3/users/dbf71991a7b94249a51f9238b854228f => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 15:42:15.350622 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8103c9-740a-4e37-af89-71abb06205db service placement] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:42:15.362976 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8103c9-740a-4e37-af89-71abb06205db service placement] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:42:15.420546 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7186de81-9651-434f-864d-e73edb3f4fc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:42:15.421169 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7186de81-9651-434f-864d-e73edb3f4fc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:42:15.421447 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7186de81-9651-434f-864d-e73edb3f4fc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:42:15.421747 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7186de81-9651-434f-864d-e73edb3f4fc7 admin admin] PATH_INFO: `/v3/projects/e3274d419beb4f41806d91fb21fe7e8a` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:42:15.422875 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7186de81-9651-434f-864d-e73edb3f4fc7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3274d419beb4f41806d91fb21fe7e8a)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:42:15.424760 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7186de81-9651-434f-864d-e73edb3f4fc7 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:42:15.470613 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-7186de81-9651-434f-864d-e73edb3f4fc7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3274d419beb4f41806d91fb21fe7e8a', 'request_id': 'req-7186de81-9651-434f-864d-e73edb3f4fc7'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:42:15.476640 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-7186de81-9651-434f-864d-e73edb3f4fc7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3274d419beb4f41806d91fb21fe7e8a', 'request_id': 'req-7186de81-9651-434f-864d-e73edb3f4fc7'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:42:15.483770 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-7186de81-9651-434f-864d-e73edb3f4fc7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3274d419beb4f41806d91fb21fe7e8a', 'request_id': 'req-7186de81-9651-434f-864d-e73edb3f4fc7'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:42:15.495008 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-7186de81-9651-434f-864d-e73edb3f4fc7 admin admin] The token cache is being invalidate because project e3274d419beb4f41806d91fb21fe7e8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 15:42:15.495317 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-7186de81-9651-434f-864d-e73edb3f4fc7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:42:15.495944 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-7186de81-9651-434f-864d-e73edb3f4fc7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:42:15.497403 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1407/2790] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 13 15:42:15 2022] DELETE /identity/v3/projects/e3274d419beb4f41806d91fb21fe7e8a => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:42:15.502463 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ec6a15-4afe-4eea-88fb-0b45f647ae16 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:42:15.502776 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ec6a15-4afe-4eea-88fb-0b45f647ae16 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:42:15.503050 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ec6a15-4afe-4eea-88fb-0b45f647ae16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:42:15.523156 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-07ec6a15-4afe-4eea-88fb-0b45f647ae16 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:42:15.524342 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-07ec6a15-4afe-4eea-88fb-0b45f647ae16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:42:15.585693 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1384/2791] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:42:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:42:15.593511 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfa9d87-a321-4539-934b-7f4a2977ac3f None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:42:15.593833 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfa9d87-a321-4539-934b-7f4a2977ac3f None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:42:15.594107 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfa9d87-a321-4539-934b-7f4a2977ac3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:42:15.614093 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-fbfa9d87-a321-4539-934b-7f4a2977ac3f None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:42:15.615413 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-fbfa9d87-a321-4539-934b-7f4a2977ac3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:42:15.623114 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1408/2792] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:42:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:42:15.627267 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ec6a15-4afe-4eea-88fb-0b45f647ae16 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:42:15.637050 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ec6a15-4afe-4eea-88fb-0b45f647ae16 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:42:15.641586 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5b1c2d-fa5b-44c9-94f8-f1fffbc2426c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:42:15.642219 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5b1c2d-fa5b-44c9-94f8-f1fffbc2426c admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:42:15.642506 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5b1c2d-fa5b-44c9-94f8-f1fffbc2426c admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:42:15.642785 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5b1c2d-fa5b-44c9-94f8-f1fffbc2426c admin admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:42:15.643431 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5b1c2d-fa5b-44c9-94f8-f1fffbc2426c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:42:15.643737 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5b1c2d-fa5b-44c9-94f8-f1fffbc2426c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:42:15.645325 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5b1c2d-fa5b-44c9-94f8-f1fffbc2426c admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:42:15.657180 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1385/2793] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Sep 13 15:42:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:42:15.661380 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfa9d87-a321-4539-934b-7f4a2977ac3f None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:42:15.670531 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfa9d87-a321-4539-934b-7f4a2977ac3f None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:42:15.675045 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66223a6-0d69-41ed-840c-de4d58242b78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:42:15.675629 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66223a6-0d69-41ed-840c-de4d58242b78 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:42:15.675935 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66223a6-0d69-41ed-840c-de4d58242b78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:42:15.676209 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66223a6-0d69-41ed-840c-de4d58242b78 admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:42:15.677392 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66223a6-0d69-41ed-840c-de4d58242b78 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:42:15.679516 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66223a6-0d69-41ed-840c-de4d58242b78 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:42:15.715464 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1409/2794] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 13 15:42:15 2022] POST /identity/v3/projects => generated 363 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 15:42:15.719628 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5b1c2d-fa5b-44c9-94f8-f1fffbc2426c admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:42:15.729803 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5b1c2d-fa5b-44c9-94f8-f1fffbc2426c admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:42:15.786000 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3314e3-d863-492f-be97-71b552ffc3e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:42:15.787177 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3314e3-d863-492f-be97-71b552ffc3e2 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:42:15.787449 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3314e3-d863-492f-be97-71b552ffc3e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:42:15.787715 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3314e3-d863-492f-be97-71b552ffc3e2 admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:42:15.788332 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3314e3-d863-492f-be97-71b552ffc3e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:42:15.790253 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3314e3-d863-492f-be97-71b552ffc3e2 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:42:15.798037 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:42:15.812939 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1386/2795] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 13 15:42:15 2022] POST /identity/v3/users => generated 282 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:42:15.817200 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66223a6-0d69-41ed-840c-de4d58242b78 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:42:15.828297 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66223a6-0d69-41ed-840c-de4d58242b78 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:42:15.832851 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69d2508-71bf-4dc2-8506-12677ec8b48a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:42:15.833656 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69d2508-71bf-4dc2-8506-12677ec8b48a admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:42:15.833980 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69d2508-71bf-4dc2-8506-12677ec8b48a admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:42:15.834258 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69d2508-71bf-4dc2-8506-12677ec8b48a admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:42:15.834900 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69d2508-71bf-4dc2-8506-12677ec8b48a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:42:15.836536 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69d2508-71bf-4dc2-8506-12677ec8b48a admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:42:15.846460 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1410/2796] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:42:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 15:42:15.850965 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3314e3-d863-492f-be97-71b552ffc3e2 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:42:15.860841 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3314e3-d863-492f-be97-71b552ffc3e2 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:42:15.866049 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc09a17-6fea-468c-aa5a-5902c0a962e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:42:15.866646 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc09a17-6fea-468c-aa5a-5902c0a962e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:42:15.866926 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc09a17-6fea-468c-aa5a-5902c0a962e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:42:15.867195 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc09a17-6fea-468c-aa5a-5902c0a962e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:42:15.867824 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc09a17-6fea-468c-aa5a-5902c0a962e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:42:15.869388 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc09a17-6fea-468c-aa5a-5902c0a962e4 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:42:15.879695 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1387/2797] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:42:15 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 15:42:15.884080 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69d2508-71bf-4dc2-8506-12677ec8b48a admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:42:15.894074 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69d2508-71bf-4dc2-8506-12677ec8b48a admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:42:15.898994 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d72f53-ad15-43e2-ba84-5418ed2e0f07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:42:15.899643 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d72f53-ad15-43e2-ba84-5418ed2e0f07 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:42:15.899928 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d72f53-ad15-43e2-ba84-5418ed2e0f07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:42:15.900207 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d72f53-ad15-43e2-ba84-5418ed2e0f07 admin admin] PATH_INFO: `/v3/projects/e18b814a1466466cb3934298962e5ddc/users/c6de46d4522f44eca342e2b760002418/roles/3fae3d3a28e147d3b2bede2378ff79ae` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:42:15.919802 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d72f53-ad15-43e2-ba84-5418ed2e0f07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e18b814a1466466cb3934298962e5ddc, user_id=c6de46d4522f44eca342e2b760002418, role_id=3fae3d3a28e147d3b2bede2378ff79ae)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:42:15.922506 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d72f53-ad15-43e2-ba84-5418ed2e0f07 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:42:15.936695 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1411/2798] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 13 15:42:15 2022] PUT /identity/v3/projects/e18b814a1466466cb3934298962e5ddc/users/c6de46d4522f44eca342e2b760002418/roles/3fae3d3a28e147d3b2bede2378ff79ae => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:42:15.948428 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256fe921-5cbd-4894-a7be-3414ec75498a None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:42:15.948794 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256fe921-5cbd-4894-a7be-3414ec75498a None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:42:15.949110 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256fe921-5cbd-4894-a7be-3414ec75498a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:42:15.978205 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-256fe921-5cbd-4894-a7be-3414ec75498a None None] MFA Rules not processed for user `c6de46d4522f44eca342e2b760002418`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:42:15.979802 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-256fe921-5cbd-4894-a7be-3414ec75498a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:42:16.050142 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1388/2799] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:42:15 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:42:16.055140 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d72f53-ad15-43e2-ba84-5418ed2e0f07 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:42:16.060739 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:42:16.117097 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d72f53-ad15-43e2-ba84-5418ed2e0f07 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:42:16.121591 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6962d7-922f-46ac-8a5e-58d0412c4275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:42:16.122212 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6962d7-922f-46ac-8a5e-58d0412c4275 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:42:16.122491 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6962d7-922f-46ac-8a5e-58d0412c4275 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:42:16.122761 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6962d7-922f-46ac-8a5e-58d0412c4275 admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:42:16.123390 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6962d7-922f-46ac-8a5e-58d0412c4275 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:42:16.125277 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6962d7-922f-46ac-8a5e-58d0412c4275 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:42:16.151295 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1412/2800] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 13 15:42:16 2022] POST /identity/v3/projects => generated 363 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:42:16.155311 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256fe921-5cbd-4894-a7be-3414ec75498a None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:42:16.166695 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256fe921-5cbd-4894-a7be-3414ec75498a None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:42:16.221628 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d7d1ee-62d5-42ca-b52a-18216bf1950e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:42:16.222263 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d7d1ee-62d5-42ca-b52a-18216bf1950e admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:42:16.222547 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d7d1ee-62d5-42ca-b52a-18216bf1950e admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:42:16.222823 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d7d1ee-62d5-42ca-b52a-18216bf1950e admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:42:16.223460 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d7d1ee-62d5-42ca-b52a-18216bf1950e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:42:16.225422 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d7d1ee-62d5-42ca-b52a-18216bf1950e admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:42:16.246431 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1389/2801] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 13 15:42:16 2022] POST /identity/v3/users => generated 288 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:42:16.250431 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6962d7-922f-46ac-8a5e-58d0412c4275 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:42:16.261377 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6962d7-922f-46ac-8a5e-58d0412c4275 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:42:16.266250 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc8803a-9181-4b21-93da-7c9090602233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:42:16.266850 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc8803a-9181-4b21-93da-7c9090602233 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:42:16.267131 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc8803a-9181-4b21-93da-7c9090602233 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:42:16.267404 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc8803a-9181-4b21-93da-7c9090602233 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:42:16.268041 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc8803a-9181-4b21-93da-7c9090602233 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:42:16.269642 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc8803a-9181-4b21-93da-7c9090602233 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:42:16.280046 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1413/2802] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:42:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 15:42:16.284005 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d7d1ee-62d5-42ca-b52a-18216bf1950e admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:42:16.293886 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d7d1ee-62d5-42ca-b52a-18216bf1950e admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:42:16.298477 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3fbcc4-ff0c-4560-8b00-ea76573b0d05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:42:16.299119 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3fbcc4-ff0c-4560-8b00-ea76573b0d05 admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:42:16.299402 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3fbcc4-ff0c-4560-8b00-ea76573b0d05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:42:16.299678 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3fbcc4-ff0c-4560-8b00-ea76573b0d05 admin admin] PATH_INFO: `/v3/projects/4736fe5694aa40d4a24dc0d847420cb8/users/af4936c4f0ad4dc48c6bd7b15767df99/roles/f34412ad29f1478cba775b033129f71f` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:42:16.314629 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3fbcc4-ff0c-4560-8b00-ea76573b0d05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4736fe5694aa40d4a24dc0d847420cb8, user_id=af4936c4f0ad4dc48c6bd7b15767df99, role_id=f34412ad29f1478cba775b033129f71f)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:42:16.317268 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3fbcc4-ff0c-4560-8b00-ea76573b0d05 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:42:16.330328 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1390/2803] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 13 15:42:16 2022] PUT /identity/v3/projects/4736fe5694aa40d4a24dc0d847420cb8/users/af4936c4f0ad4dc48c6bd7b15767df99/roles/f34412ad29f1478cba775b033129f71f => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:42:16.334584 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc8803a-9181-4b21-93da-7c9090602233 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:42:16.344529 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc8803a-9181-4b21-93da-7c9090602233 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:42:16.401396 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7977f12b-9fb1-43ef-beac-08266796b46b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:42:16.402035 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7977f12b-9fb1-43ef-beac-08266796b46b admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:42:16.402320 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7977f12b-9fb1-43ef-beac-08266796b46b admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:42:16.402601 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7977f12b-9fb1-43ef-beac-08266796b46b admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:42:16.403235 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7977f12b-9fb1-43ef-beac-08266796b46b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:42:16.404864 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7977f12b-9fb1-43ef-beac-08266796b46b admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:42:16.415139 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1414/2804] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:42:16 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 15:42:16.419262 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3fbcc4-ff0c-4560-8b00-ea76573b0d05 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:42:16.430042 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3fbcc4-ff0c-4560-8b00-ea76573b0d05 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:42:16.435051 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a63304-3717-40da-afe6-90c6bb0df881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:42:16.435712 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a63304-3717-40da-afe6-90c6bb0df881 admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:42:16.435998 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a63304-3717-40da-afe6-90c6bb0df881 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:42:16.436270 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a63304-3717-40da-afe6-90c6bb0df881 admin admin] PATH_INFO: `/v3/projects/4736fe5694aa40d4a24dc0d847420cb8/users/af4936c4f0ad4dc48c6bd7b15767df99/roles/f34412ad29f1478cba775b033129f71f` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:42:16.438222 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a63304-3717-40da-afe6-90c6bb0df881 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4736fe5694aa40d4a24dc0d847420cb8, user_id=af4936c4f0ad4dc48c6bd7b15767df99, role_id=f34412ad29f1478cba775b033129f71f)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:42:16.440844 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a63304-3717-40da-afe6-90c6bb0df881 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:42:16.452242 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1391/2805] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 13 15:42:16 2022] PUT /identity/v3/projects/4736fe5694aa40d4a24dc0d847420cb8/users/af4936c4f0ad4dc48c6bd7b15767df99/roles/f34412ad29f1478cba775b033129f71f => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:42:16.513653 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0fd49c-0be2-4118-b3f6-7dbdafe37f83 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:42:16.513957 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0fd49c-0be2-4118-b3f6-7dbdafe37f83 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:42:16.514235 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0fd49c-0be2-4118-b3f6-7dbdafe37f83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:42:16.542238 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-ba0fd49c-0be2-4118-b3f6-7dbdafe37f83 None None] MFA Rules not processed for user `af4936c4f0ad4dc48c6bd7b15767df99`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:42:16.543444 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-ba0fd49c-0be2-4118-b3f6-7dbdafe37f83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:42:16.605445 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:42:16.609917 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1415/2806] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:42:16 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:42:16.621528 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a63304-3717-40da-afe6-90c6bb0df881 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:42:16.623243 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-e7a63304-3717-40da-afe6-90c6bb0df881 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:42:16.645067 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:42:16.682381 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a63304-3717-40da-afe6-90c6bb0df881 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:42:16.686051 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1045c1a9-8c8e-4a65-8b25-b415e2b4d7f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97acd23097d54bf7805c3cef60626ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:42:16.686654 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1045c1a9-8c8e-4a65-8b25-b415e2b4d7f4 service cinder] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:42:16.686935 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1045c1a9-8c8e-4a65-8b25-b415e2b4d7f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:42:16.687210 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1045c1a9-8c8e-4a65-8b25-b415e2b4d7f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:42:16.696172 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1045c1a9-8c8e-4a65-8b25-b415e2b4d7f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:42:16.697627 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1045c1a9-8c8e-4a65-8b25-b415e2b4d7f4 service cinder] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:42:16.707263 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1392/2807] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:42:16 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:42:16.782190 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0fd49c-0be2-4118-b3f6-7dbdafe37f83 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:42:16.792586 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0fd49c-0be2-4118-b3f6-7dbdafe37f83 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:42:16.796259 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a30245-ecd4-4b2b-94a7-b1f2e2aa05d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97acd23097d54bf7805c3cef60626ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:42:16.796853 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a30245-ecd4-4b2b-94a7-b1f2e2aa05d3 service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:42:16.797134 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a30245-ecd4-4b2b-94a7-b1f2e2aa05d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:42:16.797409 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a30245-ecd4-4b2b-94a7-b1f2e2aa05d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:42:16.856988 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a30245-ecd4-4b2b-94a7-b1f2e2aa05d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:42:16.858605 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a30245-ecd4-4b2b-94a7-b1f2e2aa05d3 service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:42:16.868091 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1416/2808] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:42:16 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:42:22.794618 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1045c1a9-8c8e-4a65-8b25-b415e2b4d7f4 service cinder] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:42:22.856356 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1045c1a9-8c8e-4a65-8b25-b415e2b4d7f4 service cinder] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:42:22.860929 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f51704-ef5c-4fd3-96eb-4c875c636fba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:42:22.861497 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f51704-ef5c-4fd3-96eb-4c875c636fba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:42:22.861814 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f51704-ef5c-4fd3-96eb-4c875c636fba admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:42:22.862092 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f51704-ef5c-4fd3-96eb-4c875c636fba admin admin] PATH_INFO: `/v3/users/c6de46d4522f44eca342e2b760002418` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:42:22.863213 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f51704-ef5c-4fd3-96eb-4c875c636fba admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6de46d4522f44eca342e2b760002418)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:42:22.865734 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f51704-ef5c-4fd3-96eb-4c875c636fba admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:42:22.913206 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-20f51704-ef5c-4fd3-96eb-4c875c636fba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6de46d4522f44eca342e2b760002418'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:42:22.913874 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-20f51704-ef5c-4fd3-96eb-4c875c636fba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6de46d4522f44eca342e2b760002418'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:42:22.914467 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-20f51704-ef5c-4fd3-96eb-4c875c636fba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6de46d4522f44eca342e2b760002418'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:42:22.921340 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-20f51704-ef5c-4fd3-96eb-4c875c636fba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6de46d4522f44eca342e2b760002418'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:42:22.933548 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-20f51704-ef5c-4fd3-96eb-4c875c636fba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6de46d4522f44eca342e2b760002418'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:42:22.946097 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1393/2809] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 13 15:42:22 2022] DELETE /identity/v3/users/c6de46d4522f44eca342e2b760002418 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:42:22.950721 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd244c1-1aae-4448-9cd3-f6499561f49e None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:42:22.951253 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd244c1-1aae-4448-9cd3-f6499561f49e None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:42:22.951375 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd244c1-1aae-4448-9cd3-f6499561f49e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:42:22.971505 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-ebd244c1-1aae-4448-9cd3-f6499561f49e None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:42:22.972705 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-ebd244c1-1aae-4448-9cd3-f6499561f49e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:42:23.031709 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1417/2810] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:42:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 15:42:23.042334 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f51704-ef5c-4fd3-96eb-4c875c636fba admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:42:23.043747 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-20f51704-ef5c-4fd3-96eb-4c875c636fba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:42:23.094340 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:42:23.108044 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f51704-ef5c-4fd3-96eb-4c875c636fba admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:42:23.111868 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d110c64-9e2f-4022-9d22-b826b32e4d48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41675154bbba47388040966f75d84c3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:42:23.112417 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d110c64-9e2f-4022-9d22-b826b32e4d48 service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:42:23.112697 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d110c64-9e2f-4022-9d22-b826b32e4d48 service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:42:23.112971 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d110c64-9e2f-4022-9d22-b826b32e4d48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:42:23.122650 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d110c64-9e2f-4022-9d22-b826b32e4d48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:42:23.124089 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d110c64-9e2f-4022-9d22-b826b32e4d48 service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:42:23.134685 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1394/2811] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:42:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:42:23.402070 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd244c1-1aae-4448-9cd3-f6499561f49e None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:42:23.403581 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-ebd244c1-1aae-4448-9cd3-f6499561f49e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:42:23.420278 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd244c1-1aae-4448-9cd3-f6499561f49e None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:42:23.425187 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcfe11c-55e2-4a21-b8e0-207453e6f47c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:42:23.425773 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcfe11c-55e2-4a21-b8e0-207453e6f47c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:42:23.426088 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcfe11c-55e2-4a21-b8e0-207453e6f47c admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:42:23.426423 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcfe11c-55e2-4a21-b8e0-207453e6f47c admin admin] PATH_INFO: `/v3/projects/e18b814a1466466cb3934298962e5ddc` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:42:23.427790 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcfe11c-55e2-4a21-b8e0-207453e6f47c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e18b814a1466466cb3934298962e5ddc)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:42:23.429937 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcfe11c-55e2-4a21-b8e0-207453e6f47c admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:42:23.476979 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-cbcfe11c-55e2-4a21-b8e0-207453e6f47c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e18b814a1466466cb3934298962e5ddc', 'request_id': 'req-cbcfe11c-55e2-4a21-b8e0-207453e6f47c'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:42:23.483129 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-cbcfe11c-55e2-4a21-b8e0-207453e6f47c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e18b814a1466466cb3934298962e5ddc', 'request_id': 'req-cbcfe11c-55e2-4a21-b8e0-207453e6f47c'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:42:23.490716 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-cbcfe11c-55e2-4a21-b8e0-207453e6f47c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e18b814a1466466cb3934298962e5ddc', 'request_id': 'req-cbcfe11c-55e2-4a21-b8e0-207453e6f47c'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:42:23.501218 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-cbcfe11c-55e2-4a21-b8e0-207453e6f47c admin admin] The token cache is being invalidate because project e18b814a1466466cb3934298962e5ddc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 15:42:23.501534 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-cbcfe11c-55e2-4a21-b8e0-207453e6f47c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:42:23.502226 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-cbcfe11c-55e2-4a21-b8e0-207453e6f47c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:42:23.503723 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1418/2812] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 13 15:42:23 2022] DELETE /identity/v3/projects/e18b814a1466466cb3934298962e5ddc => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:42:23.508233 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d110c64-9e2f-4022-9d22-b826b32e4d48 service neutron] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:42:23.517852 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d110c64-9e2f-4022-9d22-b826b32e4d48 service neutron] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:42:23.574158 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d19595-5ebb-42b8-922c-0c6a3d6c0607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:42:23.574780 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d19595-5ebb-42b8-922c-0c6a3d6c0607 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:42:23.575064 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d19595-5ebb-42b8-922c-0c6a3d6c0607 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:42:23.575340 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d19595-5ebb-42b8-922c-0c6a3d6c0607 admin admin] PATH_INFO: `/v3/users/af4936c4f0ad4dc48c6bd7b15767df99` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:42:23.576453 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d19595-5ebb-42b8-922c-0c6a3d6c0607 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af4936c4f0ad4dc48c6bd7b15767df99)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:42:23.578664 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d19595-5ebb-42b8-922c-0c6a3d6c0607 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:42:23.625419 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-44d19595-5ebb-42b8-922c-0c6a3d6c0607 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af4936c4f0ad4dc48c6bd7b15767df99'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:42:23.626097 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-44d19595-5ebb-42b8-922c-0c6a3d6c0607 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af4936c4f0ad4dc48c6bd7b15767df99'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:42:23.626704 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-44d19595-5ebb-42b8-922c-0c6a3d6c0607 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af4936c4f0ad4dc48c6bd7b15767df99'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:42:23.633903 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-44d19595-5ebb-42b8-922c-0c6a3d6c0607 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af4936c4f0ad4dc48c6bd7b15767df99'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:42:23.646412 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-44d19595-5ebb-42b8-922c-0c6a3d6c0607 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af4936c4f0ad4dc48c6bd7b15767df99'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:42:23.658964 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1395/2813] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 13 15:42:23 2022] DELETE /identity/v3/users/af4936c4f0ad4dc48c6bd7b15767df99 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 15:42:23.932287 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcfe11c-55e2-4a21-b8e0-207453e6f47c admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:42:23.934049 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-cbcfe11c-55e2-4a21-b8e0-207453e6f47c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:42:23.954896 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcfe11c-55e2-4a21-b8e0-207453e6f47c admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:42:23.974622 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:42:24.013806 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158d685d-5ed1-4922-a029-b9ebf9fea989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:42:24.014442 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158d685d-5ed1-4922-a029-b9ebf9fea989 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:42:24.014726 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158d685d-5ed1-4922-a029-b9ebf9fea989 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:42:24.015004 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158d685d-5ed1-4922-a029-b9ebf9fea989 admin admin] PATH_INFO: `/v3/projects/4736fe5694aa40d4a24dc0d847420cb8` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:42:24.016164 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158d685d-5ed1-4922-a029-b9ebf9fea989 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4736fe5694aa40d4a24dc0d847420cb8)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:42:24.018123 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158d685d-5ed1-4922-a029-b9ebf9fea989 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:42:24.062978 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-158d685d-5ed1-4922-a029-b9ebf9fea989 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4736fe5694aa40d4a24dc0d847420cb8', 'request_id': 'req-158d685d-5ed1-4922-a029-b9ebf9fea989'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:42:24.069064 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-158d685d-5ed1-4922-a029-b9ebf9fea989 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4736fe5694aa40d4a24dc0d847420cb8', 'request_id': 'req-158d685d-5ed1-4922-a029-b9ebf9fea989'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:42:24.076263 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-158d685d-5ed1-4922-a029-b9ebf9fea989 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4736fe5694aa40d4a24dc0d847420cb8', 'request_id': 'req-158d685d-5ed1-4922-a029-b9ebf9fea989'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:42:24.087078 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-158d685d-5ed1-4922-a029-b9ebf9fea989 admin admin] The token cache is being invalidate because project 4736fe5694aa40d4a24dc0d847420cb8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 15:42:24.087382 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-158d685d-5ed1-4922-a029-b9ebf9fea989 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:42:24.087973 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-158d685d-5ed1-4922-a029-b9ebf9fea989 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:42:24.089437 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1419/2814] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 13 15:42:23 2022] DELETE /identity/v3/projects/4736fe5694aa40d4a24dc0d847420cb8 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 15:42:24.094309 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7ed8e9-10c1-449b-aa49-68efd06af10d None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:42:24.094787 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7ed8e9-10c1-449b-aa49-68efd06af10d None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:42:24.094910 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7ed8e9-10c1-449b-aa49-68efd06af10d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:42:24.115335 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-2b7ed8e9-10c1-449b-aa49-68efd06af10d None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:42:24.116543 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-2b7ed8e9-10c1-449b-aa49-68efd06af10d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:42:24.174544 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1396/2815] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:42:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:42:24.182725 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5884eb-6e2d-4823-8a6b-60fe599e963d None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:42:24.183061 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5884eb-6e2d-4823-8a6b-60fe599e963d None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:42:24.183369 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5884eb-6e2d-4823-8a6b-60fe599e963d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:42:24.203223 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-4b5884eb-6e2d-4823-8a6b-60fe599e963d None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:42:24.204417 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-4b5884eb-6e2d-4823-8a6b-60fe599e963d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:42:24.212321 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1420/2816] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:42:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:42:24.216452 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7ed8e9-10c1-449b-aa49-68efd06af10d None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:42:24.222481 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:42:24.227221 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7ed8e9-10c1-449b-aa49-68efd06af10d None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:42:24.233093 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ab157f-a345-4542-bacc-bbb886a3a899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:42:24.233769 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ab157f-a345-4542-bacc-bbb886a3a899 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:42:24.234152 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ab157f-a345-4542-bacc-bbb886a3a899 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:42:24.234654 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ab157f-a345-4542-bacc-bbb886a3a899 admin admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:42:24.235547 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ab157f-a345-4542-bacc-bbb886a3a899 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:42:24.235882 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ab157f-a345-4542-bacc-bbb886a3a899 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:42:24.237654 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ab157f-a345-4542-bacc-bbb886a3a899 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:42:24.249948 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1397/2817] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Sep 13 15:42:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:42:24.254178 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5884eb-6e2d-4823-8a6b-60fe599e963d None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:42:24.263466 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5884eb-6e2d-4823-8a6b-60fe599e963d None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:42:24.268002 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd62572-e541-479c-b383-49c128d38b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:42:24.268590 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd62572-e541-479c-b383-49c128d38b53 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:42:24.268868 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd62572-e541-479c-b383-49c128d38b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:42:24.269136 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd62572-e541-479c-b383-49c128d38b53 admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:42:24.269795 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd62572-e541-479c-b383-49c128d38b53 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:42:24.271710 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd62572-e541-479c-b383-49c128d38b53 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:42:24.298511 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1421/2818] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 13 15:42:24 2022] POST /identity/v3/projects => generated 379 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:42:24.303119 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ab157f-a345-4542-bacc-bbb886a3a899 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:42:24.312993 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ab157f-a345-4542-bacc-bbb886a3a899 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:42:24.368972 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b37a6c5-7608-40f5-977d-58d8de2e4a0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:42:24.369574 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b37a6c5-7608-40f5-977d-58d8de2e4a0a admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:42:24.369896 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b37a6c5-7608-40f5-977d-58d8de2e4a0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:42:24.370177 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b37a6c5-7608-40f5-977d-58d8de2e4a0a admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:42:24.370818 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b37a6c5-7608-40f5-977d-58d8de2e4a0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:42:24.372727 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b37a6c5-7608-40f5-977d-58d8de2e4a0a admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:42:24.393679 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1398/2819] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 13 15:42:24 2022] POST /identity/v3/users => generated 290 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:42:24.398601 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd62572-e541-479c-b383-49c128d38b53 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:42:24.408689 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd62572-e541-479c-b383-49c128d38b53 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:42:24.414104 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b388d838-f84e-4e7b-9331-e70b94171970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:42:24.414691 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b388d838-f84e-4e7b-9331-e70b94171970 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:42:24.414974 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b388d838-f84e-4e7b-9331-e70b94171970 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:42:24.415244 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b388d838-f84e-4e7b-9331-e70b94171970 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:42:24.415879 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b388d838-f84e-4e7b-9331-e70b94171970 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:42:24.417454 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b388d838-f84e-4e7b-9331-e70b94171970 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:42:24.428163 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1422/2820] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:42:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 15:42:24.431938 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b37a6c5-7608-40f5-977d-58d8de2e4a0a admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:42:24.442204 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b37a6c5-7608-40f5-977d-58d8de2e4a0a admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:42:24.447526 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a51771-72bc-494f-8b26-1198607ad089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:42:24.448159 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a51771-72bc-494f-8b26-1198607ad089 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:42:24.448443 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a51771-72bc-494f-8b26-1198607ad089 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:42:24.448841 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a51771-72bc-494f-8b26-1198607ad089 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:42:24.449489 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a51771-72bc-494f-8b26-1198607ad089 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:42:24.451124 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a51771-72bc-494f-8b26-1198607ad089 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:42:24.462036 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1399/2821] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:42:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 15:42:24.466028 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b388d838-f84e-4e7b-9331-e70b94171970 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:42:24.475919 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b388d838-f84e-4e7b-9331-e70b94171970 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:42:24.480525 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00f8e19-4add-4963-9f7d-6e27f80489cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:42:24.481170 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00f8e19-4add-4963-9f7d-6e27f80489cb admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:42:24.481456 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00f8e19-4add-4963-9f7d-6e27f80489cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:42:24.481768 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00f8e19-4add-4963-9f7d-6e27f80489cb admin admin] PATH_INFO: `/v3/projects/ca48a09fdf9344efa547853fe4ae2e06/users/03cb5bbdef4849eea9b41b61b4d65322/roles/3fae3d3a28e147d3b2bede2378ff79ae` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:42:24.496831 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00f8e19-4add-4963-9f7d-6e27f80489cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca48a09fdf9344efa547853fe4ae2e06, user_id=03cb5bbdef4849eea9b41b61b4d65322, role_id=3fae3d3a28e147d3b2bede2378ff79ae)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:42:24.499491 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00f8e19-4add-4963-9f7d-6e27f80489cb admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:42:24.512105 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1423/2822] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 13 15:42:24 2022] PUT /identity/v3/projects/ca48a09fdf9344efa547853fe4ae2e06/users/03cb5bbdef4849eea9b41b61b4d65322/roles/3fae3d3a28e147d3b2bede2378ff79ae => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:42:24.523827 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904fff8d-aa2c-4e87-80c5-19036bb05c91 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:42:24.524110 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904fff8d-aa2c-4e87-80c5-19036bb05c91 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:42:24.524400 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904fff8d-aa2c-4e87-80c5-19036bb05c91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:42:24.553051 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-904fff8d-aa2c-4e87-80c5-19036bb05c91 None None] MFA Rules not processed for user `03cb5bbdef4849eea9b41b61b4d65322`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:42:24.554298 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-904fff8d-aa2c-4e87-80c5-19036bb05c91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:42:24.618662 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1400/2823] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:42:24 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:42:24.623090 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00f8e19-4add-4963-9f7d-6e27f80489cb admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:42:24.672037 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:42:24.687456 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00f8e19-4add-4963-9f7d-6e27f80489cb admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:42:24.692063 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39304b50-b14b-481b-bc56-4e3e734f814c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:42:24.692669 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39304b50-b14b-481b-bc56-4e3e734f814c admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:42:24.692952 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39304b50-b14b-481b-bc56-4e3e734f814c admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:42:24.693222 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39304b50-b14b-481b-bc56-4e3e734f814c admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:42:24.693902 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39304b50-b14b-481b-bc56-4e3e734f814c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:42:24.695848 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39304b50-b14b-481b-bc56-4e3e734f814c admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:42:24.723387 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1424/2824] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 13 15:42:24 2022] POST /identity/v3/projects => generated 381 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:42:24.727755 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904fff8d-aa2c-4e87-80c5-19036bb05c91 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:42:24.738785 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904fff8d-aa2c-4e87-80c5-19036bb05c91 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:42:24.794402 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac1e4ab-f274-4801-9657-03c06100f534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:42:24.795020 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac1e4ab-f274-4801-9657-03c06100f534 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:42:24.795296 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac1e4ab-f274-4801-9657-03c06100f534 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:42:24.795575 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac1e4ab-f274-4801-9657-03c06100f534 admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:42:24.796251 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac1e4ab-f274-4801-9657-03c06100f534 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:42:24.798190 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac1e4ab-f274-4801-9657-03c06100f534 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:42:24.806127 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:42:24.820813 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1401/2825] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 13 15:42:24 2022] POST /identity/v3/users => generated 297 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:42:24.824822 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39304b50-b14b-481b-bc56-4e3e734f814c admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:42:24.836393 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39304b50-b14b-481b-bc56-4e3e734f814c admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:42:24.841077 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92997fa1-c696-4f0c-84cf-cda7e6cede4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:42:24.841797 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92997fa1-c696-4f0c-84cf-cda7e6cede4e admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:42:24.842024 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92997fa1-c696-4f0c-84cf-cda7e6cede4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:42:24.842303 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92997fa1-c696-4f0c-84cf-cda7e6cede4e admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:42:24.842972 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92997fa1-c696-4f0c-84cf-cda7e6cede4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:42:24.844557 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92997fa1-c696-4f0c-84cf-cda7e6cede4e admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:42:24.855414 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1425/2826] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:42:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 15:42:24.859445 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac1e4ab-f274-4801-9657-03c06100f534 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:42:24.869675 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac1e4ab-f274-4801-9657-03c06100f534 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:42:24.874299 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9d05ca-cf34-4384-9837-05a621abb163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:42:24.874944 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9d05ca-cf34-4384-9837-05a621abb163 admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:42:24.875225 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9d05ca-cf34-4384-9837-05a621abb163 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:42:24.875503 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9d05ca-cf34-4384-9837-05a621abb163 admin admin] PATH_INFO: `/v3/projects/b896ecf28bd94936ae0adde4dc0ce3af/users/c67497a8fe574f339b4d1a1dcd2a05f9/roles/f34412ad29f1478cba775b033129f71f` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:42:24.891072 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9d05ca-cf34-4384-9837-05a621abb163 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b896ecf28bd94936ae0adde4dc0ce3af, user_id=c67497a8fe574f339b4d1a1dcd2a05f9, role_id=f34412ad29f1478cba775b033129f71f)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:42:24.893760 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9d05ca-cf34-4384-9837-05a621abb163 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:42:24.908471 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1402/2827] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 13 15:42:24 2022] PUT /identity/v3/projects/b896ecf28bd94936ae0adde4dc0ce3af/users/c67497a8fe574f339b4d1a1dcd2a05f9/roles/f34412ad29f1478cba775b033129f71f => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:42:24.912615 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92997fa1-c696-4f0c-84cf-cda7e6cede4e admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:42:24.922848 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92997fa1-c696-4f0c-84cf-cda7e6cede4e admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:42:24.980150 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe759639-6561-4800-aab2-de3cca0a9b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:42:24.980813 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe759639-6561-4800-aab2-de3cca0a9b86 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:42:24.980941 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe759639-6561-4800-aab2-de3cca0a9b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:42:24.981217 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe759639-6561-4800-aab2-de3cca0a9b86 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:42:24.981899 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe759639-6561-4800-aab2-de3cca0a9b86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:42:24.983522 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe759639-6561-4800-aab2-de3cca0a9b86 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:42:24.993429 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1426/2828] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:42:24 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 15:42:24.997578 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9d05ca-cf34-4384-9837-05a621abb163 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:42:25.008555 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9d05ca-cf34-4384-9837-05a621abb163 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:42:25.013122 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e71f466-7ca0-48a9-ab67-b12a34d03758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:42:25.013791 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e71f466-7ca0-48a9-ab67-b12a34d03758 admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:42:25.014076 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e71f466-7ca0-48a9-ab67-b12a34d03758 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:42:25.014353 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e71f466-7ca0-48a9-ab67-b12a34d03758 admin admin] PATH_INFO: `/v3/projects/b896ecf28bd94936ae0adde4dc0ce3af/users/c67497a8fe574f339b4d1a1dcd2a05f9/roles/f34412ad29f1478cba775b033129f71f` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:42:25.016263 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e71f466-7ca0-48a9-ab67-b12a34d03758 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b896ecf28bd94936ae0adde4dc0ce3af, user_id=c67497a8fe574f339b4d1a1dcd2a05f9, role_id=f34412ad29f1478cba775b033129f71f)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:42:25.018992 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e71f466-7ca0-48a9-ab67-b12a34d03758 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:42:25.029925 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1403/2829] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 13 15:42:24 2022] PUT /identity/v3/projects/b896ecf28bd94936ae0adde4dc0ce3af/users/c67497a8fe574f339b4d1a1dcd2a05f9/roles/f34412ad29f1478cba775b033129f71f => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:42:25.040270 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac5365d-5052-4fd7-ab0b-8d208803d59f None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:42:25.040559 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac5365d-5052-4fd7-ab0b-8d208803d59f None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:42:25.040839 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac5365d-5052-4fd7-ab0b-8d208803d59f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:42:25.068155 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-eac5365d-5052-4fd7-ab0b-8d208803d59f None None] MFA Rules not processed for user `c67497a8fe574f339b4d1a1dcd2a05f9`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:42:25.069353 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-eac5365d-5052-4fd7-ab0b-8d208803d59f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:42:25.138635 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1427/2830] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:42:25 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:42:25.151269 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e71f466-7ca0-48a9-ab67-b12a34d03758 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:42:25.153016 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-9e71f466-7ca0-48a9-ab67-b12a34d03758 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:42:25.212435 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e71f466-7ca0-48a9-ab67-b12a34d03758 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:42:25.216056 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910290ed-0d84-4e1b-be33-5741b7021d0d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97acd23097d54bf7805c3cef60626ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:42:25.216650 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910290ed-0d84-4e1b-be33-5741b7021d0d service cinder] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:42:25.216929 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910290ed-0d84-4e1b-be33-5741b7021d0d service cinder] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:42:25.217201 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910290ed-0d84-4e1b-be33-5741b7021d0d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:42:25.226638 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910290ed-0d84-4e1b-be33-5741b7021d0d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:42:25.228057 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910290ed-0d84-4e1b-be33-5741b7021d0d service cinder] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:42:25.238511 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1404/2831] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:42:25 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:42:25.547559 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac5365d-5052-4fd7-ab0b-8d208803d59f None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:42:25.557563 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac5365d-5052-4fd7-ab0b-8d208803d59f None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:42:25.562192 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0d2404-c093-446c-9b34-32c840872f01 tempest-VolumeQuotaClassesTest-1646465968 tempest-VolumeQuotaClassesTest-1646465968-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c67497a8fe574f339b4d1a1dcd2a05f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b896ecf28bd94936ae0adde4dc0ce3af', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:42:25.562799 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0d2404-c093-446c-9b34-32c840872f01 tempest-VolumeQuotaClassesTest-1646465968 tempest-VolumeQuotaClassesTest-1646465968-project-admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:42:25.563086 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0d2404-c093-446c-9b34-32c840872f01 tempest-VolumeQuotaClassesTest-1646465968 tempest-VolumeQuotaClassesTest-1646465968-project-admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:42:25.563370 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0d2404-c093-446c-9b34-32c840872f01 tempest-VolumeQuotaClassesTest-1646465968 tempest-VolumeQuotaClassesTest-1646465968-project-admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:42:25.564014 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0d2404-c093-446c-9b34-32c840872f01 tempest-VolumeQuotaClassesTest-1646465968 tempest-VolumeQuotaClassesTest-1646465968-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:42:25.564325 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0d2404-c093-446c-9b34-32c840872f01 tempest-VolumeQuotaClassesTest-1646465968 tempest-VolumeQuotaClassesTest-1646465968-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:42:25.565951 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0d2404-c093-446c-9b34-32c840872f01 tempest-VolumeQuotaClassesTest-1646465968 tempest-VolumeQuotaClassesTest-1646465968-project-admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:42:25.577575 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1428/2832] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Sep 13 15:42:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:42:25.581880 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910290ed-0d84-4e1b-be33-5741b7021d0d service cinder] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:42:25.591043 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910290ed-0d84-4e1b-be33-5741b7021d0d service cinder] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:42:25.595898 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1afdba-0ba5-4fe9-a114-d4a6429bca4e tempest-VolumeQuotaClassesTest-1646465968 tempest-VolumeQuotaClassesTest-1646465968-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c67497a8fe574f339b4d1a1dcd2a05f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b896ecf28bd94936ae0adde4dc0ce3af', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:42:25.596506 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1afdba-0ba5-4fe9-a114-d4a6429bca4e tempest-VolumeQuotaClassesTest-1646465968 tempest-VolumeQuotaClassesTest-1646465968-project-admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:42:25.596792 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1afdba-0ba5-4fe9-a114-d4a6429bca4e tempest-VolumeQuotaClassesTest-1646465968 tempest-VolumeQuotaClassesTest-1646465968-project-admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:42:25.597066 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1afdba-0ba5-4fe9-a114-d4a6429bca4e tempest-VolumeQuotaClassesTest-1646465968 tempest-VolumeQuotaClassesTest-1646465968-project-admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:42:25.597715 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1afdba-0ba5-4fe9-a114-d4a6429bca4e tempest-VolumeQuotaClassesTest-1646465968 tempest-VolumeQuotaClassesTest-1646465968-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:42:25.600186 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1afdba-0ba5-4fe9-a114-d4a6429bca4e tempest-VolumeQuotaClassesTest-1646465968 tempest-VolumeQuotaClassesTest-1646465968-project-admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:42:25.626772 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1405/2833] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 13 15:42:25 2022] POST /identity/v3/projects => generated 355 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:42:25.631225 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0d2404-c093-446c-9b34-32c840872f01 tempest-VolumeQuotaClassesTest-1646465968 tempest-VolumeQuotaClassesTest-1646465968-project-admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:42:25.641141 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0d2404-c093-446c-9b34-32c840872f01 tempest-VolumeQuotaClassesTest-1646465968 tempest-VolumeQuotaClassesTest-1646465968-project-admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:42:25.670174 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:42:25.697550 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98845c21-3e92-4d06-b06c-9e59de4c932c tempest-VolumeQuotaClassesTest-1646465968 tempest-VolumeQuotaClassesTest-1646465968-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c67497a8fe574f339b4d1a1dcd2a05f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b896ecf28bd94936ae0adde4dc0ce3af', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:42:25.698191 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98845c21-3e92-4d06-b06c-9e59de4c932c tempest-VolumeQuotaClassesTest-1646465968 tempest-VolumeQuotaClassesTest-1646465968-project-admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:42:25.698476 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98845c21-3e92-4d06-b06c-9e59de4c932c tempest-VolumeQuotaClassesTest-1646465968 tempest-VolumeQuotaClassesTest-1646465968-project-admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:42:25.698754 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98845c21-3e92-4d06-b06c-9e59de4c932c tempest-VolumeQuotaClassesTest-1646465968 tempest-VolumeQuotaClassesTest-1646465968-project-admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:42:25.699406 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98845c21-3e92-4d06-b06c-9e59de4c932c tempest-VolumeQuotaClassesTest-1646465968 tempest-VolumeQuotaClassesTest-1646465968-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:42:25.699712 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98845c21-3e92-4d06-b06c-9e59de4c932c tempest-VolumeQuotaClassesTest-1646465968 tempest-VolumeQuotaClassesTest-1646465968-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:42:25.701309 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98845c21-3e92-4d06-b06c-9e59de4c932c tempest-VolumeQuotaClassesTest-1646465968 tempest-VolumeQuotaClassesTest-1646465968-project-admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:42:25.713939 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1429/2834] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Sep 13 15:42:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:42:25.750577 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1afdba-0ba5-4fe9-a114-d4a6429bca4e tempest-VolumeQuotaClassesTest-1646465968 tempest-VolumeQuotaClassesTest-1646465968-project-admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:42:25.761467 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1afdba-0ba5-4fe9-a114-d4a6429bca4e tempest-VolumeQuotaClassesTest-1646465968 tempest-VolumeQuotaClassesTest-1646465968-project-admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:42:25.766038 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4202cc36-8570-4465-bc84-f00a86c9c794 tempest-VolumeQuotaClassesTest-1646465968 tempest-VolumeQuotaClassesTest-1646465968-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c67497a8fe574f339b4d1a1dcd2a05f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b896ecf28bd94936ae0adde4dc0ce3af', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:42:25.766660 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4202cc36-8570-4465-bc84-f00a86c9c794 tempest-VolumeQuotaClassesTest-1646465968 tempest-VolumeQuotaClassesTest-1646465968-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:42:25.766944 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4202cc36-8570-4465-bc84-f00a86c9c794 tempest-VolumeQuotaClassesTest-1646465968 tempest-VolumeQuotaClassesTest-1646465968-project-admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:42:25.767219 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4202cc36-8570-4465-bc84-f00a86c9c794 tempest-VolumeQuotaClassesTest-1646465968 tempest-VolumeQuotaClassesTest-1646465968-project-admin] PATH_INFO: `/v3/projects/1888d2381b944e86a3039641ed655f2a` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:42:25.768343 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4202cc36-8570-4465-bc84-f00a86c9c794 tempest-VolumeQuotaClassesTest-1646465968 tempest-VolumeQuotaClassesTest-1646465968-project-admin] RBAC: Authorizing `identity:delete_project(project_id=1888d2381b944e86a3039641ed655f2a)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:42:25.770266 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4202cc36-8570-4465-bc84-f00a86c9c794 tempest-VolumeQuotaClassesTest-1646465968 tempest-VolumeQuotaClassesTest-1646465968-project-admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:42:25.816109 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-4202cc36-8570-4465-bc84-f00a86c9c794 tempest-VolumeQuotaClassesTest-1646465968 tempest-VolumeQuotaClassesTest-1646465968-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1888d2381b944e86a3039641ed655f2a', 'request_id': 'req-4202cc36-8570-4465-bc84-f00a86c9c794'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:42:25.823535 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-4202cc36-8570-4465-bc84-f00a86c9c794 tempest-VolumeQuotaClassesTest-1646465968 tempest-VolumeQuotaClassesTest-1646465968-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1888d2381b944e86a3039641ed655f2a', 'request_id': 'req-4202cc36-8570-4465-bc84-f00a86c9c794'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:42:25.829330 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-4202cc36-8570-4465-bc84-f00a86c9c794 tempest-VolumeQuotaClassesTest-1646465968 tempest-VolumeQuotaClassesTest-1646465968-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1888d2381b944e86a3039641ed655f2a', 'request_id': 'req-4202cc36-8570-4465-bc84-f00a86c9c794'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:42:25.841640 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-4202cc36-8570-4465-bc84-f00a86c9c794 tempest-VolumeQuotaClassesTest-1646465968 tempest-VolumeQuotaClassesTest-1646465968-project-admin] The token cache is being invalidate because project 1888d2381b944e86a3039641ed655f2a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 15:42:25.841965 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-4202cc36-8570-4465-bc84-f00a86c9c794 tempest-VolumeQuotaClassesTest-1646465968 tempest-VolumeQuotaClassesTest-1646465968-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:42:25.842595 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-4202cc36-8570-4465-bc84-f00a86c9c794 tempest-VolumeQuotaClassesTest-1646465968 tempest-VolumeQuotaClassesTest-1646465968-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:42:25.844041 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1406/2835] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 13 15:42:25 2022] DELETE /identity/v3/projects/1888d2381b944e86a3039641ed655f2a => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:42:26.032096 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98845c21-3e92-4d06-b06c-9e59de4c932c tempest-VolumeQuotaClassesTest-1646465968 tempest-VolumeQuotaClassesTest-1646465968-project-admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:42:26.033922 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-98845c21-3e92-4d06-b06c-9e59de4c932c tempest-VolumeQuotaClassesTest-1646465968 tempest-VolumeQuotaClassesTest-1646465968-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:42:26.099833 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98845c21-3e92-4d06-b06c-9e59de4c932c tempest-VolumeQuotaClassesTest-1646465968 tempest-VolumeQuotaClassesTest-1646465968-project-admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:42:26.153339 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c542588f-9033-4f1a-8c97-d010b2942f24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:42:26.153997 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c542588f-9033-4f1a-8c97-d010b2942f24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:42:26.154280 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c542588f-9033-4f1a-8c97-d010b2942f24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:42:26.154549 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c542588f-9033-4f1a-8c97-d010b2942f24 admin admin] PATH_INFO: `/v3/users/03cb5bbdef4849eea9b41b61b4d65322` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:42:26.155659 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c542588f-9033-4f1a-8c97-d010b2942f24 admin admin] RBAC: Authorizing `identity:delete_user(user_id=03cb5bbdef4849eea9b41b61b4d65322)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:42:26.157559 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c542588f-9033-4f1a-8c97-d010b2942f24 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:42:26.204187 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-c542588f-9033-4f1a-8c97-d010b2942f24 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03cb5bbdef4849eea9b41b61b4d65322'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:42:26.204831 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-c542588f-9033-4f1a-8c97-d010b2942f24 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03cb5bbdef4849eea9b41b61b4d65322'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:42:26.205429 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-c542588f-9033-4f1a-8c97-d010b2942f24 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03cb5bbdef4849eea9b41b61b4d65322'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:42:26.213147 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-c542588f-9033-4f1a-8c97-d010b2942f24 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03cb5bbdef4849eea9b41b61b4d65322'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:42:26.225430 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-c542588f-9033-4f1a-8c97-d010b2942f24 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03cb5bbdef4849eea9b41b61b4d65322'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:42:26.227176 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:42:26.238657 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1430/2836] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 13 15:42:26 2022] DELETE /identity/v3/users/03cb5bbdef4849eea9b41b61b4d65322 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:42:26.243433 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d878bd85-c4cf-4ecc-9f0e-df84f7457a74 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:42:26.243936 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d878bd85-c4cf-4ecc-9f0e-df84f7457a74 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:42:26.244051 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d878bd85-c4cf-4ecc-9f0e-df84f7457a74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:42:26.263292 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-d878bd85-c4cf-4ecc-9f0e-df84f7457a74 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:42:26.264405 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-d878bd85-c4cf-4ecc-9f0e-df84f7457a74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:42:26.274275 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:INSERT=7,keystone:SELECT=86,keystone:DELETE=7 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:42:26.324550 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1407/2837] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:42:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:42:26.335273 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c542588f-9033-4f1a-8c97-d010b2942f24 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:42:26.336697 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-c542588f-9033-4f1a-8c97-d010b2942f24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:42:26.392084 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c542588f-9033-4f1a-8c97-d010b2942f24 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:42:26.396412 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab1d298-de46-47dd-a413-60a4f4f4d647 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41675154bbba47388040966f75d84c3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:42:26.397013 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab1d298-de46-47dd-a413-60a4f4f4d647 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:42:26.397296 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab1d298-de46-47dd-a413-60a4f4f4d647 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:42:26.397575 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab1d298-de46-47dd-a413-60a4f4f4d647 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:42:26.406545 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab1d298-de46-47dd-a413-60a4f4f4d647 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:42:26.407976 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab1d298-de46-47dd-a413-60a4f4f4d647 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:42:26.417364 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1431/2838] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:42:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:42:26.687095 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d878bd85-c4cf-4ecc-9f0e-df84f7457a74 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:42:26.688717 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-d878bd85-c4cf-4ecc-9f0e-df84f7457a74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:42:26.704885 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d878bd85-c4cf-4ecc-9f0e-df84f7457a74 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:42:26.710820 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b0b510-304b-41b0-a1a1-628013cb6682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:42:26.711589 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b0b510-304b-41b0-a1a1-628013cb6682 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:42:26.711978 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b0b510-304b-41b0-a1a1-628013cb6682 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:42:26.712328 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b0b510-304b-41b0-a1a1-628013cb6682 admin admin] PATH_INFO: `/v3/projects/ca48a09fdf9344efa547853fe4ae2e06` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:42:26.713779 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b0b510-304b-41b0-a1a1-628013cb6682 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca48a09fdf9344efa547853fe4ae2e06)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:42:26.715969 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b0b510-304b-41b0-a1a1-628013cb6682 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:42:26.765564 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-12b0b510-304b-41b0-a1a1-628013cb6682 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca48a09fdf9344efa547853fe4ae2e06', 'request_id': 'req-12b0b510-304b-41b0-a1a1-628013cb6682'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:42:26.772499 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-12b0b510-304b-41b0-a1a1-628013cb6682 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca48a09fdf9344efa547853fe4ae2e06', 'request_id': 'req-12b0b510-304b-41b0-a1a1-628013cb6682'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:42:26.778453 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-12b0b510-304b-41b0-a1a1-628013cb6682 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca48a09fdf9344efa547853fe4ae2e06', 'request_id': 'req-12b0b510-304b-41b0-a1a1-628013cb6682'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:42:26.791862 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-12b0b510-304b-41b0-a1a1-628013cb6682 admin admin] The token cache is being invalidate because project ca48a09fdf9344efa547853fe4ae2e06 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 15:42:26.792090 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-12b0b510-304b-41b0-a1a1-628013cb6682 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:42:26.792721 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-12b0b510-304b-41b0-a1a1-628013cb6682 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:42:26.794232 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1408/2839] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 13 15:42:26 2022] DELETE /identity/v3/projects/ca48a09fdf9344efa547853fe4ae2e06 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:42:26.798209 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab1d298-de46-47dd-a413-60a4f4f4d647 service neutron] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:42:26.808110 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab1d298-de46-47dd-a413-60a4f4f4d647 service neutron] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:42:26.865294 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98800d6a-9a25-4a94-a6fe-484632a684ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:42:26.865957 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98800d6a-9a25-4a94-a6fe-484632a684ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:42:26.866241 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98800d6a-9a25-4a94-a6fe-484632a684ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:42:26.866517 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98800d6a-9a25-4a94-a6fe-484632a684ab admin admin] PATH_INFO: `/v3/users/c67497a8fe574f339b4d1a1dcd2a05f9` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:42:26.867644 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98800d6a-9a25-4a94-a6fe-484632a684ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=c67497a8fe574f339b4d1a1dcd2a05f9)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:42:26.869563 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98800d6a-9a25-4a94-a6fe-484632a684ab admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:42:26.914673 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-98800d6a-9a25-4a94-a6fe-484632a684ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c67497a8fe574f339b4d1a1dcd2a05f9'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:42:26.915314 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-98800d6a-9a25-4a94-a6fe-484632a684ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c67497a8fe574f339b4d1a1dcd2a05f9'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:42:26.915915 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-98800d6a-9a25-4a94-a6fe-484632a684ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c67497a8fe574f339b4d1a1dcd2a05f9'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:42:26.922708 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-98800d6a-9a25-4a94-a6fe-484632a684ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c67497a8fe574f339b4d1a1dcd2a05f9'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:42:26.934475 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-98800d6a-9a25-4a94-a6fe-484632a684ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c67497a8fe574f339b4d1a1dcd2a05f9'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:42:26.946856 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1432/2840] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 13 15:42:26 2022] DELETE /identity/v3/users/c67497a8fe574f339b4d1a1dcd2a05f9 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:42:27.214410 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b0b510-304b-41b0-a1a1-628013cb6682 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:42:27.215862 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-12b0b510-304b-41b0-a1a1-628013cb6682 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:42:27.230822 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b0b510-304b-41b0-a1a1-628013cb6682 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:42:27.288239 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389eabc7-6e24-4fa1-a188-84bcdceeb9ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:42:27.288931 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389eabc7-6e24-4fa1-a188-84bcdceeb9ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:42:27.289136 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389eabc7-6e24-4fa1-a188-84bcdceeb9ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:42:27.289414 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389eabc7-6e24-4fa1-a188-84bcdceeb9ee admin admin] PATH_INFO: `/v3/projects/b896ecf28bd94936ae0adde4dc0ce3af` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:42:27.290571 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389eabc7-6e24-4fa1-a188-84bcdceeb9ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=b896ecf28bd94936ae0adde4dc0ce3af)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:42:27.292504 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389eabc7-6e24-4fa1-a188-84bcdceeb9ee admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:42:27.332504 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:42:27.340845 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-389eabc7-6e24-4fa1-a188-84bcdceeb9ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b896ecf28bd94936ae0adde4dc0ce3af', 'request_id': 'req-389eabc7-6e24-4fa1-a188-84bcdceeb9ee'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:42:27.347467 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-389eabc7-6e24-4fa1-a188-84bcdceeb9ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b896ecf28bd94936ae0adde4dc0ce3af', 'request_id': 'req-389eabc7-6e24-4fa1-a188-84bcdceeb9ee'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:42:27.353034 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-389eabc7-6e24-4fa1-a188-84bcdceeb9ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b896ecf28bd94936ae0adde4dc0ce3af', 'request_id': 'req-389eabc7-6e24-4fa1-a188-84bcdceeb9ee'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:42:27.365730 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-389eabc7-6e24-4fa1-a188-84bcdceeb9ee admin admin] The token cache is being invalidate because project b896ecf28bd94936ae0adde4dc0ce3af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 15:42:27.366038 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-389eabc7-6e24-4fa1-a188-84bcdceeb9ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:42:27.366695 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-389eabc7-6e24-4fa1-a188-84bcdceeb9ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:42:27.368149 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1409/2841] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 13 15:42:27 2022] DELETE /identity/v3/projects/b896ecf28bd94936ae0adde4dc0ce3af => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:42:27.372948 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad79c07-24b0-441d-8e1e-090aad7907d1 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:42:27.373431 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad79c07-24b0-441d-8e1e-090aad7907d1 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:42:27.373552 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad79c07-24b0-441d-8e1e-090aad7907d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:42:27.393103 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-1ad79c07-24b0-441d-8e1e-090aad7907d1 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:42:27.394322 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-1ad79c07-24b0-441d-8e1e-090aad7907d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:42:27.403300 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:42:27.455711 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1433/2842] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:42:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:42:27.463880 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcd47bd-1d1a-444d-bb05-3d54d16783a8 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:42:27.463880 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcd47bd-1d1a-444d-bb05-3d54d16783a8 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:42:27.463880 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcd47bd-1d1a-444d-bb05-3d54d16783a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:42:27.484342 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-7dcd47bd-1d1a-444d-bb05-3d54d16783a8 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:42:27.485555 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-7dcd47bd-1d1a-444d-bb05-3d54d16783a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:42:27.494158 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1410/2843] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:42:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:42:27.498439 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad79c07-24b0-441d-8e1e-090aad7907d1 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:42:27.508883 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad79c07-24b0-441d-8e1e-090aad7907d1 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:42:27.513400 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8aa586e-a028-4ef1-b785-3c40913093e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:42:27.514026 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aa586e-a028-4ef1-b785-3c40913093e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:42:27.514306 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aa586e-a028-4ef1-b785-3c40913093e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:42:27.514576 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aa586e-a028-4ef1-b785-3c40913093e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:42:27.515210 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8aa586e-a028-4ef1-b785-3c40913093e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:42:27.515518 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8aa586e-a028-4ef1-b785-3c40913093e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:42:27.517096 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8aa586e-a028-4ef1-b785-3c40913093e8 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:42:27.529460 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1434/2844] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Sep 13 15:42:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:42:27.534294 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcd47bd-1d1a-444d-bb05-3d54d16783a8 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:42:27.543857 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcd47bd-1d1a-444d-bb05-3d54d16783a8 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:42:27.548644 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c79c0a-5361-4632-89d4-3968b48b3ef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:42:27.549290 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c79c0a-5361-4632-89d4-3968b48b3ef3 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:42:27.549568 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c79c0a-5361-4632-89d4-3968b48b3ef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:42:27.549870 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c79c0a-5361-4632-89d4-3968b48b3ef3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:42:27.550521 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c79c0a-5361-4632-89d4-3968b48b3ef3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:42:27.552942 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c79c0a-5361-4632-89d4-3968b48b3ef3 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:42:27.580172 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1411/2845] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 13 15:42:27 2022] POST /identity/v3/projects => generated 391 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:42:27.584419 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8aa586e-a028-4ef1-b785-3c40913093e8 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:42:27.594324 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8aa586e-a028-4ef1-b785-3c40913093e8 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:42:27.649610 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05827bcb-7fbe-45b3-b054-24929e54eb06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:42:27.650307 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05827bcb-7fbe-45b3-b054-24929e54eb06 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:42:27.650616 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05827bcb-7fbe-45b3-b054-24929e54eb06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:42:27.650889 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05827bcb-7fbe-45b3-b054-24929e54eb06 admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:42:27.652035 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05827bcb-7fbe-45b3-b054-24929e54eb06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:42:27.654120 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05827bcb-7fbe-45b3-b054-24929e54eb06 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:42:27.674759 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1435/2846] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 13 15:42:27 2022] POST /identity/v3/users => generated 296 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:42:27.679424 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c79c0a-5361-4632-89d4-3968b48b3ef3 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:42:27.689718 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c79c0a-5361-4632-89d4-3968b48b3ef3 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:42:27.695226 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4f050b-7952-4c62-88da-6a28daee5776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:42:27.695821 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4f050b-7952-4c62-88da-6a28daee5776 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:42:27.696107 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4f050b-7952-4c62-88da-6a28daee5776 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:42:27.696386 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4f050b-7952-4c62-88da-6a28daee5776 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:42:27.697023 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4f050b-7952-4c62-88da-6a28daee5776 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:42:27.698657 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4f050b-7952-4c62-88da-6a28daee5776 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:42:27.708788 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1412/2847] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:42:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 15:42:27.712656 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05827bcb-7fbe-45b3-b054-24929e54eb06 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:42:27.722957 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05827bcb-7fbe-45b3-b054-24929e54eb06 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:42:27.727708 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab766b98-1b5b-4693-b163-1c398ce79ac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:42:27.728311 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab766b98-1b5b-4693-b163-1c398ce79ac7 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:42:27.728595 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab766b98-1b5b-4693-b163-1c398ce79ac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:42:27.728873 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab766b98-1b5b-4693-b163-1c398ce79ac7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:42:27.729512 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab766b98-1b5b-4693-b163-1c398ce79ac7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:42:27.731155 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab766b98-1b5b-4693-b163-1c398ce79ac7 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:42:27.742454 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1436/2848] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:42:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 15:42:27.746862 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4f050b-7952-4c62-88da-6a28daee5776 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:42:27.757780 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4f050b-7952-4c62-88da-6a28daee5776 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:42:27.762713 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97537226-acb6-4457-89c2-8fde70a284ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:42:27.763461 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97537226-acb6-4457-89c2-8fde70a284ab admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:42:27.763797 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97537226-acb6-4457-89c2-8fde70a284ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:42:27.764113 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97537226-acb6-4457-89c2-8fde70a284ab admin admin] PATH_INFO: `/v3/projects/8d4fd1a9697f459989cbf88c109814f5/users/3bd23e653daa498195c1f921d55ec954/roles/3fae3d3a28e147d3b2bede2378ff79ae` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:42:27.778645 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97537226-acb6-4457-89c2-8fde70a284ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d4fd1a9697f459989cbf88c109814f5, user_id=3bd23e653daa498195c1f921d55ec954, role_id=3fae3d3a28e147d3b2bede2378ff79ae)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:42:27.781297 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97537226-acb6-4457-89c2-8fde70a284ab admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:42:27.794292 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1413/2849] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 13 15:42:27 2022] PUT /identity/v3/projects/8d4fd1a9697f459989cbf88c109814f5/users/3bd23e653daa498195c1f921d55ec954/roles/3fae3d3a28e147d3b2bede2378ff79ae => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:42:27.806397 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fc3072-5612-4285-b19f-a2a1f5c9a04f None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:42:27.806697 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fc3072-5612-4285-b19f-a2a1f5c9a04f None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:42:27.806980 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fc3072-5612-4285-b19f-a2a1f5c9a04f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:42:27.835777 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-66fc3072-5612-4285-b19f-a2a1f5c9a04f None None] MFA Rules not processed for user `3bd23e653daa498195c1f921d55ec954`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:42:27.836912 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-66fc3072-5612-4285-b19f-a2a1f5c9a04f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:42:27.901277 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1437/2850] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:42:27 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:42:27.905883 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97537226-acb6-4457-89c2-8fde70a284ab admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:42:27.968688 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97537226-acb6-4457-89c2-8fde70a284ab admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:42:27.973334 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbf4895-90f0-40ff-a47b-5f331edfd031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:42:27.974106 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbf4895-90f0-40ff-a47b-5f331edfd031 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:42:27.974394 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbf4895-90f0-40ff-a47b-5f331edfd031 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:42:27.974674 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbf4895-90f0-40ff-a47b-5f331edfd031 admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:42:27.975306 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbf4895-90f0-40ff-a47b-5f331edfd031 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:42:27.977213 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbf4895-90f0-40ff-a47b-5f331edfd031 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:42:28.003149 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1414/2851] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 13 15:42:27 2022] POST /identity/v3/projects => generated 393 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:42:28.007821 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fc3072-5612-4285-b19f-a2a1f5c9a04f None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:42:28.018775 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fc3072-5612-4285-b19f-a2a1f5c9a04f None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:42:28.024445 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:42:28.079750 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b35cc16-8791-444f-b9c7-03dc451043e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:42:28.081039 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b35cc16-8791-444f-b9c7-03dc451043e8 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:42:28.081362 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b35cc16-8791-444f-b9c7-03dc451043e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:42:28.081966 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b35cc16-8791-444f-b9c7-03dc451043e8 admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:42:28.082330 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b35cc16-8791-444f-b9c7-03dc451043e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:42:28.085107 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b35cc16-8791-444f-b9c7-03dc451043e8 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:42:28.107675 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1438/2852] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 13 15:42:28 2022] POST /identity/v3/users => generated 303 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 15:42:28.111726 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbf4895-90f0-40ff-a47b-5f331edfd031 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:42:28.122161 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbf4895-90f0-40ff-a47b-5f331edfd031 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:42:28.127820 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d56a04-1b7c-4fa2-8e03-8f00027c497d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:42:28.128126 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d56a04-1b7c-4fa2-8e03-8f00027c497d admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:42:28.128411 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d56a04-1b7c-4fa2-8e03-8f00027c497d admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:42:28.128688 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d56a04-1b7c-4fa2-8e03-8f00027c497d admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:42:28.129336 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d56a04-1b7c-4fa2-8e03-8f00027c497d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:42:28.132093 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d56a04-1b7c-4fa2-8e03-8f00027c497d admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:42:28.143075 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1415/2853] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:42:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 15:42:28.147812 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b35cc16-8791-444f-b9c7-03dc451043e8 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:42:28.158065 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b35cc16-8791-444f-b9c7-03dc451043e8 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:42:28.163101 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6460bc2-56cf-40a6-800c-6d104ac89c48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:42:28.163787 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6460bc2-56cf-40a6-800c-6d104ac89c48 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:42:28.164073 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6460bc2-56cf-40a6-800c-6d104ac89c48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:42:28.164351 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6460bc2-56cf-40a6-800c-6d104ac89c48 admin admin] PATH_INFO: `/v3/projects/5eb901c1debc4805a85148683b677270/users/d441b08a88364a91a4a10025b99a6027/roles/f34412ad29f1478cba775b033129f71f` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:42:28.179730 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6460bc2-56cf-40a6-800c-6d104ac89c48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5eb901c1debc4805a85148683b677270, user_id=d441b08a88364a91a4a10025b99a6027, role_id=f34412ad29f1478cba775b033129f71f)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:42:28.182444 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6460bc2-56cf-40a6-800c-6d104ac89c48 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:42:28.195755 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1439/2854] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 13 15:42:28 2022] PUT /identity/v3/projects/5eb901c1debc4805a85148683b677270/users/d441b08a88364a91a4a10025b99a6027/roles/f34412ad29f1478cba775b033129f71f => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:42:28.199914 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d56a04-1b7c-4fa2-8e03-8f00027c497d admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:42:28.210125 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d56a04-1b7c-4fa2-8e03-8f00027c497d admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:42:28.247636 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:42:28.268348 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c379b8b6-f7f6-428d-8fc4-f74773f8aa36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:42:28.268964 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c379b8b6-f7f6-428d-8fc4-f74773f8aa36 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:42:28.269249 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c379b8b6-f7f6-428d-8fc4-f74773f8aa36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:42:28.269523 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c379b8b6-f7f6-428d-8fc4-f74773f8aa36 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:42:28.270211 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c379b8b6-f7f6-428d-8fc4-f74773f8aa36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:42:28.272027 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c379b8b6-f7f6-428d-8fc4-f74773f8aa36 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:42:28.282478 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1416/2855] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:42:28 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 15:42:28.286739 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6460bc2-56cf-40a6-800c-6d104ac89c48 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:42:28.297024 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6460bc2-56cf-40a6-800c-6d104ac89c48 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:42:28.302219 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab53156-4cad-4454-b376-b2efeb616632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:42:28.303022 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab53156-4cad-4454-b376-b2efeb616632 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:42:28.303306 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab53156-4cad-4454-b376-b2efeb616632 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:42:28.303580 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab53156-4cad-4454-b376-b2efeb616632 admin admin] PATH_INFO: `/v3/projects/5eb901c1debc4805a85148683b677270/users/d441b08a88364a91a4a10025b99a6027/roles/f34412ad29f1478cba775b033129f71f` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:42:28.305493 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab53156-4cad-4454-b376-b2efeb616632 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5eb901c1debc4805a85148683b677270, user_id=d441b08a88364a91a4a10025b99a6027, role_id=f34412ad29f1478cba775b033129f71f)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:42:28.308151 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab53156-4cad-4454-b376-b2efeb616632 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:42:28.318977 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1440/2856] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 13 15:42:28 2022] PUT /identity/v3/projects/5eb901c1debc4805a85148683b677270/users/d441b08a88364a91a4a10025b99a6027/roles/f34412ad29f1478cba775b033129f71f => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:42:28.329326 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3a11c0-9f97-4a02-aee8-d1fcec39776c None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:42:28.329833 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3a11c0-9f97-4a02-aee8-d1fcec39776c None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:42:28.329944 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3a11c0-9f97-4a02-aee8-d1fcec39776c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:42:28.357525 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-bb3a11c0-9f97-4a02-aee8-d1fcec39776c None None] MFA Rules not processed for user `d441b08a88364a91a4a10025b99a6027`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:42:28.358681 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-bb3a11c0-9f97-4a02-aee8-d1fcec39776c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:42:28.425038 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1417/2857] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:42:28 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:42:28.436481 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab53156-4cad-4454-b376-b2efeb616632 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:42:28.438248 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-4ab53156-4cad-4454-b376-b2efeb616632 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:42:28.495802 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab53156-4cad-4454-b376-b2efeb616632 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:42:28.499478 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e5b17a-27e2-4bf4-9573-d0fec6bc8e1c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97acd23097d54bf7805c3cef60626ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:42:28.500085 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e5b17a-27e2-4bf4-9573-d0fec6bc8e1c service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:42:28.500366 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e5b17a-27e2-4bf4-9573-d0fec6bc8e1c service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:42:28.500642 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e5b17a-27e2-4bf4-9573-d0fec6bc8e1c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:42:28.510241 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e5b17a-27e2-4bf4-9573-d0fec6bc8e1c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:42:28.511680 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e5b17a-27e2-4bf4-9573-d0fec6bc8e1c service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:42:28.520969 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1441/2858] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:42:28 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:42:28.567829 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3a11c0-9f97-4a02-aee8-d1fcec39776c None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:42:28.569222 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-bb3a11c0-9f97-4a02-aee8-d1fcec39776c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:42:28.581387 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3a11c0-9f97-4a02-aee8-d1fcec39776c None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:42:28.585233 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0420a686-31c7-4883-8c36-fbb9280a4ac7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97acd23097d54bf7805c3cef60626ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:42:28.585855 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0420a686-31c7-4883-8c36-fbb9280a4ac7 service cinder] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:42:28.586138 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0420a686-31c7-4883-8c36-fbb9280a4ac7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:42:28.586407 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0420a686-31c7-4883-8c36-fbb9280a4ac7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:42:28.641663 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0420a686-31c7-4883-8c36-fbb9280a4ac7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:42:28.643106 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0420a686-31c7-4883-8c36-fbb9280a4ac7 service cinder] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:42:28.652084 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1418/2859] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:42:28 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:42:31.924942 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e5b17a-27e2-4bf4-9573-d0fec6bc8e1c service cinder] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:42:31.986663 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e5b17a-27e2-4bf4-9573-d0fec6bc8e1c service cinder] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:42:31.991544 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d6103c-23ee-4b66-b663-47be79246bcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:42:31.992182 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d6103c-23ee-4b66-b663-47be79246bcc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:42:31.992469 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d6103c-23ee-4b66-b663-47be79246bcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:42:31.992749 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d6103c-23ee-4b66-b663-47be79246bcc admin admin] PATH_INFO: `/v3/users/3bd23e653daa498195c1f921d55ec954` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:42:31.993930 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d6103c-23ee-4b66-b663-47be79246bcc admin admin] RBAC: Authorizing `identity:delete_user(user_id=3bd23e653daa498195c1f921d55ec954)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:42:31.995880 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d6103c-23ee-4b66-b663-47be79246bcc admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:42:32.000553 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:42:32.045963 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-a5d6103c-23ee-4b66-b663-47be79246bcc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3bd23e653daa498195c1f921d55ec954'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:42:32.046612 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-a5d6103c-23ee-4b66-b663-47be79246bcc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3bd23e653daa498195c1f921d55ec954'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:42:32.047216 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-a5d6103c-23ee-4b66-b663-47be79246bcc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3bd23e653daa498195c1f921d55ec954'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:42:32.054205 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-a5d6103c-23ee-4b66-b663-47be79246bcc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3bd23e653daa498195c1f921d55ec954'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:42:32.066053 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-a5d6103c-23ee-4b66-b663-47be79246bcc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3bd23e653daa498195c1f921d55ec954'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:42:32.078643 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1442/2860] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 13 15:42:31 2022] DELETE /identity/v3/users/3bd23e653daa498195c1f921d55ec954 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:42:32.083167 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7ab8f1-74e4-4c04-871b-6f6e893390bd None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:42:32.084175 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7ab8f1-74e4-4c04-871b-6f6e893390bd None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:42:32.084309 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7ab8f1-74e4-4c04-871b-6f6e893390bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:42:32.103810 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-cd7ab8f1-74e4-4c04-871b-6f6e893390bd None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:42:32.105029 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-cd7ab8f1-74e4-4c04-871b-6f6e893390bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:42:32.154849 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:42:32.164410 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1419/2861] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:42:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:42:32.174648 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d6103c-23ee-4b66-b663-47be79246bcc admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:42:32.176089 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-a5d6103c-23ee-4b66-b663-47be79246bcc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:42:32.233091 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d6103c-23ee-4b66-b663-47be79246bcc admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:42:32.236806 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29464203-09ef-470c-8335-ab73ce073584 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41675154bbba47388040966f75d84c3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:42:32.237349 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29464203-09ef-470c-8335-ab73ce073584 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:42:32.237634 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29464203-09ef-470c-8335-ab73ce073584 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:42:32.237943 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29464203-09ef-470c-8335-ab73ce073584 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:42:32.247042 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29464203-09ef-470c-8335-ab73ce073584 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:42:32.248477 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29464203-09ef-470c-8335-ab73ce073584 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:42:32.258574 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1443/2862] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:42:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:42:32.526555 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7ab8f1-74e4-4c04-871b-6f6e893390bd None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:42:32.527981 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-cd7ab8f1-74e4-4c04-871b-6f6e893390bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:42:32.542543 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7ab8f1-74e4-4c04-871b-6f6e893390bd None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:42:32.547381 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb50f36f-07d0-4eb5-8a3c-4e97a46950da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:42:32.548799 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb50f36f-07d0-4eb5-8a3c-4e97a46950da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:42:32.549084 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb50f36f-07d0-4eb5-8a3c-4e97a46950da admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:42:32.549525 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb50f36f-07d0-4eb5-8a3c-4e97a46950da admin admin] PATH_INFO: `/v3/projects/8d4fd1a9697f459989cbf88c109814f5` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:42:32.550930 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb50f36f-07d0-4eb5-8a3c-4e97a46950da admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d4fd1a9697f459989cbf88c109814f5)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:42:32.553063 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb50f36f-07d0-4eb5-8a3c-4e97a46950da admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:42:32.600387 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-eb50f36f-07d0-4eb5-8a3c-4e97a46950da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d4fd1a9697f459989cbf88c109814f5', 'request_id': 'req-eb50f36f-07d0-4eb5-8a3c-4e97a46950da'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:42:32.606691 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-eb50f36f-07d0-4eb5-8a3c-4e97a46950da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d4fd1a9697f459989cbf88c109814f5', 'request_id': 'req-eb50f36f-07d0-4eb5-8a3c-4e97a46950da'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:42:32.612402 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-eb50f36f-07d0-4eb5-8a3c-4e97a46950da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d4fd1a9697f459989cbf88c109814f5', 'request_id': 'req-eb50f36f-07d0-4eb5-8a3c-4e97a46950da'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:42:32.625508 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-eb50f36f-07d0-4eb5-8a3c-4e97a46950da admin admin] The token cache is being invalidate because project 8d4fd1a9697f459989cbf88c109814f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 15:42:32.625832 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-eb50f36f-07d0-4eb5-8a3c-4e97a46950da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:42:32.626463 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-eb50f36f-07d0-4eb5-8a3c-4e97a46950da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:42:32.627937 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1420/2863] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 13 15:42:32 2022] DELETE /identity/v3/projects/8d4fd1a9697f459989cbf88c109814f5 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:42:32.632715 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29464203-09ef-470c-8335-ab73ce073584 service neutron] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:42:32.642353 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29464203-09ef-470c-8335-ab73ce073584 service neutron] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:42:32.698345 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce53d54-13bb-41fb-a054-d248450aba1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:42:32.698972 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce53d54-13bb-41fb-a054-d248450aba1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:42:32.699256 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce53d54-13bb-41fb-a054-d248450aba1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:42:32.699534 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce53d54-13bb-41fb-a054-d248450aba1b admin admin] PATH_INFO: `/v3/users/d441b08a88364a91a4a10025b99a6027` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:42:32.700661 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce53d54-13bb-41fb-a054-d248450aba1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=d441b08a88364a91a4a10025b99a6027)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:42:32.702883 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce53d54-13bb-41fb-a054-d248450aba1b admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:42:32.731785 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:42:32.751120 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-bce53d54-13bb-41fb-a054-d248450aba1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd441b08a88364a91a4a10025b99a6027'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:42:32.751768 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-bce53d54-13bb-41fb-a054-d248450aba1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd441b08a88364a91a4a10025b99a6027'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:42:32.752368 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-bce53d54-13bb-41fb-a054-d248450aba1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd441b08a88364a91a4a10025b99a6027'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:42:32.759913 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-bce53d54-13bb-41fb-a054-d248450aba1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd441b08a88364a91a4a10025b99a6027'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:42:32.771572 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-bce53d54-13bb-41fb-a054-d248450aba1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd441b08a88364a91a4a10025b99a6027'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:42:32.783638 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1444/2864] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 13 15:42:32 2022] DELETE /identity/v3/users/d441b08a88364a91a4a10025b99a6027 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:42:33.048705 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb50f36f-07d0-4eb5-8a3c-4e97a46950da admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:42:33.050190 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-eb50f36f-07d0-4eb5-8a3c-4e97a46950da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:42:33.064163 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb50f36f-07d0-4eb5-8a3c-4e97a46950da admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:42:33.121179 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce7f6ae-929c-41b2-9487-2e84ed0642e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:42:33.121838 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce7f6ae-929c-41b2-9487-2e84ed0642e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:42:33.122106 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce7f6ae-929c-41b2-9487-2e84ed0642e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:42:33.122388 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce7f6ae-929c-41b2-9487-2e84ed0642e9 admin admin] PATH_INFO: `/v3/projects/5eb901c1debc4805a85148683b677270` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:42:33.123556 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce7f6ae-929c-41b2-9487-2e84ed0642e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5eb901c1debc4805a85148683b677270)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:42:33.125445 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce7f6ae-929c-41b2-9487-2e84ed0642e9 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:42:33.172257 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-0ce7f6ae-929c-41b2-9487-2e84ed0642e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5eb901c1debc4805a85148683b677270', 'request_id': 'req-0ce7f6ae-929c-41b2-9487-2e84ed0642e9'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:42:33.178891 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-0ce7f6ae-929c-41b2-9487-2e84ed0642e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5eb901c1debc4805a85148683b677270', 'request_id': 'req-0ce7f6ae-929c-41b2-9487-2e84ed0642e9'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:42:33.184462 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-0ce7f6ae-929c-41b2-9487-2e84ed0642e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5eb901c1debc4805a85148683b677270', 'request_id': 'req-0ce7f6ae-929c-41b2-9487-2e84ed0642e9'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:42:33.196496 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-0ce7f6ae-929c-41b2-9487-2e84ed0642e9 admin admin] The token cache is being invalidate because project 5eb901c1debc4805a85148683b677270 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 15:42:33.196783 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-0ce7f6ae-929c-41b2-9487-2e84ed0642e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:42:33.197400 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-0ce7f6ae-929c-41b2-9487-2e84ed0642e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:42:33.198875 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1421/2865] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 13 15:42:33 2022] DELETE /identity/v3/projects/5eb901c1debc4805a85148683b677270 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:42:33.204034 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce74403-69ce-4f79-84f8-da09dfaab516 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:42:33.204535 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce74403-69ce-4f79-84f8-da09dfaab516 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:42:33.204636 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce74403-69ce-4f79-84f8-da09dfaab516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:42:33.224022 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-8ce74403-69ce-4f79-84f8-da09dfaab516 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:42:33.225773 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-8ce74403-69ce-4f79-84f8-da09dfaab516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:42:33.282995 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1445/2866] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:42:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:42:33.292257 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812f6513-c2ee-470d-a6f6-459a78bca057 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:42:33.292480 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812f6513-c2ee-470d-a6f6-459a78bca057 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:42:33.292762 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812f6513-c2ee-470d-a6f6-459a78bca057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:42:33.312802 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-812f6513-c2ee-470d-a6f6-459a78bca057 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:42:33.314026 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-812f6513-c2ee-470d-a6f6-459a78bca057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:42:33.322007 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1422/2867] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:42:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:42:33.326108 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce74403-69ce-4f79-84f8-da09dfaab516 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:42:33.336407 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce74403-69ce-4f79-84f8-da09dfaab516 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:42:33.340936 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453b298d-1880-483b-87e1-15fc84e4b30d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:42:33.341535 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453b298d-1880-483b-87e1-15fc84e4b30d admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:42:33.341839 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453b298d-1880-483b-87e1-15fc84e4b30d admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:42:33.342113 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453b298d-1880-483b-87e1-15fc84e4b30d admin admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:42:33.342747 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453b298d-1880-483b-87e1-15fc84e4b30d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:42:33.343049 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453b298d-1880-483b-87e1-15fc84e4b30d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:42:33.344633 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453b298d-1880-483b-87e1-15fc84e4b30d admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:42:33.356730 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1446/2868] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Sep 13 15:42:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:42:33.360995 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812f6513-c2ee-470d-a6f6-459a78bca057 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:42:33.370772 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812f6513-c2ee-470d-a6f6-459a78bca057 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:42:33.375357 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce3b88a-ebd2-4937-af84-613a1af19539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:42:33.375944 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce3b88a-ebd2-4937-af84-613a1af19539 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:42:33.376222 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce3b88a-ebd2-4937-af84-613a1af19539 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:42:33.376494 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce3b88a-ebd2-4937-af84-613a1af19539 admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:42:33.377114 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce3b88a-ebd2-4937-af84-613a1af19539 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:42:33.379034 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce3b88a-ebd2-4937-af84-613a1af19539 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:42:33.384284 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:42:33.409995 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1423/2869] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 13 15:42:33 2022] POST /identity/v3/projects => generated 387 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:42:33.414752 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453b298d-1880-483b-87e1-15fc84e4b30d admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:42:33.424457 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453b298d-1880-483b-87e1-15fc84e4b30d admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:42:33.480524 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bf05d6-a998-43c2-a4ad-67c9b7c40dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:42:33.481130 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bf05d6-a998-43c2-a4ad-67c9b7c40dc7 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:42:33.481411 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bf05d6-a998-43c2-a4ad-67c9b7c40dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:42:33.481684 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bf05d6-a998-43c2-a4ad-67c9b7c40dc7 admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:42:33.482335 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bf05d6-a998-43c2-a4ad-67c9b7c40dc7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:42:33.484240 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bf05d6-a998-43c2-a4ad-67c9b7c40dc7 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:42:33.505055 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1447/2870] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 13 15:42:33 2022] POST /identity/v3/users => generated 294 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:42:33.509742 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce3b88a-ebd2-4937-af84-613a1af19539 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:42:33.519874 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce3b88a-ebd2-4937-af84-613a1af19539 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:42:33.524791 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bb4338-c5ef-4986-9cd4-18e63ad05c77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:42:33.525378 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bb4338-c5ef-4986-9cd4-18e63ad05c77 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:42:33.525658 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bb4338-c5ef-4986-9cd4-18e63ad05c77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:42:33.525956 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bb4338-c5ef-4986-9cd4-18e63ad05c77 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:42:33.526589 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bb4338-c5ef-4986-9cd4-18e63ad05c77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:42:33.528159 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bb4338-c5ef-4986-9cd4-18e63ad05c77 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:42:33.538576 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1424/2871] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:42:33 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 15:42:33.542483 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bf05d6-a998-43c2-a4ad-67c9b7c40dc7 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:42:33.552980 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bf05d6-a998-43c2-a4ad-67c9b7c40dc7 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:42:33.557662 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a652d9-b1c5-4d84-9c66-7cf7b88673eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:42:33.558297 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a652d9-b1c5-4d84-9c66-7cf7b88673eb admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:42:33.558583 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a652d9-b1c5-4d84-9c66-7cf7b88673eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:42:33.558858 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a652d9-b1c5-4d84-9c66-7cf7b88673eb admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:42:33.559496 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a652d9-b1c5-4d84-9c66-7cf7b88673eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:42:33.561094 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a652d9-b1c5-4d84-9c66-7cf7b88673eb admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:42:33.572220 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1448/2872] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:42:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 15:42:33.576187 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bb4338-c5ef-4986-9cd4-18e63ad05c77 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:42:33.586470 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bb4338-c5ef-4986-9cd4-18e63ad05c77 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:42:33.591068 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40258f2-56a9-419f-9cde-ded773a2e053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:42:33.591712 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40258f2-56a9-419f-9cde-ded773a2e053 admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:42:33.591996 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40258f2-56a9-419f-9cde-ded773a2e053 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:42:33.592274 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40258f2-56a9-419f-9cde-ded773a2e053 admin admin] PATH_INFO: `/v3/projects/b89291b40103451dbf5be536a7590c2c/users/6c207c684933466d9fb3ecbc207db47c/roles/3fae3d3a28e147d3b2bede2378ff79ae` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:42:33.606844 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40258f2-56a9-419f-9cde-ded773a2e053 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b89291b40103451dbf5be536a7590c2c, user_id=6c207c684933466d9fb3ecbc207db47c, role_id=3fae3d3a28e147d3b2bede2378ff79ae)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:42:33.609750 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40258f2-56a9-419f-9cde-ded773a2e053 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:42:33.623254 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1425/2873] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 13 15:42:33 2022] PUT /identity/v3/projects/b89291b40103451dbf5be536a7590c2c/users/6c207c684933466d9fb3ecbc207db47c/roles/3fae3d3a28e147d3b2bede2378ff79ae => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:42:33.634004 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c813385-f904-4b07-b493-139587d9c133 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:42:33.634290 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c813385-f904-4b07-b493-139587d9c133 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:42:33.634567 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c813385-f904-4b07-b493-139587d9c133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:42:33.654902 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:42:33.663313 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-0c813385-f904-4b07-b493-139587d9c133 None None] MFA Rules not processed for user `6c207c684933466d9fb3ecbc207db47c`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:42:33.665162 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-0c813385-f904-4b07-b493-139587d9c133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:42:33.732245 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1449/2874] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:42:33 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 15:42:33.736749 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40258f2-56a9-419f-9cde-ded773a2e053 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:42:33.797229 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40258f2-56a9-419f-9cde-ded773a2e053 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:42:33.801794 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459950d0-3081-47a2-9670-9f82eda62c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:42:33.802415 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459950d0-3081-47a2-9670-9f82eda62c69 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:42:33.802694 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459950d0-3081-47a2-9670-9f82eda62c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:42:33.802966 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459950d0-3081-47a2-9670-9f82eda62c69 admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:42:33.803582 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459950d0-3081-47a2-9670-9f82eda62c69 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:42:33.805488 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459950d0-3081-47a2-9670-9f82eda62c69 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:42:33.831906 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1426/2875] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 13 15:42:33 2022] POST /identity/v3/projects => generated 387 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:42:33.836790 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c813385-f904-4b07-b493-139587d9c133 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:42:33.847726 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c813385-f904-4b07-b493-139587d9c133 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:42:33.902593 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83713a13-8656-4b3c-b89c-c5c936725ae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:42:33.903435 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83713a13-8656-4b3c-b89c-c5c936725ae1 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:42:33.903719 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83713a13-8656-4b3c-b89c-c5c936725ae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:42:33.903994 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83713a13-8656-4b3c-b89c-c5c936725ae1 admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:42:33.904619 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83713a13-8656-4b3c-b89c-c5c936725ae1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:42:33.906651 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83713a13-8656-4b3c-b89c-c5c936725ae1 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:42:33.928279 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1450/2876] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 13 15:42:33 2022] POST /identity/v3/users => generated 300 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:42:33.933455 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459950d0-3081-47a2-9670-9f82eda62c69 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:42:33.945525 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459950d0-3081-47a2-9670-9f82eda62c69 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:42:33.950200 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba6ba69-148f-4aaa-89e6-f342c8fbd561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:42:33.950816 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba6ba69-148f-4aaa-89e6-f342c8fbd561 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:42:33.951083 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba6ba69-148f-4aaa-89e6-f342c8fbd561 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:42:33.951361 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba6ba69-148f-4aaa-89e6-f342c8fbd561 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:42:33.952002 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba6ba69-148f-4aaa-89e6-f342c8fbd561 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:42:33.953878 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba6ba69-148f-4aaa-89e6-f342c8fbd561 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:42:33.965177 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1427/2877] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:42:33 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 15:42:33.969286 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83713a13-8656-4b3c-b89c-c5c936725ae1 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:42:33.979778 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83713a13-8656-4b3c-b89c-c5c936725ae1 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:42:33.984351 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96516b8-2d13-4b94-9371-a0a49cf23423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:42:33.985000 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96516b8-2d13-4b94-9371-a0a49cf23423 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:42:33.985280 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96516b8-2d13-4b94-9371-a0a49cf23423 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:42:33.985555 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96516b8-2d13-4b94-9371-a0a49cf23423 admin admin] PATH_INFO: `/v3/projects/3f5fafee186547bb9c266604a9c5f88a/users/248ae42190b247a79bbf44e023d0cb98/roles/f34412ad29f1478cba775b033129f71f` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:42:33.999936 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96516b8-2d13-4b94-9371-a0a49cf23423 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f5fafee186547bb9c266604a9c5f88a, user_id=248ae42190b247a79bbf44e023d0cb98, role_id=f34412ad29f1478cba775b033129f71f)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:42:34.002618 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96516b8-2d13-4b94-9371-a0a49cf23423 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:42:34.016159 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1451/2878] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 13 15:42:33 2022] PUT /identity/v3/projects/3f5fafee186547bb9c266604a9c5f88a/users/248ae42190b247a79bbf44e023d0cb98/roles/f34412ad29f1478cba775b033129f71f => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:42:34.020212 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba6ba69-148f-4aaa-89e6-f342c8fbd561 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:42:34.030843 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba6ba69-148f-4aaa-89e6-f342c8fbd561 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:42:34.088535 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49d78e6-fefc-46d6-944e-58460851f812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:42:34.089066 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49d78e6-fefc-46d6-944e-58460851f812 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:42:34.089348 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49d78e6-fefc-46d6-944e-58460851f812 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:42:34.089623 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49d78e6-fefc-46d6-944e-58460851f812 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:42:34.090291 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49d78e6-fefc-46d6-944e-58460851f812 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:42:34.091886 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49d78e6-fefc-46d6-944e-58460851f812 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:42:34.101686 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1428/2879] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:42:34 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 15:42:34.105951 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96516b8-2d13-4b94-9371-a0a49cf23423 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:42:34.116575 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96516b8-2d13-4b94-9371-a0a49cf23423 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:42:34.121177 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b45d363-0df0-42bd-a101-4423cd8b916c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:42:34.121854 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b45d363-0df0-42bd-a101-4423cd8b916c admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:42:34.122141 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b45d363-0df0-42bd-a101-4423cd8b916c admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:42:34.122414 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b45d363-0df0-42bd-a101-4423cd8b916c admin admin] PATH_INFO: `/v3/projects/3f5fafee186547bb9c266604a9c5f88a/users/248ae42190b247a79bbf44e023d0cb98/roles/f34412ad29f1478cba775b033129f71f` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:42:34.124330 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b45d363-0df0-42bd-a101-4423cd8b916c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f5fafee186547bb9c266604a9c5f88a, user_id=248ae42190b247a79bbf44e023d0cb98, role_id=f34412ad29f1478cba775b033129f71f)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:42:34.127075 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b45d363-0df0-42bd-a101-4423cd8b916c admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:42:34.137748 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1452/2880] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 13 15:42:34 2022] PUT /identity/v3/projects/3f5fafee186547bb9c266604a9c5f88a/users/248ae42190b247a79bbf44e023d0cb98/roles/f34412ad29f1478cba775b033129f71f => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:42:34.148762 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618f62e3-423c-4c1c-a03a-12f00c61db9c None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:42:34.149251 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618f62e3-423c-4c1c-a03a-12f00c61db9c None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:42:34.149352 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618f62e3-423c-4c1c-a03a-12f00c61db9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:42:34.176927 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-618f62e3-423c-4c1c-a03a-12f00c61db9c None None] MFA Rules not processed for user `248ae42190b247a79bbf44e023d0cb98`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:42:34.178769 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-618f62e3-423c-4c1c-a03a-12f00c61db9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:42:34.186981 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:42:34.248024 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1429/2881] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:42:34 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:42:34.259269 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b45d363-0df0-42bd-a101-4423cd8b916c admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:42:34.261038 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-5b45d363-0df0-42bd-a101-4423cd8b916c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:42:34.316558 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b45d363-0df0-42bd-a101-4423cd8b916c admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:42:34.320718 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab70b32e-6b8e-4d03-9934-62b111f74007 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97acd23097d54bf7805c3cef60626ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:42:34.321311 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab70b32e-6b8e-4d03-9934-62b111f74007 service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:42:34.321590 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab70b32e-6b8e-4d03-9934-62b111f74007 service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:42:34.321891 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab70b32e-6b8e-4d03-9934-62b111f74007 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:42:34.328875 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:42:34.331447 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab70b32e-6b8e-4d03-9934-62b111f74007 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:42:34.333176 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab70b32e-6b8e-4d03-9934-62b111f74007 service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:42:34.343799 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1453/2882] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:42:34 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:42:34.477963 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618f62e3-423c-4c1c-a03a-12f00c61db9c None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:42:34.539841 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618f62e3-423c-4c1c-a03a-12f00c61db9c None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:42:34.544546 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cd4e81-8d4f-4046-8a47-b61e4b03d817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:42:34.545196 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cd4e81-8d4f-4046-8a47-b61e4b03d817 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:42:34.545477 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cd4e81-8d4f-4046-8a47-b61e4b03d817 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:42:34.545785 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cd4e81-8d4f-4046-8a47-b61e4b03d817 admin admin] PATH_INFO: `/v3/users/6c207c684933466d9fb3ecbc207db47c` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:42:34.546913 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cd4e81-8d4f-4046-8a47-b61e4b03d817 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c207c684933466d9fb3ecbc207db47c)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:42:34.548824 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cd4e81-8d4f-4046-8a47-b61e4b03d817 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:42:34.596009 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-a2cd4e81-8d4f-4046-8a47-b61e4b03d817 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c207c684933466d9fb3ecbc207db47c'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:42:34.596594 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-a2cd4e81-8d4f-4046-8a47-b61e4b03d817 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c207c684933466d9fb3ecbc207db47c'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:42:34.597209 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-a2cd4e81-8d4f-4046-8a47-b61e4b03d817 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c207c684933466d9fb3ecbc207db47c'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:42:34.604211 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-a2cd4e81-8d4f-4046-8a47-b61e4b03d817 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c207c684933466d9fb3ecbc207db47c'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:42:34.616206 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-a2cd4e81-8d4f-4046-8a47-b61e4b03d817 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c207c684933466d9fb3ecbc207db47c'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:42:34.628826 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1430/2883] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 13 15:42:34 2022] DELETE /identity/v3/users/6c207c684933466d9fb3ecbc207db47c => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:42:34.633905 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638ccf39-c2a0-4db3-a450-75e60f093706 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:42:34.634198 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638ccf39-c2a0-4db3-a450-75e60f093706 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:42:34.634480 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638ccf39-c2a0-4db3-a450-75e60f093706 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:42:34.653921 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-638ccf39-c2a0-4db3-a450-75e60f093706 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:42:34.655226 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-638ccf39-c2a0-4db3-a450-75e60f093706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:42:34.712884 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1454/2884] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:42:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:42:34.722751 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cd4e81-8d4f-4046-8a47-b61e4b03d817 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:42:34.724492 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-a2cd4e81-8d4f-4046-8a47-b61e4b03d817 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:42:34.751504 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:42:34.782303 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cd4e81-8d4f-4046-8a47-b61e4b03d817 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:42:34.785944 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c96f08b-1932-4817-86a2-da4d3a644fb6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41675154bbba47388040966f75d84c3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:42:34.786548 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c96f08b-1932-4817-86a2-da4d3a644fb6 service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:42:34.786859 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c96f08b-1932-4817-86a2-da4d3a644fb6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:42:34.787132 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c96f08b-1932-4817-86a2-da4d3a644fb6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:42:34.795892 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c96f08b-1932-4817-86a2-da4d3a644fb6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:42:34.797316 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c96f08b-1932-4817-86a2-da4d3a644fb6 service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:42:34.806796 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1431/2885] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:42:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 15:42:35.076097 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638ccf39-c2a0-4db3-a450-75e60f093706 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:42:35.077807 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-638ccf39-c2a0-4db3-a450-75e60f093706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:42:35.090896 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638ccf39-c2a0-4db3-a450-75e60f093706 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:42:35.095808 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8216d6-02c8-4df2-8eda-cbee82d447c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:42:35.096486 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8216d6-02c8-4df2-8eda-cbee82d447c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:42:35.096843 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8216d6-02c8-4df2-8eda-cbee82d447c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:42:35.097118 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8216d6-02c8-4df2-8eda-cbee82d447c5 admin admin] PATH_INFO: `/v3/projects/b89291b40103451dbf5be536a7590c2c` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:42:35.098288 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8216d6-02c8-4df2-8eda-cbee82d447c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b89291b40103451dbf5be536a7590c2c)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:42:35.101166 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8216d6-02c8-4df2-8eda-cbee82d447c5 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:42:35.150035 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-5a8216d6-02c8-4df2-8eda-cbee82d447c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b89291b40103451dbf5be536a7590c2c', 'request_id': 'req-5a8216d6-02c8-4df2-8eda-cbee82d447c5'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:42:35.156336 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-5a8216d6-02c8-4df2-8eda-cbee82d447c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b89291b40103451dbf5be536a7590c2c', 'request_id': 'req-5a8216d6-02c8-4df2-8eda-cbee82d447c5'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:42:35.164227 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-5a8216d6-02c8-4df2-8eda-cbee82d447c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b89291b40103451dbf5be536a7590c2c', 'request_id': 'req-5a8216d6-02c8-4df2-8eda-cbee82d447c5'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:42:35.174702 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-5a8216d6-02c8-4df2-8eda-cbee82d447c5 admin admin] The token cache is being invalidate because project b89291b40103451dbf5be536a7590c2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 15:42:35.174993 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-5a8216d6-02c8-4df2-8eda-cbee82d447c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:42:35.175617 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-5a8216d6-02c8-4df2-8eda-cbee82d447c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:42:35.177103 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1455/2886] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 13 15:42:35 2022] DELETE /identity/v3/projects/b89291b40103451dbf5be536a7590c2c => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:42:35.181734 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c96f08b-1932-4817-86a2-da4d3a644fb6 service neutron] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:42:35.192850 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c96f08b-1932-4817-86a2-da4d3a644fb6 service neutron] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:42:35.256579 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac0c831-cf70-4905-b8e4-ae771c9facfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:42:35.257211 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac0c831-cf70-4905-b8e4-ae771c9facfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:42:35.257518 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac0c831-cf70-4905-b8e4-ae771c9facfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:42:35.257824 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac0c831-cf70-4905-b8e4-ae771c9facfa admin admin] PATH_INFO: `/v3/users/248ae42190b247a79bbf44e023d0cb98` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:42:35.258945 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac0c831-cf70-4905-b8e4-ae771c9facfa admin admin] RBAC: Authorizing `identity:delete_user(user_id=248ae42190b247a79bbf44e023d0cb98)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:42:35.260975 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac0c831-cf70-4905-b8e4-ae771c9facfa admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:42:35.308222 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-8ac0c831-cf70-4905-b8e4-ae771c9facfa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '248ae42190b247a79bbf44e023d0cb98'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:42:35.308871 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-8ac0c831-cf70-4905-b8e4-ae771c9facfa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '248ae42190b247a79bbf44e023d0cb98'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:42:35.309483 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-8ac0c831-cf70-4905-b8e4-ae771c9facfa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '248ae42190b247a79bbf44e023d0cb98'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:42:35.316380 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-8ac0c831-cf70-4905-b8e4-ae771c9facfa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '248ae42190b247a79bbf44e023d0cb98'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:42:35.328844 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-8ac0c831-cf70-4905-b8e4-ae771c9facfa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '248ae42190b247a79bbf44e023d0cb98'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:42:35.341636 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1432/2887] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 13 15:42:35 2022] DELETE /identity/v3/users/248ae42190b247a79bbf44e023d0cb98 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:42:35.611220 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8216d6-02c8-4df2-8eda-cbee82d447c5 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:42:35.612727 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-5a8216d6-02c8-4df2-8eda-cbee82d447c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:42:35.627837 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8216d6-02c8-4df2-8eda-cbee82d447c5 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:42:35.684918 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b4351d-d410-47f3-a6ad-fbd528d23e58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:42:35.685547 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b4351d-d410-47f3-a6ad-fbd528d23e58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:42:35.685878 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b4351d-d410-47f3-a6ad-fbd528d23e58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:42:35.686155 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b4351d-d410-47f3-a6ad-fbd528d23e58 admin admin] PATH_INFO: `/v3/projects/3f5fafee186547bb9c266604a9c5f88a` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:42:35.687273 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b4351d-d410-47f3-a6ad-fbd528d23e58 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f5fafee186547bb9c266604a9c5f88a)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:42:35.689220 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b4351d-d410-47f3-a6ad-fbd528d23e58 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:42:35.712910 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:42:35.738695 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-06b4351d-d410-47f3-a6ad-fbd528d23e58 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f5fafee186547bb9c266604a9c5f88a', 'request_id': 'req-06b4351d-d410-47f3-a6ad-fbd528d23e58'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:42:35.745621 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-06b4351d-d410-47f3-a6ad-fbd528d23e58 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f5fafee186547bb9c266604a9c5f88a', 'request_id': 'req-06b4351d-d410-47f3-a6ad-fbd528d23e58'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:42:35.753103 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-06b4351d-d410-47f3-a6ad-fbd528d23e58 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f5fafee186547bb9c266604a9c5f88a', 'request_id': 'req-06b4351d-d410-47f3-a6ad-fbd528d23e58'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:42:35.764954 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-06b4351d-d410-47f3-a6ad-fbd528d23e58 admin admin] The token cache is being invalidate because project 3f5fafee186547bb9c266604a9c5f88a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 15:42:35.765241 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-06b4351d-d410-47f3-a6ad-fbd528d23e58 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:42:35.765892 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-06b4351d-d410-47f3-a6ad-fbd528d23e58 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:42:35.767357 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1456/2888] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 13 15:42:35 2022] DELETE /identity/v3/projects/3f5fafee186547bb9c266604a9c5f88a => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:42:35.772774 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1661fcc0-0de1-4780-a3bd-25ff6ede0835 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:42:35.773063 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1661fcc0-0de1-4780-a3bd-25ff6ede0835 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:42:35.773334 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1661fcc0-0de1-4780-a3bd-25ff6ede0835 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:42:35.793822 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-1661fcc0-0de1-4780-a3bd-25ff6ede0835 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:42:35.795016 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-1661fcc0-0de1-4780-a3bd-25ff6ede0835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:42:35.836654 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:42:35.854842 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1433/2889] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:42:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:42:35.862371 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f378887e-c126-4cab-b888-4a4c83628168 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:42:35.862660 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f378887e-c126-4cab-b888-4a4c83628168 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:42:35.862934 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f378887e-c126-4cab-b888-4a4c83628168 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:42:35.883563 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-f378887e-c126-4cab-b888-4a4c83628168 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:42:35.884753 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-f378887e-c126-4cab-b888-4a4c83628168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:42:35.892698 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1457/2890] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:42:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:42:35.896813 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1661fcc0-0de1-4780-a3bd-25ff6ede0835 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:42:35.906468 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1661fcc0-0de1-4780-a3bd-25ff6ede0835 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:42:35.911459 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b23c67-ee18-4905-b85d-028901b48529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:42:35.912072 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b23c67-ee18-4905-b85d-028901b48529 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:42:35.912352 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b23c67-ee18-4905-b85d-028901b48529 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:42:35.912617 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b23c67-ee18-4905-b85d-028901b48529 admin admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:42:35.913260 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b23c67-ee18-4905-b85d-028901b48529 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:42:35.913562 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b23c67-ee18-4905-b85d-028901b48529 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:42:35.915175 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b23c67-ee18-4905-b85d-028901b48529 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:42:35.926628 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1434/2891] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Sep 13 15:42:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:42:35.931609 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f378887e-c126-4cab-b888-4a4c83628168 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:42:35.940902 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f378887e-c126-4cab-b888-4a4c83628168 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:42:35.945585 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d2a0a5-6b30-45ee-9a20-96340a64ac30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:42:35.946210 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d2a0a5-6b30-45ee-9a20-96340a64ac30 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:42:35.946497 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d2a0a5-6b30-45ee-9a20-96340a64ac30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:42:35.946775 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d2a0a5-6b30-45ee-9a20-96340a64ac30 admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:42:35.947405 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d2a0a5-6b30-45ee-9a20-96340a64ac30 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:42:35.949299 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d2a0a5-6b30-45ee-9a20-96340a64ac30 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:42:35.977123 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1458/2892] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 13 15:42:35 2022] POST /identity/v3/projects => generated 365 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:42:35.981324 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b23c67-ee18-4905-b85d-028901b48529 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:42:35.991892 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b23c67-ee18-4905-b85d-028901b48529 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:42:36.048740 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502f246a-ba1a-4a01-8460-cbffb90173fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:42:36.049351 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502f246a-ba1a-4a01-8460-cbffb90173fb admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:42:36.049640 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502f246a-ba1a-4a01-8460-cbffb90173fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:42:36.049949 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502f246a-ba1a-4a01-8460-cbffb90173fb admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:42:36.050582 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502f246a-ba1a-4a01-8460-cbffb90173fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:42:36.052595 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502f246a-ba1a-4a01-8460-cbffb90173fb admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:42:36.073332 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1435/2893] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 13 15:42:35 2022] POST /identity/v3/users => generated 283 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:42:36.077721 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d2a0a5-6b30-45ee-9a20-96340a64ac30 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:42:36.088773 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d2a0a5-6b30-45ee-9a20-96340a64ac30 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:42:36.093371 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ad4274-1ab7-42b4-8ddd-5844f32d30c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:42:36.093996 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ad4274-1ab7-42b4-8ddd-5844f32d30c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:42:36.094291 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ad4274-1ab7-42b4-8ddd-5844f32d30c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:42:36.094548 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ad4274-1ab7-42b4-8ddd-5844f32d30c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:42:36.095180 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ad4274-1ab7-42b4-8ddd-5844f32d30c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:42:36.096803 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ad4274-1ab7-42b4-8ddd-5844f32d30c6 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:42:36.107043 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1459/2894] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:42:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 15:42:36.110771 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502f246a-ba1a-4a01-8460-cbffb90173fb admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:42:36.120803 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502f246a-ba1a-4a01-8460-cbffb90173fb admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:42:36.125427 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff08b47-129e-4f50-a37a-d36902ff8e05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:42:36.126070 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff08b47-129e-4f50-a37a-d36902ff8e05 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:42:36.126353 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff08b47-129e-4f50-a37a-d36902ff8e05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:42:36.126629 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff08b47-129e-4f50-a37a-d36902ff8e05 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:42:36.127264 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff08b47-129e-4f50-a37a-d36902ff8e05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:42:36.128870 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff08b47-129e-4f50-a37a-d36902ff8e05 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:42:36.140198 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1436/2895] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:42:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 15:42:36.144501 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ad4274-1ab7-42b4-8ddd-5844f32d30c6 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:42:36.155044 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ad4274-1ab7-42b4-8ddd-5844f32d30c6 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:42:36.159598 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea7d811-6b82-4198-acc4-2acdf9ff61f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:42:36.160242 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea7d811-6b82-4198-acc4-2acdf9ff61f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:42:36.160525 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea7d811-6b82-4198-acc4-2acdf9ff61f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:42:36.160801 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea7d811-6b82-4198-acc4-2acdf9ff61f0 admin admin] PATH_INFO: `/v3/projects/29b80b7a608d4af2b5c605aff4a675c3/users/39bc4a29185341aeacce36900cc6a4b7/roles/3fae3d3a28e147d3b2bede2378ff79ae` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:42:36.174956 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea7d811-6b82-4198-acc4-2acdf9ff61f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29b80b7a608d4af2b5c605aff4a675c3, user_id=39bc4a29185341aeacce36900cc6a4b7, role_id=3fae3d3a28e147d3b2bede2378ff79ae)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:42:36.177726 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea7d811-6b82-4198-acc4-2acdf9ff61f0 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:42:36.191081 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1460/2896] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 13 15:42:36 2022] PUT /identity/v3/projects/29b80b7a608d4af2b5c605aff4a675c3/users/39bc4a29185341aeacce36900cc6a4b7/roles/3fae3d3a28e147d3b2bede2378ff79ae => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:42:36.201671 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e957e919-eff1-4150-8f3c-0056397036a9 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:42:36.202207 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e957e919-eff1-4150-8f3c-0056397036a9 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:42:36.202611 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e957e919-eff1-4150-8f3c-0056397036a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:42:36.234874 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-e957e919-eff1-4150-8f3c-0056397036a9 None None] MFA Rules not processed for user `39bc4a29185341aeacce36900cc6a4b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:42:36.236094 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-e957e919-eff1-4150-8f3c-0056397036a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:42:36.299569 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1437/2897] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:42:36 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:42:36.304203 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea7d811-6b82-4198-acc4-2acdf9ff61f0 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:42:36.365502 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea7d811-6b82-4198-acc4-2acdf9ff61f0 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:42:36.370238 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b841f3a-8639-4ee2-a21c-053b9953fb6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:42:36.370836 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b841f3a-8639-4ee2-a21c-053b9953fb6a admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:42:36.371118 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b841f3a-8639-4ee2-a21c-053b9953fb6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:42:36.371395 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b841f3a-8639-4ee2-a21c-053b9953fb6a admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:42:36.372014 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b841f3a-8639-4ee2-a21c-053b9953fb6a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:42:36.373962 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b841f3a-8639-4ee2-a21c-053b9953fb6a admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:42:36.400553 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1461/2898] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 13 15:42:36 2022] POST /identity/v3/projects => generated 365 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:42:36.404644 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e957e919-eff1-4150-8f3c-0056397036a9 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:42:36.416077 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e957e919-eff1-4150-8f3c-0056397036a9 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:42:36.455637 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:42:36.473056 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c672c99-723f-4ac3-9ab9-6a7f94f2e529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:42:36.473662 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c672c99-723f-4ac3-9ab9-6a7f94f2e529 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:42:36.473997 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c672c99-723f-4ac3-9ab9-6a7f94f2e529 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:42:36.474901 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c672c99-723f-4ac3-9ab9-6a7f94f2e529 admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:42:36.475538 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c672c99-723f-4ac3-9ab9-6a7f94f2e529 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:42:36.477448 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c672c99-723f-4ac3-9ab9-6a7f94f2e529 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:42:36.498124 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1438/2899] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 13 15:42:36 2022] POST /identity/v3/users => generated 289 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:42:36.502176 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b841f3a-8639-4ee2-a21c-053b9953fb6a admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:42:36.512232 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b841f3a-8639-4ee2-a21c-053b9953fb6a admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:42:36.516759 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1bdc21-a115-41b0-a9a0-e211cb984909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:42:36.517348 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1bdc21-a115-41b0-a9a0-e211cb984909 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:42:36.517628 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1bdc21-a115-41b0-a9a0-e211cb984909 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:42:36.517930 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1bdc21-a115-41b0-a9a0-e211cb984909 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:42:36.518568 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1bdc21-a115-41b0-a9a0-e211cb984909 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:42:36.520147 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1bdc21-a115-41b0-a9a0-e211cb984909 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:42:36.530810 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1462/2900] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:42:36 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 15:42:36.535583 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c672c99-723f-4ac3-9ab9-6a7f94f2e529 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:42:36.545666 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c672c99-723f-4ac3-9ab9-6a7f94f2e529 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:42:36.550238 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8060417-03dd-4803-96ae-f870e18f77bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:42:36.550882 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8060417-03dd-4803-96ae-f870e18f77bb admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:42:36.551165 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8060417-03dd-4803-96ae-f870e18f77bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:42:36.551459 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8060417-03dd-4803-96ae-f870e18f77bb admin admin] PATH_INFO: `/v3/projects/83d9cfbcda5f4286a71a9773c7d8ba2e/users/ec220371a00444228fc296487d2c92d7/roles/f34412ad29f1478cba775b033129f71f` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:42:36.566388 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8060417-03dd-4803-96ae-f870e18f77bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=83d9cfbcda5f4286a71a9773c7d8ba2e, user_id=ec220371a00444228fc296487d2c92d7, role_id=f34412ad29f1478cba775b033129f71f)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:42:36.569847 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8060417-03dd-4803-96ae-f870e18f77bb admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:42:36.582522 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1439/2901] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 13 15:42:36 2022] PUT /identity/v3/projects/83d9cfbcda5f4286a71a9773c7d8ba2e/users/ec220371a00444228fc296487d2c92d7/roles/f34412ad29f1478cba775b033129f71f => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 15:42:36.586723 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1bdc21-a115-41b0-a9a0-e211cb984909 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:42:36.596660 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1bdc21-a115-41b0-a9a0-e211cb984909 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:42:36.612814 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:42:36.654912 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23fb5a6-feea-47e3-a76d-d62acad3851f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:42:36.655515 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23fb5a6-feea-47e3-a76d-d62acad3851f admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:42:36.655799 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23fb5a6-feea-47e3-a76d-d62acad3851f admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:42:36.656075 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23fb5a6-feea-47e3-a76d-d62acad3851f admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:42:36.656714 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23fb5a6-feea-47e3-a76d-d62acad3851f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:42:36.658352 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23fb5a6-feea-47e3-a76d-d62acad3851f admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:42:36.667991 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1463/2902] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:42:36 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 15:42:36.672130 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8060417-03dd-4803-96ae-f870e18f77bb admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:42:36.682869 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8060417-03dd-4803-96ae-f870e18f77bb admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:42:36.687440 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a740d215-4525-4d85-b735-f5debd1664df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:42:36.688077 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a740d215-4525-4d85-b735-f5debd1664df admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:42:36.688353 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a740d215-4525-4d85-b735-f5debd1664df admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:42:36.688625 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a740d215-4525-4d85-b735-f5debd1664df admin admin] PATH_INFO: `/v3/projects/83d9cfbcda5f4286a71a9773c7d8ba2e/users/ec220371a00444228fc296487d2c92d7/roles/f34412ad29f1478cba775b033129f71f` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:42:36.690555 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a740d215-4525-4d85-b735-f5debd1664df admin admin] RBAC: Authorizing `identity:create_grant(project_id=83d9cfbcda5f4286a71a9773c7d8ba2e, user_id=ec220371a00444228fc296487d2c92d7, role_id=f34412ad29f1478cba775b033129f71f)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:42:36.693781 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a740d215-4525-4d85-b735-f5debd1664df admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:42:36.704342 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1440/2903] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 13 15:42:36 2022] PUT /identity/v3/projects/83d9cfbcda5f4286a71a9773c7d8ba2e/users/ec220371a00444228fc296487d2c92d7/roles/f34412ad29f1478cba775b033129f71f => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:42:36.715702 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc69ad0-4407-47e4-884d-87b9598fccad None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:42:36.715916 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc69ad0-4407-47e4-884d-87b9598fccad None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:42:36.716199 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc69ad0-4407-47e4-884d-87b9598fccad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:42:36.744323 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-cdc69ad0-4407-47e4-884d-87b9598fccad None None] MFA Rules not processed for user `ec220371a00444228fc296487d2c92d7`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:42:36.745529 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-cdc69ad0-4407-47e4-884d-87b9598fccad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:42:36.811842 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1464/2904] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:42:36 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:42:36.824529 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a740d215-4525-4d85-b735-f5debd1664df admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:42:36.826255 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-a740d215-4525-4d85-b735-f5debd1664df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:42:36.885527 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a740d215-4525-4d85-b735-f5debd1664df admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:42:36.889222 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a3e417-fb48-46ef-bdc7-e8afb07255b0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97acd23097d54bf7805c3cef60626ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:42:36.889864 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a3e417-fb48-46ef-bdc7-e8afb07255b0 service cinder] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:42:36.890144 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a3e417-fb48-46ef-bdc7-e8afb07255b0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:42:36.890417 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a3e417-fb48-46ef-bdc7-e8afb07255b0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:42:36.900073 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a3e417-fb48-46ef-bdc7-e8afb07255b0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:42:36.901492 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a3e417-fb48-46ef-bdc7-e8afb07255b0 service cinder] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:42:36.910904 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1441/2905] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:42:36 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:42:36.995457 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc69ad0-4407-47e4-884d-87b9598fccad None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:42:37.005115 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc69ad0-4407-47e4-884d-87b9598fccad None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:42:37.009354 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b4621e-0cf8-4e0c-adf8-7c15c8542926 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97acd23097d54bf7805c3cef60626ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:42:37.009989 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b4621e-0cf8-4e0c-adf8-7c15c8542926 service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:42:37.010271 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b4621e-0cf8-4e0c-adf8-7c15c8542926 service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:42:37.010546 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b4621e-0cf8-4e0c-adf8-7c15c8542926 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:42:37.065718 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b4621e-0cf8-4e0c-adf8-7c15c8542926 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:42:37.067165 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b4621e-0cf8-4e0c-adf8-7c15c8542926 service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:42:37.076644 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1465/2906] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:42:36 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:42:41.778199 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a3e417-fb48-46ef-bdc7-e8afb07255b0 service cinder] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:42:41.840520 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a3e417-fb48-46ef-bdc7-e8afb07255b0 service cinder] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:42:41.845120 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cd73da-bca2-4279-b080-4e2fdabe0bf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:42:41.845770 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cd73da-bca2-4279-b080-4e2fdabe0bf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:42:41.846076 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cd73da-bca2-4279-b080-4e2fdabe0bf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:42:41.846355 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cd73da-bca2-4279-b080-4e2fdabe0bf4 admin admin] PATH_INFO: `/v3/users/39bc4a29185341aeacce36900cc6a4b7` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:42:41.847481 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cd73da-bca2-4279-b080-4e2fdabe0bf4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=39bc4a29185341aeacce36900cc6a4b7)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:42:41.849499 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cd73da-bca2-4279-b080-4e2fdabe0bf4 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:42:41.889874 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:42:41.896722 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-46cd73da-bca2-4279-b080-4e2fdabe0bf4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39bc4a29185341aeacce36900cc6a4b7'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:42:41.897788 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-46cd73da-bca2-4279-b080-4e2fdabe0bf4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39bc4a29185341aeacce36900cc6a4b7'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:42:41.898503 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-46cd73da-bca2-4279-b080-4e2fdabe0bf4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39bc4a29185341aeacce36900cc6a4b7'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:42:41.906000 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-46cd73da-bca2-4279-b080-4e2fdabe0bf4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39bc4a29185341aeacce36900cc6a4b7'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:42:41.918233 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-46cd73da-bca2-4279-b080-4e2fdabe0bf4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39bc4a29185341aeacce36900cc6a4b7'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:42:41.931168 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1442/2907] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 13 15:42:41 2022] DELETE /identity/v3/users/39bc4a29185341aeacce36900cc6a4b7 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:42:41.935610 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c17b2e-4b39-43a9-90fb-4e593142e98b None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:42:41.936057 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c17b2e-4b39-43a9-90fb-4e593142e98b None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:42:41.936207 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c17b2e-4b39-43a9-90fb-4e593142e98b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:42:41.955977 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-f6c17b2e-4b39-43a9-90fb-4e593142e98b None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:42:41.957204 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-f6c17b2e-4b39-43a9-90fb-4e593142e98b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:42:41.991789 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:42:42.016759 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1466/2908] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:42:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:42:42.026927 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cd73da-bca2-4279-b080-4e2fdabe0bf4 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:42:42.028333 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-46cd73da-bca2-4279-b080-4e2fdabe0bf4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:42:42.086878 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cd73da-bca2-4279-b080-4e2fdabe0bf4 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:42:42.090630 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9df85b-bb2d-4163-aa71-d60ca7fbd07a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41675154bbba47388040966f75d84c3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:42:42.091232 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9df85b-bb2d-4163-aa71-d60ca7fbd07a service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:42:42.091513 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9df85b-bb2d-4163-aa71-d60ca7fbd07a service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:42:42.091789 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9df85b-bb2d-4163-aa71-d60ca7fbd07a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:42:42.101473 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9df85b-bb2d-4163-aa71-d60ca7fbd07a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:42:42.102948 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9df85b-bb2d-4163-aa71-d60ca7fbd07a service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:42:42.112619 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1443/2909] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:42:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:42:42.383368 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c17b2e-4b39-43a9-90fb-4e593142e98b None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:42:42.384831 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-f6c17b2e-4b39-43a9-90fb-4e593142e98b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:42:42.398119 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c17b2e-4b39-43a9-90fb-4e593142e98b None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:42:42.403256 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5af192d-c4f7-4464-aaf1-177a45bd98e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:42:42.403898 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5af192d-c4f7-4464-aaf1-177a45bd98e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:42:42.404185 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5af192d-c4f7-4464-aaf1-177a45bd98e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:42:42.404463 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5af192d-c4f7-4464-aaf1-177a45bd98e5 admin admin] PATH_INFO: `/v3/projects/29b80b7a608d4af2b5c605aff4a675c3` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:42:42.405595 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5af192d-c4f7-4464-aaf1-177a45bd98e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=29b80b7a608d4af2b5c605aff4a675c3)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:42:42.407541 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5af192d-c4f7-4464-aaf1-177a45bd98e5 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:42:42.455813 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-e5af192d-c4f7-4464-aaf1-177a45bd98e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29b80b7a608d4af2b5c605aff4a675c3', 'request_id': 'req-e5af192d-c4f7-4464-aaf1-177a45bd98e5'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:42:42.462557 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-e5af192d-c4f7-4464-aaf1-177a45bd98e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29b80b7a608d4af2b5c605aff4a675c3', 'request_id': 'req-e5af192d-c4f7-4464-aaf1-177a45bd98e5'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:42:42.469660 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-e5af192d-c4f7-4464-aaf1-177a45bd98e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29b80b7a608d4af2b5c605aff4a675c3', 'request_id': 'req-e5af192d-c4f7-4464-aaf1-177a45bd98e5'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:42:42.480484 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-e5af192d-c4f7-4464-aaf1-177a45bd98e5 admin admin] The token cache is being invalidate because project 29b80b7a608d4af2b5c605aff4a675c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 15:42:42.480777 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-e5af192d-c4f7-4464-aaf1-177a45bd98e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:42:42.481404 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-e5af192d-c4f7-4464-aaf1-177a45bd98e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:42:42.482897 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1467/2910] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 13 15:42:42 2022] DELETE /identity/v3/projects/29b80b7a608d4af2b5c605aff4a675c3 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:42:42.486804 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9df85b-bb2d-4163-aa71-d60ca7fbd07a service neutron] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:42:42.496894 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9df85b-bb2d-4163-aa71-d60ca7fbd07a service neutron] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:42:42.552845 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df949fd6-c3dc-4781-862f-220ead5f2979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:42:42.553661 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df949fd6-c3dc-4781-862f-220ead5f2979 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:42:42.553979 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df949fd6-c3dc-4781-862f-220ead5f2979 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:42:42.554257 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df949fd6-c3dc-4781-862f-220ead5f2979 admin admin] PATH_INFO: `/v3/users/ec220371a00444228fc296487d2c92d7` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:42:42.555393 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df949fd6-c3dc-4781-862f-220ead5f2979 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec220371a00444228fc296487d2c92d7)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:42:42.557313 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df949fd6-c3dc-4781-862f-220ead5f2979 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:42:42.604697 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-df949fd6-c3dc-4781-862f-220ead5f2979 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec220371a00444228fc296487d2c92d7'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:42:42.605418 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-df949fd6-c3dc-4781-862f-220ead5f2979 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec220371a00444228fc296487d2c92d7'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:42:42.606066 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-df949fd6-c3dc-4781-862f-220ead5f2979 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec220371a00444228fc296487d2c92d7'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:42:42.612879 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-df949fd6-c3dc-4781-862f-220ead5f2979 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec220371a00444228fc296487d2c92d7'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:42:42.617362 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:42:42.626959 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-df949fd6-c3dc-4781-862f-220ead5f2979 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec220371a00444228fc296487d2c92d7'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:42:42.639812 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1444/2911] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 13 15:42:42 2022] DELETE /identity/v3/users/ec220371a00444228fc296487d2c92d7 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:42:42.914189 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5af192d-c4f7-4464-aaf1-177a45bd98e5 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:42:42.915703 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-e5af192d-c4f7-4464-aaf1-177a45bd98e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:42:42.931297 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5af192d-c4f7-4464-aaf1-177a45bd98e5 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:42:42.989627 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42158b5-89ff-4861-9fe8-98c3c69d7ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:42:42.990319 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42158b5-89ff-4861-9fe8-98c3c69d7ca5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:42:42.990592 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42158b5-89ff-4861-9fe8-98c3c69d7ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:42:42.990872 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42158b5-89ff-4861-9fe8-98c3c69d7ca5 admin admin] PATH_INFO: `/v3/projects/83d9cfbcda5f4286a71a9773c7d8ba2e` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:42:42.992061 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42158b5-89ff-4861-9fe8-98c3c69d7ca5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=83d9cfbcda5f4286a71a9773c7d8ba2e)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:42:42.993994 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42158b5-89ff-4861-9fe8-98c3c69d7ca5 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:42:43.039828 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-a42158b5-89ff-4861-9fe8-98c3c69d7ca5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83d9cfbcda5f4286a71a9773c7d8ba2e', 'request_id': 'req-a42158b5-89ff-4861-9fe8-98c3c69d7ca5'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:42:43.045789 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-a42158b5-89ff-4861-9fe8-98c3c69d7ca5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83d9cfbcda5f4286a71a9773c7d8ba2e', 'request_id': 'req-a42158b5-89ff-4861-9fe8-98c3c69d7ca5'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:42:43.053004 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-a42158b5-89ff-4861-9fe8-98c3c69d7ca5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83d9cfbcda5f4286a71a9773c7d8ba2e', 'request_id': 'req-a42158b5-89ff-4861-9fe8-98c3c69d7ca5'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:42:43.057138 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:42:43.065840 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-a42158b5-89ff-4861-9fe8-98c3c69d7ca5 admin admin] The token cache is being invalidate because project 83d9cfbcda5f4286a71a9773c7d8ba2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 15:42:43.066316 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-a42158b5-89ff-4861-9fe8-98c3c69d7ca5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:42:43.066978 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-a42158b5-89ff-4861-9fe8-98c3c69d7ca5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:42:43.069015 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1468/2912] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 13 15:42:42 2022] DELETE /identity/v3/projects/83d9cfbcda5f4286a71a9773c7d8ba2e => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 15:42:43.074822 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f53616-d634-455c-9aeb-682db35be11a None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:42:43.075294 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f53616-d634-455c-9aeb-682db35be11a None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:42:43.075396 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f53616-d634-455c-9aeb-682db35be11a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:42:43.096023 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-54f53616-d634-455c-9aeb-682db35be11a None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:42:43.097236 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-54f53616-d634-455c-9aeb-682db35be11a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:42:43.156416 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1445/2913] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:42:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:42:43.164210 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2be310-5c05-450e-bc3b-ba2ed20c00a0 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:42:43.164432 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2be310-5c05-450e-bc3b-ba2ed20c00a0 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:42:43.164711 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2be310-5c05-450e-bc3b-ba2ed20c00a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:42:43.188315 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-5b2be310-5c05-450e-bc3b-ba2ed20c00a0 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:42:43.190207 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-5b2be310-5c05-450e-bc3b-ba2ed20c00a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:42:43.202958 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1469/2914] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:42:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 15:42:43.207292 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f53616-d634-455c-9aeb-682db35be11a None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:42:43.217202 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f53616-d634-455c-9aeb-682db35be11a None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:42:43.221890 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88560764-f01d-4bbb-8646-220f2e18fa49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:42:43.222494 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88560764-f01d-4bbb-8646-220f2e18fa49 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:42:43.222779 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88560764-f01d-4bbb-8646-220f2e18fa49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:42:43.223053 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88560764-f01d-4bbb-8646-220f2e18fa49 admin admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:42:43.223696 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88560764-f01d-4bbb-8646-220f2e18fa49 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 15:42:43.224005 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88560764-f01d-4bbb-8646-220f2e18fa49 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:42:43.225673 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88560764-f01d-4bbb-8646-220f2e18fa49 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:42:43.237189 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1446/2915] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Sep 13 15:42:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 15:42:43.242176 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2be310-5c05-450e-bc3b-ba2ed20c00a0 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:42:43.251564 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2be310-5c05-450e-bc3b-ba2ed20c00a0 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:42:43.256844 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574d888a-db4b-47b8-9cb1-c38841e60d40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:42:43.257518 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574d888a-db4b-47b8-9cb1-c38841e60d40 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:42:43.257843 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574d888a-db4b-47b8-9cb1-c38841e60d40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:42:43.258119 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574d888a-db4b-47b8-9cb1-c38841e60d40 admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:42:43.258753 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574d888a-db4b-47b8-9cb1-c38841e60d40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:42:43.260642 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574d888a-db4b-47b8-9cb1-c38841e60d40 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:42:43.287253 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1470/2916] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 13 15:42:43 2022] POST /identity/v3/projects => generated 383 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 15:42:43.291583 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88560764-f01d-4bbb-8646-220f2e18fa49 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:42:43.301475 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88560764-f01d-4bbb-8646-220f2e18fa49 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:42:43.357413 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd62b3e-cf1d-4608-a1dd-6347ed8191c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:42:43.358051 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd62b3e-cf1d-4608-a1dd-6347ed8191c6 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:42:43.358334 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd62b3e-cf1d-4608-a1dd-6347ed8191c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:42:43.358606 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd62b3e-cf1d-4608-a1dd-6347ed8191c6 admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:42:43.359229 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd62b3e-cf1d-4608-a1dd-6347ed8191c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:42:43.361126 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd62b3e-cf1d-4608-a1dd-6347ed8191c6 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:42:43.382513 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1447/2917] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 13 15:42:43 2022] POST /identity/v3/users => generated 292 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:42:43.386757 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574d888a-db4b-47b8-9cb1-c38841e60d40 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:42:43.397247 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574d888a-db4b-47b8-9cb1-c38841e60d40 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:42:43.401906 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829a24bc-291e-43c3-8f93-b5aae047d959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:42:43.402502 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829a24bc-291e-43c3-8f93-b5aae047d959 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:42:43.402780 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829a24bc-291e-43c3-8f93-b5aae047d959 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:42:43.403052 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829a24bc-291e-43c3-8f93-b5aae047d959 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:42:43.403684 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829a24bc-291e-43c3-8f93-b5aae047d959 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:42:43.405278 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829a24bc-291e-43c3-8f93-b5aae047d959 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:42:43.415274 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1471/2918] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:42:43 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 15:42:43.419181 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd62b3e-cf1d-4608-a1dd-6347ed8191c6 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:42:43.429929 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd62b3e-cf1d-4608-a1dd-6347ed8191c6 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:42:43.434678 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb16ba7a-1f0b-490c-bd00-f1955c09e09f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:42:43.435271 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb16ba7a-1f0b-490c-bd00-f1955c09e09f admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:42:43.435556 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb16ba7a-1f0b-490c-bd00-f1955c09e09f admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:42:43.435831 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb16ba7a-1f0b-490c-bd00-f1955c09e09f admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:42:43.436489 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb16ba7a-1f0b-490c-bd00-f1955c09e09f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:42:43.438112 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb16ba7a-1f0b-490c-bd00-f1955c09e09f admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:42:43.449289 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1448/2919] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:42:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 15:42:43.453977 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829a24bc-291e-43c3-8f93-b5aae047d959 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:42:43.464180 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829a24bc-291e-43c3-8f93-b5aae047d959 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:42:43.468782 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500735b0-a3c5-4faa-99d2-c499c62daf23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:42:43.469420 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500735b0-a3c5-4faa-99d2-c499c62daf23 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:42:43.469718 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500735b0-a3c5-4faa-99d2-c499c62daf23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:42:43.469996 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500735b0-a3c5-4faa-99d2-c499c62daf23 admin admin] PATH_INFO: `/v3/projects/b1aa5066d7854ee2b467c4a0ce83ab19/users/6c25baae38554bbea277c7f648fbb26c/roles/3fae3d3a28e147d3b2bede2378ff79ae` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:42:43.488888 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500735b0-a3c5-4faa-99d2-c499c62daf23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1aa5066d7854ee2b467c4a0ce83ab19, user_id=6c25baae38554bbea277c7f648fbb26c, role_id=3fae3d3a28e147d3b2bede2378ff79ae)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:42:43.492590 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500735b0-a3c5-4faa-99d2-c499c62daf23 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:42:43.504842 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1472/2920] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 13 15:42:43 2022] PUT /identity/v3/projects/b1aa5066d7854ee2b467c4a0ce83ab19/users/6c25baae38554bbea277c7f648fbb26c/roles/3fae3d3a28e147d3b2bede2378ff79ae => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:42:43.515300 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2707fe9-9a04-4eb8-bb27-823709e3b332 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:42:43.515639 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2707fe9-9a04-4eb8-bb27-823709e3b332 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:42:43.515919 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2707fe9-9a04-4eb8-bb27-823709e3b332 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:42:43.544046 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-f2707fe9-9a04-4eb8-bb27-823709e3b332 None None] MFA Rules not processed for user `6c25baae38554bbea277c7f648fbb26c`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:42:43.545278 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-f2707fe9-9a04-4eb8-bb27-823709e3b332 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:42:43.578398 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:42:43.612531 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1449/2921] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:42:43 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:42:43.617543 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500735b0-a3c5-4faa-99d2-c499c62daf23 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:42:43.677603 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500735b0-a3c5-4faa-99d2-c499c62daf23 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:42:43.682846 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db644abf-65ab-49d4-b786-25b5b8d3c5c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:42:43.683454 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db644abf-65ab-49d4-b786-25b5b8d3c5c1 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:42:43.683737 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db644abf-65ab-49d4-b786-25b5b8d3c5c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:42:43.684018 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db644abf-65ab-49d4-b786-25b5b8d3c5c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:42:43.684639 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db644abf-65ab-49d4-b786-25b5b8d3c5c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:42:43.686569 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db644abf-65ab-49d4-b786-25b5b8d3c5c1 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:42:43.718167 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1473/2922] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 13 15:42:43 2022] POST /identity/v3/projects => generated 385 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:42:43.722467 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2707fe9-9a04-4eb8-bb27-823709e3b332 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:42:43.733870 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2707fe9-9a04-4eb8-bb27-823709e3b332 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:42:43.790535 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf1ba89-b34a-46c8-88a9-c66dd61f1af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:42:43.791140 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf1ba89-b34a-46c8-88a9-c66dd61f1af6 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:42:43.791425 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf1ba89-b34a-46c8-88a9-c66dd61f1af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:42:43.791703 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf1ba89-b34a-46c8-88a9-c66dd61f1af6 admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:42:43.792348 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf1ba89-b34a-46c8-88a9-c66dd61f1af6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:42:43.794294 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf1ba89-b34a-46c8-88a9-c66dd61f1af6 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:42:43.815170 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1450/2923] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 13 15:42:43 2022] POST /identity/v3/users => generated 293 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:42:43.819252 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db644abf-65ab-49d4-b786-25b5b8d3c5c1 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:42:43.829804 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db644abf-65ab-49d4-b786-25b5b8d3c5c1 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:42:43.834396 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41352ce-e51f-4ca7-95ea-4513bfedb684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:42:43.834990 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41352ce-e51f-4ca7-95ea-4513bfedb684 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:42:43.835271 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41352ce-e51f-4ca7-95ea-4513bfedb684 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:42:43.835543 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41352ce-e51f-4ca7-95ea-4513bfedb684 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:42:43.836177 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41352ce-e51f-4ca7-95ea-4513bfedb684 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:42:43.837792 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41352ce-e51f-4ca7-95ea-4513bfedb684 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:42:43.848057 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1474/2924] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:42:43 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 15:42:43.852623 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf1ba89-b34a-46c8-88a9-c66dd61f1af6 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:42:43.862870 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf1ba89-b34a-46c8-88a9-c66dd61f1af6 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:42:43.868168 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47edc506-4376-4d66-b149-3debc3f70cd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:42:43.868760 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47edc506-4376-4d66-b149-3debc3f70cd2 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:42:43.869050 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47edc506-4376-4d66-b149-3debc3f70cd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:42:43.869328 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47edc506-4376-4d66-b149-3debc3f70cd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:42:43.870000 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47edc506-4376-4d66-b149-3debc3f70cd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:42:43.871597 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47edc506-4376-4d66-b149-3debc3f70cd2 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:42:43.881346 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1451/2925] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:42:43 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 15:42:43.885304 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41352ce-e51f-4ca7-95ea-4513bfedb684 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:42:43.895151 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41352ce-e51f-4ca7-95ea-4513bfedb684 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:42:43.900537 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c60a4e-2df2-4496-9b31-c8a696759ac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:42:43.901174 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c60a4e-2df2-4496-9b31-c8a696759ac0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:42:43.901457 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c60a4e-2df2-4496-9b31-c8a696759ac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:42:43.901761 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c60a4e-2df2-4496-9b31-c8a696759ac0 admin admin] PATH_INFO: `/v3/projects/b26b866927ac4254b1b402fdecad261e/users/f8ba80a0235f49c489eb5d53e606597e/roles/3fae3d3a28e147d3b2bede2378ff79ae` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:42:43.917377 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c60a4e-2df2-4496-9b31-c8a696759ac0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b26b866927ac4254b1b402fdecad261e, user_id=f8ba80a0235f49c489eb5d53e606597e, role_id=3fae3d3a28e147d3b2bede2378ff79ae)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:42:43.920084 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c60a4e-2df2-4496-9b31-c8a696759ac0 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:42:43.934680 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1475/2926] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 13 15:42:43 2022] PUT /identity/v3/projects/b26b866927ac4254b1b402fdecad261e/users/f8ba80a0235f49c489eb5d53e606597e/roles/3fae3d3a28e147d3b2bede2378ff79ae => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:42:43.946063 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24ded02-1535-4de3-9b13-93323ab681b0 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:42:43.946361 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24ded02-1535-4de3-9b13-93323ab681b0 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:42:43.946645 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24ded02-1535-4de3-9b13-93323ab681b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:42:43.976565 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-b24ded02-1535-4de3-9b13-93323ab681b0 None None] MFA Rules not processed for user `f8ba80a0235f49c489eb5d53e606597e`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:42:43.977842 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-b24ded02-1535-4de3-9b13-93323ab681b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:42:44.041140 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1452/2927] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:42:43 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:42:44.045629 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c60a4e-2df2-4496-9b31-c8a696759ac0 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:42:44.087240 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:DELETE=1,keystone:SELECT=95,keystone:INSERT=4 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:42:44.107663 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c60a4e-2df2-4496-9b31-c8a696759ac0 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:42:44.112334 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a56e38d-934c-4b69-b085-ed15475036ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:42:44.112938 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a56e38d-934c-4b69-b085-ed15475036ae admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:42:44.113222 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a56e38d-934c-4b69-b085-ed15475036ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:42:44.113498 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a56e38d-934c-4b69-b085-ed15475036ae admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:42:44.114180 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a56e38d-934c-4b69-b085-ed15475036ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:42:44.116103 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a56e38d-934c-4b69-b085-ed15475036ae admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:42:44.141474 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1476/2928] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 13 15:42:44 2022] POST /identity/v3/projects => generated 385 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:42:44.145535 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24ded02-1535-4de3-9b13-93323ab681b0 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:42:44.156828 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24ded02-1535-4de3-9b13-93323ab681b0 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:42:44.199496 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:42:44.217864 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad522ff-4316-4c10-bbda-1717e42e7f9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:42:44.218468 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad522ff-4316-4c10-bbda-1717e42e7f9e admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:42:44.218766 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad522ff-4316-4c10-bbda-1717e42e7f9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:42:44.219018 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad522ff-4316-4c10-bbda-1717e42e7f9e admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:42:44.219653 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad522ff-4316-4c10-bbda-1717e42e7f9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:42:44.221549 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad522ff-4316-4c10-bbda-1717e42e7f9e admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:42:44.243759 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1453/2929] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 13 15:42:44 2022] POST /identity/v3/users => generated 299 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 15:42:44.247774 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a56e38d-934c-4b69-b085-ed15475036ae admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:42:44.258473 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a56e38d-934c-4b69-b085-ed15475036ae admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:42:44.263055 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff04b5e4-e46b-4c92-9f8c-588caa4038b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:42:44.263653 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff04b5e4-e46b-4c92-9f8c-588caa4038b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:42:44.263935 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff04b5e4-e46b-4c92-9f8c-588caa4038b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:42:44.264212 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff04b5e4-e46b-4c92-9f8c-588caa4038b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:42:44.264855 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff04b5e4-e46b-4c92-9f8c-588caa4038b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:42:44.266503 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff04b5e4-e46b-4c92-9f8c-588caa4038b4 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:42:44.277042 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1477/2930] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:42:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 15:42:44.281291 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad522ff-4316-4c10-bbda-1717e42e7f9e admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:42:44.294863 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad522ff-4316-4c10-bbda-1717e42e7f9e admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:42:44.300951 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63e2013-0561-4341-be89-156bf75d11b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:42:44.301599 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63e2013-0561-4341-be89-156bf75d11b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:42:44.301909 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63e2013-0561-4341-be89-156bf75d11b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:42:44.302187 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63e2013-0561-4341-be89-156bf75d11b8 admin admin] PATH_INFO: `/v3/projects/936a90eba2bf4bbaac5194a914827be9/users/c93b0c907cdc4db9881b9033c272286f/roles/f34412ad29f1478cba775b033129f71f` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:42:44.317630 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63e2013-0561-4341-be89-156bf75d11b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=936a90eba2bf4bbaac5194a914827be9, user_id=c93b0c907cdc4db9881b9033c272286f, role_id=f34412ad29f1478cba775b033129f71f)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:42:44.320314 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63e2013-0561-4341-be89-156bf75d11b8 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:42:44.333196 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1454/2931] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 13 15:42:44 2022] PUT /identity/v3/projects/936a90eba2bf4bbaac5194a914827be9/users/c93b0c907cdc4db9881b9033c272286f/roles/f34412ad29f1478cba775b033129f71f => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:42:44.337210 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff04b5e4-e46b-4c92-9f8c-588caa4038b4 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:42:44.347121 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff04b5e4-e46b-4c92-9f8c-588caa4038b4 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:42:44.402170 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36570ca-dce4-43cf-956a-4dad95a4428a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:42:44.402801 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36570ca-dce4-43cf-956a-4dad95a4428a admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:42:44.403083 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36570ca-dce4-43cf-956a-4dad95a4428a admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:42:44.403359 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36570ca-dce4-43cf-956a-4dad95a4428a admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:42:44.403990 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36570ca-dce4-43cf-956a-4dad95a4428a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:42:44.405579 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36570ca-dce4-43cf-956a-4dad95a4428a admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:42:44.415803 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1478/2932] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 13 15:42:44 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 15:42:44.419970 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63e2013-0561-4341-be89-156bf75d11b8 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:42:44.430870 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63e2013-0561-4341-be89-156bf75d11b8 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:42:44.435434 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdb3cca-aa7c-4c98-9d8d-3ed6afec4737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:42:44.436084 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdb3cca-aa7c-4c98-9d8d-3ed6afec4737 admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:42:44.436366 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdb3cca-aa7c-4c98-9d8d-3ed6afec4737 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:42:44.436643 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdb3cca-aa7c-4c98-9d8d-3ed6afec4737 admin admin] PATH_INFO: `/v3/projects/936a90eba2bf4bbaac5194a914827be9/users/c93b0c907cdc4db9881b9033c272286f/roles/f34412ad29f1478cba775b033129f71f` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:42:44.438592 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdb3cca-aa7c-4c98-9d8d-3ed6afec4737 admin admin] RBAC: Authorizing `identity:create_grant(project_id=936a90eba2bf4bbaac5194a914827be9, user_id=c93b0c907cdc4db9881b9033c272286f, role_id=f34412ad29f1478cba775b033129f71f)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:42:44.441206 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdb3cca-aa7c-4c98-9d8d-3ed6afec4737 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:42:44.451489 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1455/2933] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 13 15:42:44 2022] PUT /identity/v3/projects/936a90eba2bf4bbaac5194a914827be9/users/c93b0c907cdc4db9881b9033c272286f/roles/f34412ad29f1478cba775b033129f71f => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:42:44.461829 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780575f4-f362-452f-9caf-5c1f5e6828b0 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:42:44.462123 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780575f4-f362-452f-9caf-5c1f5e6828b0 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:42:44.462405 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780575f4-f362-452f-9caf-5c1f5e6828b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:42:44.491652 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-780575f4-f362-452f-9caf-5c1f5e6828b0 None None] MFA Rules not processed for user `c93b0c907cdc4db9881b9033c272286f`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:42:44.492856 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-780575f4-f362-452f-9caf-5c1f5e6828b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:42:44.559403 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1479/2934] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:42:44 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:42:44.570579 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdb3cca-aa7c-4c98-9d8d-3ed6afec4737 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:42:44.572323 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-0bdb3cca-aa7c-4c98-9d8d-3ed6afec4737 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:42:44.630102 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdb3cca-aa7c-4c98-9d8d-3ed6afec4737 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:42:44.633941 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d833f55e-9462-414e-9f47-651b1d49aea2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97acd23097d54bf7805c3cef60626ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:42:44.634548 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d833f55e-9462-414e-9f47-651b1d49aea2 service cinder] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:42:44.634831 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d833f55e-9462-414e-9f47-651b1d49aea2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:42:44.635106 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d833f55e-9462-414e-9f47-651b1d49aea2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:42:44.691471 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d833f55e-9462-414e-9f47-651b1d49aea2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:42:44.692906 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d833f55e-9462-414e-9f47-651b1d49aea2 service cinder] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:42:44.702106 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1456/2935] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:42:44 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:42:46.214677 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780575f4-f362-452f-9caf-5c1f5e6828b0 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:42:46.216142 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-780575f4-f362-452f-9caf-5c1f5e6828b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:42:46.228093 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780575f4-f362-452f-9caf-5c1f5e6828b0 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:42:46.231628 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93d65ee-bc61-4f34-b41c-c23581d7b1b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97acd23097d54bf7805c3cef60626ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:42:46.232226 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93d65ee-bc61-4f34-b41c-c23581d7b1b3 service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:42:46.232505 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93d65ee-bc61-4f34-b41c-c23581d7b1b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:42:46.232778 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93d65ee-bc61-4f34-b41c-c23581d7b1b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:42:46.265243 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:42:46.290044 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93d65ee-bc61-4f34-b41c-c23581d7b1b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:42:46.291488 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93d65ee-bc61-4f34-b41c-c23581d7b1b3 service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:42:46.300264 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1480/2936] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:42:46 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:42:46.818167 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d833f55e-9462-414e-9f47-651b1d49aea2 service cinder] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:42:46.827018 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d833f55e-9462-414e-9f47-651b1d49aea2 service cinder] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:42:46.830851 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b454381-a235-4087-a841-d8f52b8436cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97acd23097d54bf7805c3cef60626ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:42:46.831442 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b454381-a235-4087-a841-d8f52b8436cc service cinder] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:42:46.831719 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b454381-a235-4087-a841-d8f52b8436cc service cinder] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:42:46.831989 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b454381-a235-4087-a841-d8f52b8436cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:42:46.841011 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b454381-a235-4087-a841-d8f52b8436cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:42:46.842454 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b454381-a235-4087-a841-d8f52b8436cc service cinder] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:42:46.853017 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1457/2937] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:42:46 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:42:50.743875 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93d65ee-bc61-4f34-b41c-c23581d7b1b3 service cinder] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:42:50.825268 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93d65ee-bc61-4f34-b41c-c23581d7b1b3 service cinder] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:42:50.830364 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5769750-33cd-40b9-b076-99e3dfbf1b9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:42:50.830993 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5769750-33cd-40b9-b076-99e3dfbf1b9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:42:50.831275 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5769750-33cd-40b9-b076-99e3dfbf1b9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:42:50.831549 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5769750-33cd-40b9-b076-99e3dfbf1b9b admin admin] PATH_INFO: `/v3/users/6c25baae38554bbea277c7f648fbb26c` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:42:50.832661 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5769750-33cd-40b9-b076-99e3dfbf1b9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c25baae38554bbea277c7f648fbb26c)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:42:50.834683 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5769750-33cd-40b9-b076-99e3dfbf1b9b admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:42:50.881090 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-f5769750-33cd-40b9-b076-99e3dfbf1b9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c25baae38554bbea277c7f648fbb26c'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:42:50.881772 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-f5769750-33cd-40b9-b076-99e3dfbf1b9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c25baae38554bbea277c7f648fbb26c'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:42:50.882388 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-f5769750-33cd-40b9-b076-99e3dfbf1b9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c25baae38554bbea277c7f648fbb26c'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:42:50.889537 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-f5769750-33cd-40b9-b076-99e3dfbf1b9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c25baae38554bbea277c7f648fbb26c'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:42:50.901957 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-f5769750-33cd-40b9-b076-99e3dfbf1b9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c25baae38554bbea277c7f648fbb26c'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:42:50.915847 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1481/2938] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 13 15:42:50 2022] DELETE /identity/v3/users/6c25baae38554bbea277c7f648fbb26c => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:42:50.920294 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82faddc1-7967-4e4c-905a-7b59f0b779c8 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:42:50.920810 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82faddc1-7967-4e4c-905a-7b59f0b779c8 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:42:50.920920 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82faddc1-7967-4e4c-905a-7b59f0b779c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:42:50.939701 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-82faddc1-7967-4e4c-905a-7b59f0b779c8 None None] MFA Rules not processed for user `50d6e356b66c47338a3bc6aea3a43029`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 15:42:50.940911 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-82faddc1-7967-4e4c-905a-7b59f0b779c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:42:50.973475 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:42:51.004182 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1458/2939] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 13 15:42:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 15:42:51.014631 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5769750-33cd-40b9-b076-99e3dfbf1b9b admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:42:51.016073 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-f5769750-33cd-40b9-b076-99e3dfbf1b9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:42:51.073654 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5769750-33cd-40b9-b076-99e3dfbf1b9b admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:42:51.077385 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988fa800-ed5c-4f54-92d1-335a503f7f8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41675154bbba47388040966f75d84c3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:42:51.078310 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988fa800-ed5c-4f54-92d1-335a503f7f8c service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:42:51.078591 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988fa800-ed5c-4f54-92d1-335a503f7f8c service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:42:51.078865 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988fa800-ed5c-4f54-92d1-335a503f7f8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:42:51.088418 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:42:51.090806 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988fa800-ed5c-4f54-92d1-335a503f7f8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:42:51.092607 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988fa800-ed5c-4f54-92d1-335a503f7f8c service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:42:51.105035 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1482/2940] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:42:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:42:51.379071 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82faddc1-7967-4e4c-905a-7b59f0b779c8 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:42:51.380670 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-82faddc1-7967-4e4c-905a-7b59f0b779c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:42:51.394951 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82faddc1-7967-4e4c-905a-7b59f0b779c8 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:42:51.400589 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57696c97-5965-4c87-a9af-2c05b29193b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:42:51.401261 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57696c97-5965-4c87-a9af-2c05b29193b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:42:51.401548 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57696c97-5965-4c87-a9af-2c05b29193b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:42:51.401863 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57696c97-5965-4c87-a9af-2c05b29193b1 admin admin] PATH_INFO: `/v3/projects/b1aa5066d7854ee2b467c4a0ce83ab19` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:42:51.403021 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57696c97-5965-4c87-a9af-2c05b29193b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1aa5066d7854ee2b467c4a0ce83ab19)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:42:51.405575 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57696c97-5965-4c87-a9af-2c05b29193b1 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:42:51.455619 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-57696c97-5965-4c87-a9af-2c05b29193b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1aa5066d7854ee2b467c4a0ce83ab19', 'request_id': 'req-57696c97-5965-4c87-a9af-2c05b29193b1'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:42:51.462151 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-57696c97-5965-4c87-a9af-2c05b29193b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1aa5066d7854ee2b467c4a0ce83ab19', 'request_id': 'req-57696c97-5965-4c87-a9af-2c05b29193b1'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:42:51.467774 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-57696c97-5965-4c87-a9af-2c05b29193b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1aa5066d7854ee2b467c4a0ce83ab19', 'request_id': 'req-57696c97-5965-4c87-a9af-2c05b29193b1'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:42:51.478898 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-57696c97-5965-4c87-a9af-2c05b29193b1 admin admin] The token cache is being invalidate because project b1aa5066d7854ee2b467c4a0ce83ab19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 15:42:51.479195 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-57696c97-5965-4c87-a9af-2c05b29193b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:42:51.479820 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-57696c97-5965-4c87-a9af-2c05b29193b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:42:51.481283 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1459/2941] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 13 15:42:51 2022] DELETE /identity/v3/projects/b1aa5066d7854ee2b467c4a0ce83ab19 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:42:51.485247 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988fa800-ed5c-4f54-92d1-335a503f7f8c service neutron] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:42:51.495582 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988fa800-ed5c-4f54-92d1-335a503f7f8c service neutron] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:42:51.550091 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40467190-b2d7-40a6-b61d-f3429d79df43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:42:51.550713 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40467190-b2d7-40a6-b61d-f3429d79df43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:42:51.550993 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40467190-b2d7-40a6-b61d-f3429d79df43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:42:51.551270 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40467190-b2d7-40a6-b61d-f3429d79df43 admin admin] PATH_INFO: `/v3/users/f8ba80a0235f49c489eb5d53e606597e` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:42:51.552379 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40467190-b2d7-40a6-b61d-f3429d79df43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8ba80a0235f49c489eb5d53e606597e)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:42:51.554350 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40467190-b2d7-40a6-b61d-f3429d79df43 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:42:51.599719 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-40467190-b2d7-40a6-b61d-f3429d79df43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8ba80a0235f49c489eb5d53e606597e'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:42:51.600358 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-40467190-b2d7-40a6-b61d-f3429d79df43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8ba80a0235f49c489eb5d53e606597e'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:42:51.600966 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-40467190-b2d7-40a6-b61d-f3429d79df43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8ba80a0235f49c489eb5d53e606597e'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:42:51.607999 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-40467190-b2d7-40a6-b61d-f3429d79df43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8ba80a0235f49c489eb5d53e606597e'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:42:51.620141 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-40467190-b2d7-40a6-b61d-f3429d79df43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8ba80a0235f49c489eb5d53e606597e'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:42:51.632792 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1483/2942] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 13 15:42:51 2022] DELETE /identity/v3/users/f8ba80a0235f49c489eb5d53e606597e => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:42:51.906573 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57696c97-5965-4c87-a9af-2c05b29193b1 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:42:51.908078 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-57696c97-5965-4c87-a9af-2c05b29193b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:42:51.923389 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57696c97-5965-4c87-a9af-2c05b29193b1 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:42:51.983538 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15b43a5-de48-4bd5-b27b-6bc2dc4a7d93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:42:51.984100 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15b43a5-de48-4bd5-b27b-6bc2dc4a7d93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:42:51.984384 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15b43a5-de48-4bd5-b27b-6bc2dc4a7d93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:42:51.984661 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15b43a5-de48-4bd5-b27b-6bc2dc4a7d93 admin admin] PATH_INFO: `/v3/projects/b26b866927ac4254b1b402fdecad261e` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:42:51.985859 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15b43a5-de48-4bd5-b27b-6bc2dc4a7d93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b26b866927ac4254b1b402fdecad261e)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:42:51.987759 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15b43a5-de48-4bd5-b27b-6bc2dc4a7d93 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:42:52.033680 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-a15b43a5-de48-4bd5-b27b-6bc2dc4a7d93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b26b866927ac4254b1b402fdecad261e', 'request_id': 'req-a15b43a5-de48-4bd5-b27b-6bc2dc4a7d93'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:42:52.040367 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-a15b43a5-de48-4bd5-b27b-6bc2dc4a7d93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b26b866927ac4254b1b402fdecad261e', 'request_id': 'req-a15b43a5-de48-4bd5-b27b-6bc2dc4a7d93'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:42:52.045007 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:42:52.046394 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-a15b43a5-de48-4bd5-b27b-6bc2dc4a7d93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b26b866927ac4254b1b402fdecad261e', 'request_id': 'req-a15b43a5-de48-4bd5-b27b-6bc2dc4a7d93'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:42:52.060642 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-a15b43a5-de48-4bd5-b27b-6bc2dc4a7d93 admin admin] The token cache is being invalidate because project b26b866927ac4254b1b402fdecad261e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 15:42:52.061148 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-a15b43a5-de48-4bd5-b27b-6bc2dc4a7d93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:42:52.061997 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-a15b43a5-de48-4bd5-b27b-6bc2dc4a7d93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:42:52.063512 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1460/2943] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 13 15:42:51 2022] DELETE /identity/v3/projects/b26b866927ac4254b1b402fdecad261e => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:42:52.067594 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40467190-b2d7-40a6-b61d-f3429d79df43 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:42:52.069036 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-40467190-b2d7-40a6-b61d-f3429d79df43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:42:52.082576 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40467190-b2d7-40a6-b61d-f3429d79df43 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:42:52.139573 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7e21d0-b7c4-49a0-b81f-4942916d6aef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:42:52.140210 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7e21d0-b7c4-49a0-b81f-4942916d6aef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:42:52.140496 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7e21d0-b7c4-49a0-b81f-4942916d6aef admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:42:52.140777 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7e21d0-b7c4-49a0-b81f-4942916d6aef admin admin] PATH_INFO: `/v3/users/c93b0c907cdc4db9881b9033c272286f` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:42:52.142003 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7e21d0-b7c4-49a0-b81f-4942916d6aef admin admin] RBAC: Authorizing `identity:delete_user(user_id=c93b0c907cdc4db9881b9033c272286f)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:42:52.144000 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7e21d0-b7c4-49a0-b81f-4942916d6aef admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:42:52.159040 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:42:52.189133 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-5a7e21d0-b7c4-49a0-b81f-4942916d6aef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c93b0c907cdc4db9881b9033c272286f'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:42:52.189840 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-5a7e21d0-b7c4-49a0-b81f-4942916d6aef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c93b0c907cdc4db9881b9033c272286f'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:42:52.190458 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-5a7e21d0-b7c4-49a0-b81f-4942916d6aef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c93b0c907cdc4db9881b9033c272286f'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:42:52.198318 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-5a7e21d0-b7c4-49a0-b81f-4942916d6aef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c93b0c907cdc4db9881b9033c272286f'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:42:52.210443 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-5a7e21d0-b7c4-49a0-b81f-4942916d6aef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c93b0c907cdc4db9881b9033c272286f'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:42:52.222929 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1484/2944] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 13 15:42:52 2022] DELETE /identity/v3/users/c93b0c907cdc4db9881b9033c272286f => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:42:52.505249 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15b43a5-de48-4bd5-b27b-6bc2dc4a7d93 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:42:52.506722 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-a15b43a5-de48-4bd5-b27b-6bc2dc4a7d93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:42:52.520737 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15b43a5-de48-4bd5-b27b-6bc2dc4a7d93 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:42:52.579410 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f227348d-7323-4f1d-981b-f42c488a32b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d6e356b66c47338a3bc6aea3a43029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7edec545f8774b83a9353b60f81fc3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:42:52.580023 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f227348d-7323-4f1d-981b-f42c488a32b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:42:52.580302 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f227348d-7323-4f1d-981b-f42c488a32b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:42:52.580575 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f227348d-7323-4f1d-981b-f42c488a32b4 admin admin] PATH_INFO: `/v3/projects/936a90eba2bf4bbaac5194a914827be9` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:42:52.581680 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f227348d-7323-4f1d-981b-f42c488a32b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=936a90eba2bf4bbaac5194a914827be9)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:42:52.583600 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f227348d-7323-4f1d-981b-f42c488a32b4 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:42:52.629894 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-f227348d-7323-4f1d-981b-f42c488a32b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '936a90eba2bf4bbaac5194a914827be9', 'request_id': 'req-f227348d-7323-4f1d-981b-f42c488a32b4'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:42:52.636691 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-f227348d-7323-4f1d-981b-f42c488a32b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '936a90eba2bf4bbaac5194a914827be9', 'request_id': 'req-f227348d-7323-4f1d-981b-f42c488a32b4'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:42:52.642226 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-f227348d-7323-4f1d-981b-f42c488a32b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '936a90eba2bf4bbaac5194a914827be9', 'request_id': 'req-f227348d-7323-4f1d-981b-f42c488a32b4'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:42:52.655420 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-f227348d-7323-4f1d-981b-f42c488a32b4 admin admin] The token cache is being invalidate because project 936a90eba2bf4bbaac5194a914827be9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 15:42:52.655717 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-f227348d-7323-4f1d-981b-f42c488a32b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:42:52.656371 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-f227348d-7323-4f1d-981b-f42c488a32b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 15:42:52.657908 dv-cinder-857434-2-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1461/2945] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 13 15:42:52 2022] DELETE /identity/v3/projects/936a90eba2bf4bbaac5194a914827be9 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 15:43:00.187006 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7e21d0-b7c4-49a0-b81f-4942916d6aef admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 15:43:00.188523 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-5a7e21d0-b7c4-49a0-b81f-4942916d6aef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:43:00.257217 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7e21d0-b7c4-49a0-b81f-4942916d6aef admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 15:43:00.315988 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7027734-22f5-4c9d-8fd3-6995e439c846 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b56f96cb3184a3ba82c8a0c3427e268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6e00339cfa47d2a6fa8724c587035f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 15:43:00.316594 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7027734-22f5-4c9d-8fd3-6995e439c846 service placement] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 15:43:00.316872 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7027734-22f5-4c9d-8fd3-6995e439c846 service placement] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 15:43:00.317142 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7027734-22f5-4c9d-8fd3-6995e439c846 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 15:43:00.318872 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-b7027734-22f5-4c9d-8fd3-6995e439c846 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 15:43:00.333039 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7027734-22f5-4c9d-8fd3-6995e439c846 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 15:43:00.334641 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7027734-22f5-4c9d-8fd3-6995e439c846 service placement] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 15:43:00.344651 dv-cinder-857434-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1485/2946] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 13 15:43:00 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 15:43:02.652367 dv-cinder-857434-2-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=54,keystone:INSERT=2,keystone:DELETE=8 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:43:10.340509 dv-cinder-857434-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:DELETE=9,keystone:SELECT=78,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}